-- Logs begin at Tue 2021-10-12 17:30:35 UTC, end at Tue 2021-10-12 18:48:20 UTC. -- Oct 12 18:03:49.834443 dv-cinder-813227-2-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Oct 12 18:03:49.842370 dv-cinder-813227-2-iscsi devstack@keystone.service[73992]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 12 18:03:49.844419 dv-cinder-813227-2-iscsi devstack@keystone.service[73992]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 12 18:03:49 2021] *** Oct 12 18:03:49.844419 dv-cinder-813227-2-iscsi devstack@keystone.service[73992]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 12 18:03:49.845463 dv-cinder-813227-2-iscsi devstack@keystone.service[73992]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 12 18:03:49.845463 dv-cinder-813227-2-iscsi devstack@keystone.service[73992]: nodename: dv-cinder-813227-2-iscsi Oct 12 18:03:49.845463 dv-cinder-813227-2-iscsi devstack@keystone.service[73992]: machine: x86_64 Oct 12 18:03:49.845463 dv-cinder-813227-2-iscsi devstack@keystone.service[73992]: clock source: unix Oct 12 18:03:49.845463 dv-cinder-813227-2-iscsi devstack@keystone.service[73992]: pcre jit disabled Oct 12 18:03:49.845463 dv-cinder-813227-2-iscsi devstack@keystone.service[73992]: detected number of CPU cores: 4 Oct 12 18:03:49.845463 dv-cinder-813227-2-iscsi devstack@keystone.service[73992]: current working directory: / Oct 12 18:03:49.845463 dv-cinder-813227-2-iscsi devstack@keystone.service[73992]: detected binary path: /usr/bin/uwsgi-core Oct 12 18:03:49.845463 dv-cinder-813227-2-iscsi devstack@keystone.service[73992]: your processes number limit is 47680 Oct 12 18:03:49.845463 dv-cinder-813227-2-iscsi devstack@keystone.service[73992]: your memory page size is 4096 bytes Oct 12 18:03:49.846020 dv-cinder-813227-2-iscsi devstack@keystone.service[73992]: detected max file descriptor number: 2048 Oct 12 18:03:49.846020 dv-cinder-813227-2-iscsi devstack@keystone.service[73992]: lock engine: pthread robust mutexes Oct 12 18:03:49.846020 dv-cinder-813227-2-iscsi devstack@keystone.service[73992]: thunder lock: enabled Oct 12 18:03:49.846020 dv-cinder-813227-2-iscsi devstack@keystone.service[73992]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 12 18:03:49.846020 dv-cinder-813227-2-iscsi devstack@keystone.service[73992]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Oct 12 18:03:49.890220 dv-cinder-813227-2-iscsi devstack@keystone.service[73992]: Python main interpreter initialized at 0x5642541e99c0 Oct 12 18:03:49.890220 dv-cinder-813227-2-iscsi devstack@keystone.service[73992]: python threads support enabled Oct 12 18:03:49.890220 dv-cinder-813227-2-iscsi devstack@keystone.service[73992]: your server socket listen backlog is limited to 100 connections Oct 12 18:03:49.890220 dv-cinder-813227-2-iscsi devstack@keystone.service[73992]: your mercy for graceful operations on workers is 90 seconds Oct 12 18:03:49.890826 dv-cinder-813227-2-iscsi devstack@keystone.service[73992]: mapped 403077 bytes (393 KB) for 2 cores Oct 12 18:03:49.890826 dv-cinder-813227-2-iscsi devstack@keystone.service[73992]: *** Operational MODE: preforking *** Oct 12 18:03:49.891111 dv-cinder-813227-2-iscsi devstack@keystone.service[73992]: *** uWSGI is running in multiple interpreter mode *** Oct 12 18:03:49.891111 dv-cinder-813227-2-iscsi devstack@keystone.service[73992]: spawned uWSGI master process (pid: 73992) Oct 12 18:03:49.891313 dv-cinder-813227-2-iscsi systemd[1]: Started Devstack devstack@keystone.service. Oct 12 18:03:49.892432 dv-cinder-813227-2-iscsi devstack@keystone.service[73992]: spawned uWSGI worker 1 (pid: 74005, cores: 1) Oct 12 18:03:49.892432 dv-cinder-813227-2-iscsi devstack@keystone.service[73992]: spawned uWSGI worker 2 (pid: 74006, cores: 1) Oct 12 18:03:49.894340 dv-cinder-813227-2-iscsi devstack@keystone.service[73992]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 12 18:03:55.012180 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 18:03:55.012180 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: from cryptography.utils import int_from_bytes Oct 12 18:03:55.012979 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 18:03:55.012979 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: from cryptography.utils import int_from_bytes Oct 12 18:03:55.013393 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 18:03:55.013393 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: from cryptography.utils import int_from_bytes Oct 12 18:03:55.013498 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 18:03:55.013498 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: from cryptography.utils import int_from_bytes Oct 12 18:03:55.069515 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 12 18:03:55.069703 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 12 18:03:55.069793 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 12 18:03:55.069886 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] command line args: [] {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 12 18:03:55.069966 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 12 18:03:55.070149 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] command line args: [] {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 12 18:03:55.070237 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 12 18:03:55.070309 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] ================================================================================ {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 12 18:03:55.070427 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 12 18:03:55.070572 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] admin_token = **** {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.070656 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] ================================================================================ {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 12 18:03:55.070847 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] config_dir = [] {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.070940 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] admin_token = **** {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.071043 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.071122 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] config_dir = [] {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.071230 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] config_source = [] {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.071308 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.071411 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] debug = True {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.071499 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] config_source = [] {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.071604 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] debug = True {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.071685 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.071914 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.072050 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.072154 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.072255 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] insecure_debug = False {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.072355 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] insecure_debug = False {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.072497 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.072688 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.072794 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.072890 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.072985 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] list_limit = None {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.073085 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] list_limit = None {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.073179 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] log_config_append = None {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.073283 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] log_config_append = None {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.073385 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.073486 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.073667 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] log_dir = None {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.073806 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] log_dir = None {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.073981 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] log_file = None {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.074126 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] log_file = None {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.074203 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.074323 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.074404 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.074523 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.074604 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.074728 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.074809 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.074889 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.075005 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.075081 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.075206 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.075289 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.075362 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.075431 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.075550 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.075631 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.075747 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.075864 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.075945 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.076057 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.076137 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.076264 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.076373 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.076586 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.076712 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.076795 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.076922 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] notification_format = cadf {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.077003 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] notification_format = cadf {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.077126 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.077214 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.077409 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.077529 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.077615 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] publish_errors = False {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.077687 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] publish_errors = False {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.077802 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.077907 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.078041 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.078182 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.078265 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.078339 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.078463 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.078631 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.078764 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.078885 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.079007 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] standard_threads = False {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.079134 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] standard_threads = False {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.079266 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] strict_password_check = False {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.079399 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] strict_password_check = False {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.079527 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.079661 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.079796 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] use_eventlog = False {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.079925 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] use_eventlog = False {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.080052 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] use_journal = False {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.080184 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] use_journal = False {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.080318 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] use_json = False {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.080556 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] use_json = False {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.080695 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] use_stderr = False {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.080825 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] use_stderr = False {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.080963 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] use_syslog = False {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.081105 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] use_syslog = False {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.081234 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] watch_log_file = False {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.081364 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] watch_log_file = False {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:03:55.081494 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.081577 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.081656 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.081736 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.081813 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.081930 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.082012 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.082089 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.082166 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.082312 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.082394 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.082465 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.082534 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.082610 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.082680 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.082757 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.082835 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.082906 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.082976 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.083045 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.083115 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.083195 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.083267 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.083337 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.083510 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.083589 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.083747 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.083835 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.083997 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.084073 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.084247 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.084334 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.084517 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.084611 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.084782 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.084860 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.085034 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.085112 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.085275 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.085360 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.085537 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.085616 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.085811 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.085887 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.086068 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.086168 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.086318 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.086414 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.086555 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.086635 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.086789 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.086873 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.087023 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.087102 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.087275 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.087372 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.087534 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.087613 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.087783 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.087860 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.088016 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.088093 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.088248 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.088325 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.088524 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.088605 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.088778 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.092048 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.092048 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.092215 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.092305 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.092381 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.092473 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.092546 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.092546 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.092675 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.092768 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.092843 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.092914 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.092991 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.093068 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.093141 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.093220 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.093294 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.093365 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.093436 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.093507 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.093577 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.093655 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.093729 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.093805 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.093877 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.093948 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.094024 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.094105 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.094178 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.094249 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.094320 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.094390 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.094469 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.094542 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.094613 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.094725 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.094806 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.094880 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.094964 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.095039 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.095111 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.095181 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.095251 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.095322 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.095322 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.095468 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.095540 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.095610 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.095681 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.095760 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.095840 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.095919 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.095993 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.096070 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.096142 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.096212 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.096290 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.096363 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.096472 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.096548 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.096628 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.096707 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.096780 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.096862 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.096936 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.097007 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.097078 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.097149 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.097220 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.097298 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.097372 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.097443 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.097519 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.097591 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.097662 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] cache.enabled = True {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.097740 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.097814 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.097890 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] cache.enabled = True {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.098007 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.098094 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.098249 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.098338 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.098486 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.098571 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.098723 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.098806 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.098957 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.099036 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.099193 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.099273 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.099448 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.099526 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.099687 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.099782 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.099922 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.100009 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.100152 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.100232 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.100385 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.100498 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.100642 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.100721 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.100877 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.100965 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.101115 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.101190 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.101334 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.101416 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.101571 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.101650 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.101816 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.101895 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.102550 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.102636 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.102820 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.102900 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.103081 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.103162 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.103319 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] auth.external = None {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.103397 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.103549 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] auth.external = None {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.103626 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] auth.mapped = None {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.103783 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] auth.mapped = None {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.103870 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.104087 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.104206 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.104324 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.104436 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] auth.password = None {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.104530 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] auth.password = None {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.104611 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] auth.token = None {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.104772 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] auth.token = None {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.104858 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.105013 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.105092 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] catalog.caching = True {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.105249 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] catalog.caching = True {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.105329 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.105492 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.105575 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.105721 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.105798 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.105971 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.106053 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.106215 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.106293 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.106443 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.106522 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] credential.caching = True {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.106680 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] credential.caching = True {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.106769 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] credential.driver = sql {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.106930 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] credential.driver = sql {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.107012 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.107182 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.107260 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.107424 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.107504 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.107661 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.107741 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.107902 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.107981 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.108135 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.108214 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.108386 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.108485 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.108665 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.108745 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.108904 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.108989 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.109161 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.109244 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.109437 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.109560 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.109681 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.109760 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.109941 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.110021 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.110184 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.110268 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.110435 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] federation.caching = True {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.110555 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.110679 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.110762 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] federation.caching = True {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.110948 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] federation.driver = sql {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.111029 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.111204 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.111290 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] federation.driver = sql {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.111441 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.111522 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.111695 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.111777 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.111937 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.112028 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.112190 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.112277 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.112449 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.112531 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.112701 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.112792 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.112944 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.113027 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.113189 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.113271 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.113427 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] identity.caching = True {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.113515 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.113664 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] identity.caching = True {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.113750 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.113917 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.113997 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.114155 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.114242 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.114395 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.114475 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.114634 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.114719 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] identity.driver = sql {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.114882 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.114972 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] identity.driver = sql {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.115113 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.115191 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.115355 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.115435 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.115611 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.115697 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.115849 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.115930 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.116083 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.116161 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.116316 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.116417 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.116574 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.116652 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.116823 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.116907 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.117075 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.117166 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.117323 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.117408 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.117577 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.117655 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.118352 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.118520 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.118648 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.118729 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.118890 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.118973 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.119128 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.119216 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.119363 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.119443 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.119596 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.119674 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.119826 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.119912 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.120063 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.120145 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.120305 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.120390 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.120569 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.120661 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.120814 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.120892 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.121046 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.121124 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.121298 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.121387 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.121535 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.121613 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.121783 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.121862 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.122034 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.122115 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.122269 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.122347 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.122504 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.122588 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.122740 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] ldap.password = **** {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.122819 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.122972 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] ldap.password = **** {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.123060 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.123211 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.123289 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.123444 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.123524 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.123686 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.123763 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.123922 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.124000 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.124162 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.124243 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.124435 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.124517 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.124677 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.124757 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.124911 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.124992 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.125145 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.125225 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.125397 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.125477 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.125633 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.125713 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.125871 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.125949 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.126107 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.126191 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.126340 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.126420 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] ldap.user = None {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.126573 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] ldap.user = None {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.126653 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.126813 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.126883 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.127056 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.127145 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.127292 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.127371 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.127541 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.127622 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.127789 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.127869 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.128029 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.128110 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.128261 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.128340 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.128518 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.128602 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.128755 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.128835 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.128989 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.129070 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.129226 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.129306 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.129481 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.129570 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.129735 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.129816 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.129987 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.130068 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.130237 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.130315 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.130485 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.130564 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.130721 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.130803 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.130959 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.131038 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.131198 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.131276 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.131434 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.131513 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.131670 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.131748 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.131904 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.131982 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.132139 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.132221 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.132385 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.132525 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.132647 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.132727 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.132883 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.132964 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] policy.driver = sql {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.133131 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.133216 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] policy.driver = sql {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.133386 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.133464 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.133633 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.133715 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.133869 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] receipt.caching = True {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.133948 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.134104 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] receipt.caching = True {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.134182 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.134348 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.134429 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.134597 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.134683 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.134838 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.134916 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.135069 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.135149 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.135309 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.135389 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] resource.caching = True {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.135551 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] resource.caching = True {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.135631 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.135805 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.135887 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] resource.driver = sql {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.136044 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.136123 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] resource.driver = sql {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.136301 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.136417 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.136580 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.136669 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.136822 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] revoke.caching = True {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.136903 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.137076 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.137168 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] revoke.caching = True {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.137318 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.137479 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.137559 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] role.cache_time = None {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.137790 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] role.caching = True {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.137869 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.138046 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] role.driver = sql {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.138128 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] role.cache_time = None {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.138282 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] role.list_limit = None {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.138361 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] role.caching = True {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.138534 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] role.driver = sql {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.138612 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.138777 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] role.list_limit = None {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.138859 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.139027 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.139106 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.139281 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.139367 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.139534 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.139616 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.139834 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.139912 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.140086 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.140165 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.140335 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.140441 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.140845 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.140931 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.141105 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.141186 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.141336 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.141417 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.141587 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.141666 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.141836 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.141914 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.142083 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.142241 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.142322 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.142485 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.142712 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.142792 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.142949 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.143202 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.143281 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.143456 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.143707 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.143785 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.143956 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.144196 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.144354 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.144477 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.144672 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.144765 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.145049 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.145176 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.145278 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.145488 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.145579 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.145738 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.145903 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.146045 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.146170 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.146303 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.146434 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.146585 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.146720 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.146720 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.146959 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.147045 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.147118 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.147200 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] token.cache_time = None {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.147274 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.147345 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] token.caching = True {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.147516 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.147596 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.147764 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.147852 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] token.provider = fernet {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.148005 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] token.cache_time = None {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.148095 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.148251 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] token.caching = True {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.148329 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.148537 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.148682 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.148817 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.149447 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] token.provider = fernet {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.149586 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.149722 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.149846 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.149958 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.150034 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] trust.driver = sql {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.150212 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.150292 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.150448 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.150685 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.150778 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.150932 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.151147 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.151225 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.151400 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.151624 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.151711 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.151898 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.152126 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] trust.driver = sql {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.152204 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] database.connection = **** {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.152392 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.152622 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.152714 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.152890 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.153088 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.153167 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.153359 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.153494 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.153644 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.153781 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.153913 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.154036 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.154162 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.154291 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.154433 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.154568 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.154701 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.154834 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.154965 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.155113 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] database.connection = **** {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.155257 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.155395 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.155520 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.155655 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.155781 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.155902 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.156029 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.156318 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.156421 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.156498 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.156570 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.156570 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.156711 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.156793 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=74005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 12 18:03:55.156867 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.156867 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.157076 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.157351 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.157605 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.157850 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.158109 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.158352 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.158605 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.158845 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.159102 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.159346 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:03:55.159493 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=74006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 12 18:03:55.186546 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=74005) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 18:03:55.186803 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=74005) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 18:03:55.187031 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=74005) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 18:03:55.188145 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=74006) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 18:03:55.188381 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=74006) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 18:03:55.188638 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=74006) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 18:03:55.197267 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=74005) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 18:03:55.198623 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=74006) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 18:03:55.237522 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=74005) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 18:03:55.237645 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=74006) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 18:03:55.237755 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=74005) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 18:03:55.237876 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=74006) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 18:03:55.303352 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=74006) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 18:03:55.304189 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=74005) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 18:03:55.448638 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=74006) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 18:03:55.448879 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=74006) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 18:03:55.449220 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=74005) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 18:03:55.449456 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=74005) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 18:03:55.534729 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=74006) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 18:03:55.534961 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=74006) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 18:03:55.535075 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=74005) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 18:03:55.535188 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=74006) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 18:03:55.535275 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=74005) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 18:03:55.535407 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=74005) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 18:03:55.535489 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=74006) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 18:03:55.535627 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=74005) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 18:03:55.535719 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=74006) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 18:03:55.535843 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=74006) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 18:03:55.535925 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=74005) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 18:03:55.536055 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=74005) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 18:03:55.567094 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=74006) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 18:03:55.567221 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=74005) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 18:03:55.567303 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=74006) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 18:03:55.567419 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=74005) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 18:03:55.567505 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=74006) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 18:03:55.567705 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=74006) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 18:03:55.567864 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=74005) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 18:03:55.567943 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=74006) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 18:03:55.568016 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=74005) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 18:03:55.568128 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=74006) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 18:03:55.568211 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=74005) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 18:03:55.568337 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=74005) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 18:03:55.568450 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=74006) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 18:03:55.568573 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=74005) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 18:03:55.580089 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=74006) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 18:03:55.580516 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=74005) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 18:03:55.592846 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=74006) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 18:03:55.600142 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=74006) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 18:03:55.600142 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=74006) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 18:03:55.600280 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=74005) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 18:03:55.600356 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=74006) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 18:03:55.600461 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=74005) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 18:03:55.600543 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=74006) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 18:03:55.600620 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=74005) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 18:03:55.600694 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=74006) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 18:03:55.600766 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=74005) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 18:03:55.600839 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=74006) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 18:03:55.600920 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=74005) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 18:03:55.600920 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=74005) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 18:03:55.600920 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=74005) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 18:03:55.617082 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=74006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.617296 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=74006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 12 18:03:55.617679 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=74006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.617822 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=74005) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.617910 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=74006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 12 18:03:55.618033 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=74005) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 12 18:03:55.618160 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=74006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.618361 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=74005) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.618453 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=74006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.618557 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=74005) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 12 18:03:55.618667 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=74006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.618820 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=74005) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.618923 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=74006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.619074 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=74005) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.619327 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=74005) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.619577 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=74005) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.629496 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=74006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.629772 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=74006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.630044 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=74006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.630234 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=74005) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.630326 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=74006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.630504 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=74005) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.630766 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=74005) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.631072 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=74005) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.641102 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=74006) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 18:03:55.642092 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=74005) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 18:03:55.644312 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=74006) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 18:03:55.644634 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=74006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.644906 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=74006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.645189 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=74006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.645419 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=74005) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 18:03:55.645503 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=74006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.645697 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=74005) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.645789 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=74006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.645971 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=74005) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.646053 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=74006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.646244 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=74006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.646324 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=74005) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.646515 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=74005) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.646604 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=74006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.646772 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=74005) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.646853 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=74006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.647038 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=74006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.647117 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=74005) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.647301 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=74005) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.647565 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=74005) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.648047 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=74005) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.648304 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=74005) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.673513 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=74006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.675098 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=74006) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 18:03:55.675379 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=74006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.675844 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=74005) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.677554 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=74005) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 18:03:55.677827 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=74005) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.680592 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=74006) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 18:03:55.680872 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=74006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.681157 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=74006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.683081 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=74005) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 18:03:55.683359 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=74005) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.683639 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=74005) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.688413 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=74006) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 18:03:55.688704 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=74006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.690731 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=74005) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 18:03:55.691012 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=74005) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.693094 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=74006) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 18:03:55.693388 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=74006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.693666 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=74006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.693943 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=74006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.694214 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=74006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.694486 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=74006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.694757 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=74006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.695026 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=74006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.695423 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=74005) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 18:03:55.695704 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=74005) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.696519 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=74005) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.696796 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=74005) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.697063 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=74005) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.697331 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=74005) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.697589 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=74005) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.697853 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=74005) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.715749 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=74006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.716030 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=74006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.717034 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=74005) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.717303 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=74005) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.721961 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=74005) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 18:03:55.722075 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=74006) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 18:03:55.725580 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=74006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.725671 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=74005) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.725876 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=74006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.725959 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=74005) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.730941 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=74005) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 18:03:55.731059 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=74006) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 18:03:55.734479 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=74005) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 18:03:55.734574 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=74006) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 18:03:55.738104 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=74005) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.738286 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=74006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.738398 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=74005) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.738485 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=74006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.738675 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=74005) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.738758 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=74006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.738950 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=74005) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.739035 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=74006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.739216 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=74005) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.739300 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=74006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.739503 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=74005) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.739598 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=74006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.758770 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=74006) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 18:03:55.759061 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=74006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.759277 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=74005) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 18:03:55.759371 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=74006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.759554 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=74005) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.759653 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=74006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.759816 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=74005) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.760071 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=74005) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.767559 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=74006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.768061 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=74005) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.769244 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=74006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.769524 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=74006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.769920 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=74005) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.770228 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=74005) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.772810 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=74006) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 18:03:55.773102 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=74006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.773373 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=74005) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 18:03:55.773459 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=74006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.773650 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=74005) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.773795 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=74006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.773950 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=74006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.774045 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=74005) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.774259 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=74005) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.774533 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=74005) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.786962 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=74006) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 18:03:55.787237 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=74006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.787459 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=74005) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 18:03:55.787544 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=74006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.787738 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=74005) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.787830 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=74006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.788010 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=74005) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.788094 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=74006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.788320 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=74006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.788447 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=74005) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.788623 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=74006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.788706 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=74005) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.788960 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=74005) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.789231 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=74005) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.808060 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=74005) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 18:03:55.809979 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=74006) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 18:03:55.811333 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=74005) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 18:03:55.813232 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=74006) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 18:03:55.814549 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=74005) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.816245 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=74005) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.816498 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=74006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.817894 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=74005) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 18:03:55.818090 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=74006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.818184 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=74005) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.818381 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=74005) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.819830 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=74006) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 18:03:55.820111 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=74006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.820418 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=74006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.825985 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=74005) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.827633 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=74006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.827734 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=74005) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 18:03:55.829216 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=74006) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 18:03:55.831024 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=74005) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.831308 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=74005) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.831905 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=74005) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.831905 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=74005) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.832377 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=74006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.832691 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=74006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.832978 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=74006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.833273 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=74006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.840956 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=74005) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 18:03:55.841249 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=74005) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.841523 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=74005) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.842292 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=74006) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 18:03:55.842596 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=74006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.842870 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=74006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.849388 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=74005) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 18:03:55.849664 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=74005) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.850039 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=74005) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.850310 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=74005) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.850586 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=74006) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 18:03:55.850672 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=74005) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.850863 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=74005) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.850946 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=74006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.851130 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=74005) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.851214 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=74006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.851402 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=74006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.851484 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=74005) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.851671 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=74005) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.851752 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=74006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.851933 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=74005) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.852529 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=74006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.852744 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=74006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.852827 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=74005) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.853032 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=74006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.853115 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=74005) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.853304 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=74005) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.853410 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=74006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.853566 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=74005) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.853701 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=74006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.853975 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=74006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.854242 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=74006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.854508 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=74006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.854778 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=74006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 18:03:55.892112 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5642541e99c0 pid: 74005 (default app) Oct 12 18:03:55.893065 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5642541e99c0 pid: 74006 (default app) Oct 12 18:03:55.896523 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b20755-c6e7-4bc4-af3c-d0ab9559decb None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:03:55.896809 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b20755-c6e7-4bc4-af3c-d0ab9559decb None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:03:55.897083 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b20755-c6e7-4bc4-af3c-d0ab9559decb None None] PATH_INFO: `/v3` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:03:55.901857 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1/1] 10.222.0.18 () {50 vars in 791 bytes} [Tue Oct 12 18:03:55 2021] GET /identity/v3/ => generated 255 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:04.842850 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213c8b9-e3c9-4e0b-a876-6f06040c0119 None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:04.843361 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213c8b9-e3c9-4e0b-a876-6f06040c0119 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:04.843443 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213c8b9-e3c9-4e0b-a876-6f06040c0119 None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:04.848482 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1/2] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:04:04 2021] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:04:04.854779 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8baf8c0-78b8-4921-aa3c-f70b01de2b9d None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:04.855185 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8baf8c0-78b8-4921-aa3c-f70b01de2b9d None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:04.855324 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8baf8c0-78b8-4921-aa3c-f70b01de2b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:04.885117 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG oslo_db.sqlalchemy.engines [None req-f8baf8c0-78b8-4921-aa3c-f70b01de2b9d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74005) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 18:04:05.073811 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG passlib.handlers.bcrypt [None req-f8baf8c0-78b8-4921-aa3c-f70b01de2b9d None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=74005) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 12 18:04:05.074255 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG passlib.handlers.bcrypt [None req-f8baf8c0-78b8-4921-aa3c-f70b01de2b9d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=74005) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 12 18:04:05.130372 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-f8baf8c0-78b8-4921-aa3c-f70b01de2b9d None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:04:05.131982 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-f8baf8c0-78b8-4921-aa3c-f70b01de2b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:04:05.264073 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 2/3] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:04:04 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 410 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:04:05.425978 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8213c8b9-e3c9-4e0b-a876-6f06040c0119 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:05.458753 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG oslo_db.sqlalchemy.engines [None req-8213c8b9-e3c9-4e0b-a876-6f06040c0119 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74006) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 18:04:05.585505 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8213c8b9-e3c9-4e0b-a876-6f06040c0119 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:05.590306 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ad7113-f928-4283-8511-c93a311bc082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:05.590964 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ad7113-f928-4283-8511-c93a311bc082 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:05.591249 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ad7113-f928-4283-8511-c93a311bc082 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:05.591527 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ad7113-f928-4283-8511-c93a311bc082 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:05.599440 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ad7113-f928-4283-8511-c93a311bc082 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:05.651146 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f4ad7113-f928-4283-8511-c93a311bc082 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 12 18:04:05.651489 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ad7113-f928-4283-8511-c93a311bc082 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:05.661040 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 2/4] 10.222.0.18 () {58 vars in 1324 bytes} [Tue Oct 12 18:04:05 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 18:04:05.667465 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8baf8c0-78b8-4921-aa3c-f70b01de2b9d None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:05.681970 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8baf8c0-78b8-4921-aa3c-f70b01de2b9d None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:05.686379 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e310d1-12f7-47f1-add4-8323e6d4ae97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:05.687467 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e310d1-12f7-47f1-add4-8323e6d4ae97 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:05.687750 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e310d1-12f7-47f1-add4-8323e6d4ae97 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:05.688024 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e310d1-12f7-47f1-add4-8323e6d4ae97 admin admin] PATH_INFO: `/v3/projects/e340b2a295714eb294f0cebe48fde56d` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:05.689558 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e310d1-12f7-47f1-add4-8323e6d4ae97 admin admin] RBAC: Authorizing `identity:get_project(project_id=e340b2a295714eb294f0cebe48fde56d)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:05.739311 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.common.rbac_enforcer.enforcer [None req-56e310d1-12f7-47f1-add4-8323e6d4ae97 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 12 18:04:05.739660 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e310d1-12f7-47f1-add4-8323e6d4ae97 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:05.744663 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 3/5] 10.222.0.18 () {56 vars in 1207 bytes} [Tue Oct 12 18:04:05 2021] GET /identity/v3/projects/e340b2a295714eb294f0cebe48fde56d => generated 344 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:07.953142 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17974bf-ac35-497f-afea-9d27423f659a None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:07.953670 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17974bf-ac35-497f-afea-9d27423f659a None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:07.953670 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17974bf-ac35-497f-afea-9d27423f659a None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:07.958132 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 3/6] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:04:07 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:04:07.964149 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea27ed-b709-4da3-a1ea-1902f3fb59c8 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:07.964542 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea27ed-b709-4da3-a1ea-1902f3fb59c8 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:07.964741 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea27ed-b709-4da3-a1ea-1902f3fb59c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:07.984579 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-4aea27ed-b709-4da3-a1ea-1902f3fb59c8 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:04:07.986104 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-4aea27ed-b709-4da3-a1ea-1902f3fb59c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:04:07.994504 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 4/7] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:04:07 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:04:08.018559 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17974bf-ac35-497f-afea-9d27423f659a None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:08.030696 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17974bf-ac35-497f-afea-9d27423f659a None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:08.034912 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3c2d25-27ff-4981-8adf-12086c45730b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:08.035534 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c2d25-27ff-4981-8adf-12086c45730b admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:08.035816 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c2d25-27ff-4981-8adf-12086c45730b admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:08.036089 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c2d25-27ff-4981-8adf-12086c45730b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:08.043739 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3c2d25-27ff-4981-8adf-12086c45730b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:08.045605 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3c2d25-27ff-4981-8adf-12086c45730b admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:08.054180 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 4/8] 10.222.0.18 () {58 vars in 1324 bytes} [Tue Oct 12 18:04:08 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:04:08.060911 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aea27ed-b709-4da3-a1ea-1902f3fb59c8 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:08.069748 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aea27ed-b709-4da3-a1ea-1902f3fb59c8 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:08.074879 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c332ee0c-3671-4681-aa50-8a8c6d20efc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:08.075739 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332ee0c-3671-4681-aa50-8a8c6d20efc3 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:08.076021 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332ee0c-3671-4681-aa50-8a8c6d20efc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:08.076294 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332ee0c-3671-4681-aa50-8a8c6d20efc3 admin admin] PATH_INFO: `/v3/users/31651079c8d04df8a5fb70d40851475c` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:08.077813 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c332ee0c-3671-4681-aa50-8a8c6d20efc3 admin admin] RBAC: Authorizing `identity:get_user(user_id=31651079c8d04df8a5fb70d40851475c)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:08.079672 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c332ee0c-3671-4681-aa50-8a8c6d20efc3 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:08.081248 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 5/9] 10.222.0.18 () {56 vars in 1198 bytes} [Tue Oct 12 18:04:08 2021] GET /identity/v3/users/31651079c8d04df8a5fb70d40851475c => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:10.334967 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f466f2d-8229-47b7-bb20-cb8be81927a5 None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:10.335488 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f466f2d-8229-47b7-bb20-cb8be81927a5 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:10.335569 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f466f2d-8229-47b7-bb20-cb8be81927a5 None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:10.337370 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 5/10] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:04:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:04:10.343028 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3862e5-74b0-4385-b74f-b924464f68c2 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:10.343448 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3862e5-74b0-4385-b74f-b924464f68c2 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:10.343583 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3862e5-74b0-4385-b74f-b924464f68c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:10.360756 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-bf3862e5-74b0-4385-b74f-b924464f68c2 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:04:10.361943 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-bf3862e5-74b0-4385-b74f-b924464f68c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:04:10.369937 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 6/11] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:04:10 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:04:10.392556 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54549bf-1592-46cf-9f8d-26556b8d7c31 None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:10.392927 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54549bf-1592-46cf-9f8d-26556b8d7c31 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:10.393268 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54549bf-1592-46cf-9f8d-26556b8d7c31 None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:10.394622 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3862e5-74b0-4385-b74f-b924464f68c2 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:10.395016 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 6/12] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:04:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 18:04:10.400448 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d13169-4aee-47fb-9743-4fdd4a594a76 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:10.400734 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d13169-4aee-47fb-9743-4fdd4a594a76 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:10.401015 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d13169-4aee-47fb-9743-4fdd4a594a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:10.404180 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3862e5-74b0-4385-b74f-b924464f68c2 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:10.408515 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236f2b86-33f8-4e97-b883-1b97093454d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:10.409302 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f2b86-33f8-4e97-b883-1b97093454d7 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:10.409585 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f2b86-33f8-4e97-b883-1b97093454d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:10.409861 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f2b86-33f8-4e97-b883-1b97093454d7 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:10.422522 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236f2b86-33f8-4e97-b883-1b97093454d7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 18:04:10.430006 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-236f2b86-33f8-4e97-b883-1b97093454d7 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 18:04:10.431177 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 7/13] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Oct 12 18:04:10 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 18:04:10.437503 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236f2b86-33f8-4e97-b883-1b97093454d7 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:10.441492 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG passlib.handlers.bcrypt [None req-10d13169-4aee-47fb-9743-4fdd4a594a76 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=74006) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 12 18:04:10.441918 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG passlib.handlers.bcrypt [None req-10d13169-4aee-47fb-9743-4fdd4a594a76 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=74006) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 12 18:04:10.447262 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236f2b86-33f8-4e97-b883-1b97093454d7 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:10.451621 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fd17d2-b400-488c-a8c2-95cbcf7aff26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:10.452231 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd17d2-b400-488c-a8c2-95cbcf7aff26 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:10.452543 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd17d2-b400-488c-a8c2-95cbcf7aff26 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:10.452819 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd17d2-b400-488c-a8c2-95cbcf7aff26 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:10.453562 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fd17d2-b400-488c-a8c2-95cbcf7aff26 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:10.453864 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fd17d2-b400-488c-a8c2-95cbcf7aff26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:10.455609 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING py.warnings [None req-c9fd17d2-b400-488c-a8c2-95cbcf7aff26 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:04:10.455609 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: warnings.warn(msg) Oct 12 18:04:10.455609 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: Oct 12 18:04:10.456534 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fd17d2-b400-488c-a8c2-95cbcf7aff26 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:10.468914 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 8/14] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Oct 12 18:04:10 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:04:10.474662 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fd17d2-b400-488c-a8c2-95cbcf7aff26 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:10.483724 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fd17d2-b400-488c-a8c2-95cbcf7aff26 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:10.487929 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-10d13169-4aee-47fb-9743-4fdd4a594a76 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:04:10.488186 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279524e7-99f3-4475-8c31-3127f6d3032d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:10.489034 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279524e7-99f3-4475-8c31-3127f6d3032d admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:10.489320 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279524e7-99f3-4475-8c31-3127f6d3032d admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:10.489545 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-10d13169-4aee-47fb-9743-4fdd4a594a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:04:10.489631 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279524e7-99f3-4475-8c31-3127f6d3032d admin admin] PATH_INFO: `/v3/users/31651079c8d04df8a5fb70d40851475c` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:10.490801 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279524e7-99f3-4475-8c31-3127f6d3032d admin admin] RBAC: Authorizing `identity:get_user(user_id=31651079c8d04df8a5fb70d40851475c)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:10.493130 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279524e7-99f3-4475-8c31-3127f6d3032d admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:10.494649 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 9/15] 10.222.0.18 () {56 vars in 1198 bytes} [Tue Oct 12 18:04:10 2021] GET /identity/v3/users/31651079c8d04df8a5fb70d40851475c => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:04:10.500245 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279524e7-99f3-4475-8c31-3127f6d3032d admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:10.509962 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279524e7-99f3-4475-8c31-3127f6d3032d admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:10.514349 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccdbc18-9426-4953-8001-affc6635a48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:10.515064 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccdbc18-9426-4953-8001-affc6635a48a admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:10.515350 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccdbc18-9426-4953-8001-affc6635a48a admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:10.515871 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccdbc18-9426-4953-8001-affc6635a48a admin admin] PATH_INFO: `/v3/domains/default` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:10.517050 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccdbc18-9426-4953-8001-affc6635a48a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:10.517359 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 7/16] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:04:10 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:04:10.518844 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccdbc18-9426-4953-8001-affc6635a48a admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:10.520374 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 10/17] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:04:10 2021] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:04:10.526176 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d13169-4aee-47fb-9743-4fdd4a594a76 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:10.535625 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d13169-4aee-47fb-9743-4fdd4a594a76 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:10.540121 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccdbc18-9426-4953-8001-affc6635a48a admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:10.540714 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6321957-d4f4-41aa-8961-9e39109b175f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:10.541677 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6321957-d4f4-41aa-8961-9e39109b175f admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:10.541966 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6321957-d4f4-41aa-8961-9e39109b175f admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:10.542248 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6321957-d4f4-41aa-8961-9e39109b175f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:10.543253 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6321957-d4f4-41aa-8961-9e39109b175f admin admin] RBAC: Adding query filter params (role.id=6c54f239944d46e3b027ccce97eb8b49, scope.domain.id=default, user.id=31651079c8d04df8a5fb70d40851475c) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:10.543566 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6321957-d4f4-41aa-8961-9e39109b175f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:10.545332 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING py.warnings [None req-a6321957-d4f4-41aa-8961-9e39109b175f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:04:10.545332 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: warnings.warn(msg) Oct 12 18:04:10.545332 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: Oct 12 18:04:10.546505 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6321957-d4f4-41aa-8961-9e39109b175f admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:10.549521 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccdbc18-9426-4953-8001-affc6635a48a admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:10.553820 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7eb3ed-8e7e-4105-b967-432e3d6c8c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:10.554439 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7eb3ed-8e7e-4105-b967-432e3d6c8c6f admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:10.555298 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7eb3ed-8e7e-4105-b967-432e3d6c8c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:10.555576 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7eb3ed-8e7e-4105-b967-432e3d6c8c6f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:10.555707 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 8/18] 10.222.0.18 () {56 vars in 1343 bytes} [Tue Oct 12 18:04:10 2021] GET /identity/v3/role_assignments?user.id=31651079c8d04df8a5fb70d40851475c&scope.domain.id=default&role.id=6c54f239944d46e3b027ccce97eb8b49 => generated 233 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:10.563905 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7eb3ed-8e7e-4105-b967-432e3d6c8c6f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:10.565774 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7eb3ed-8e7e-4105-b967-432e3d6c8c6f admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:10.575859 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 11/19] 10.222.0.18 () {58 vars in 1324 bytes} [Tue Oct 12 18:04:10 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 18:04:10.582213 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6321957-d4f4-41aa-8961-9e39109b175f admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:10.592392 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6321957-d4f4-41aa-8961-9e39109b175f admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:10.596936 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a98b743-ba53-4d4d-9710-ff779e589787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:10.597744 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98b743-ba53-4d4d-9710-ff779e589787 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:10.598026 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98b743-ba53-4d4d-9710-ff779e589787 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:10.598302 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98b743-ba53-4d4d-9710-ff779e589787 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:10.599734 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a98b743-ba53-4d4d-9710-ff779e589787 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:10.602033 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a98b743-ba53-4d4d-9710-ff779e589787 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:10.603846 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 9/20] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:04:10 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:13.448164 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e667c29-618a-4ce6-a437-35e681269c54 None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:13.450291 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e667c29-618a-4ce6-a437-35e681269c54 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:13.450798 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e667c29-618a-4ce6-a437-35e681269c54 None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:13.453548 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 12/21] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:04:13 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 18:04:13.461149 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ccb6bc-b7c3-401a-bb03-94cb45ecfbca None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:13.461655 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ccb6bc-b7c3-401a-bb03-94cb45ecfbca None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:13.462420 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ccb6bc-b7c3-401a-bb03-94cb45ecfbca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:13.506259 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-78ccb6bc-b7c3-401a-bb03-94cb45ecfbca None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:04:13.508771 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-78ccb6bc-b7c3-401a-bb03-94cb45ecfbca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:04:13.528851 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 10/22] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:04:13 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:04:13.559948 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e667c29-618a-4ce6-a437-35e681269c54 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:13.576584 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e667c29-618a-4ce6-a437-35e681269c54 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:13.580999 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b722e7-de64-40f8-8fc2-359ed75fb949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:13.581787 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b722e7-de64-40f8-8fc2-359ed75fb949 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:13.582066 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b722e7-de64-40f8-8fc2-359ed75fb949 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:13.582337 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b722e7-de64-40f8-8fc2-359ed75fb949 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:13.601815 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b722e7-de64-40f8-8fc2-359ed75fb949 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 18:04:13.608933 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-f2b722e7-de64-40f8-8fc2-359ed75fb949 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 18:04:13.610447 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 13/23] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Oct 12 18:04:13 2021] GET /identity/v3/roles/admin => generated 83 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:04:13.617774 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ccb6bc-b7c3-401a-bb03-94cb45ecfbca None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:13.640037 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ccb6bc-b7c3-401a-bb03-94cb45ecfbca None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:13.655509 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab0234a-09af-48fb-866e-0a5178b07db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:13.657041 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab0234a-09af-48fb-866e-0a5178b07db7 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:13.657793 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab0234a-09af-48fb-866e-0a5178b07db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:13.658552 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab0234a-09af-48fb-866e-0a5178b07db7 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:13.660250 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab0234a-09af-48fb-866e-0a5178b07db7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:13.661098 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab0234a-09af-48fb-866e-0a5178b07db7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:13.663189 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING py.warnings [None req-8ab0234a-09af-48fb-866e-0a5178b07db7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:04:13.663189 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: warnings.warn(msg) Oct 12 18:04:13.663189 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: Oct 12 18:04:13.665952 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab0234a-09af-48fb-866e-0a5178b07db7 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:13.693259 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 11/24] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Oct 12 18:04:13 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:13.699564 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b722e7-de64-40f8-8fc2-359ed75fb949 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:13.714005 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b722e7-de64-40f8-8fc2-359ed75fb949 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:13.718497 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e37d1a-f193-468c-a2f2-be36881af85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:13.719386 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e37d1a-f193-468c-a2f2-be36881af85a admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:13.719667 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e37d1a-f193-468c-a2f2-be36881af85a admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:13.719944 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e37d1a-f193-468c-a2f2-be36881af85a admin admin] PATH_INFO: `/v3/users/31651079c8d04df8a5fb70d40851475c` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:13.721218 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e37d1a-f193-468c-a2f2-be36881af85a admin admin] RBAC: Authorizing `identity:get_user(user_id=31651079c8d04df8a5fb70d40851475c)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:13.723077 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e37d1a-f193-468c-a2f2-be36881af85a admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:13.733346 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 14/25] 10.222.0.18 () {56 vars in 1198 bytes} [Tue Oct 12 18:04:13 2021] GET /identity/v3/users/31651079c8d04df8a5fb70d40851475c => generated 247 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:04:13.739623 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab0234a-09af-48fb-866e-0a5178b07db7 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:13.763274 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab0234a-09af-48fb-866e-0a5178b07db7 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:13.779344 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19bc134-2d43-4e3f-99e1-461f2414b0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:13.781231 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19bc134-2d43-4e3f-99e1-461f2414b0f6 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:13.782043 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19bc134-2d43-4e3f-99e1-461f2414b0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:13.782822 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19bc134-2d43-4e3f-99e1-461f2414b0f6 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:13.790540 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19bc134-2d43-4e3f-99e1-461f2414b0f6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:13.794425 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19bc134-2d43-4e3f-99e1-461f2414b0f6 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:13.798676 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 12/26] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:04:13 2021] GET /identity/v3/domains/default => generated 199 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:13.805249 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e37d1a-f193-468c-a2f2-be36881af85a admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:13.818333 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e37d1a-f193-468c-a2f2-be36881af85a admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:13.833949 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e86e5c7-65d4-47d5-9371-7616188bf23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:13.834845 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86e5c7-65d4-47d5-9371-7616188bf23c admin admin] REQUEST_METHOD: `PUT` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:13.835122 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86e5c7-65d4-47d5-9371-7616188bf23c admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:13.835404 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86e5c7-65d4-47d5-9371-7616188bf23c admin admin] PATH_INFO: `/v3/domains/default/users/31651079c8d04df8a5fb70d40851475c/roles/6c54f239944d46e3b027ccce97eb8b49` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:13.842322 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e86e5c7-65d4-47d5-9371-7616188bf23c admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=31651079c8d04df8a5fb70d40851475c, role_id=6c54f239944d46e3b027ccce97eb8b49)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:13.843371 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING py.warnings [None req-6e86e5c7-65d4-47d5-9371-7616188bf23c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:04:13.843371 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: warnings.warn(msg) Oct 12 18:04:13.843371 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: Oct 12 18:04:13.845390 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e86e5c7-65d4-47d5-9371-7616188bf23c admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:13.920614 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72797876-4870-4949-b30f-3037b6f2fd7e None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:13.921534 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72797876-4870-4949-b30f-3037b6f2fd7e None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:13.922271 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72797876-4870-4949-b30f-3037b6f2fd7e None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:13.925873 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 13/27] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:04:13 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:04:13.933015 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a78bc-f0d2-4e1e-bd67-de09e514bd97 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:13.933938 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a78bc-f0d2-4e1e-bd67-de09e514bd97 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:13.934722 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a78bc-f0d2-4e1e-bd67-de09e514bd97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:13.974191 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-7d8a78bc-f0d2-4e1e-bd67-de09e514bd97 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:04:13.977114 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-7d8a78bc-f0d2-4e1e-bd67-de09e514bd97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:04:14.155507 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 14/28] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:04:13 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:04:14.157507 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd30ed49-c0af-4ef2-8abe-e1e4deafbb29 None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:14.158006 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd30ed49-c0af-4ef2-8abe-e1e4deafbb29 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:14.158503 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd30ed49-c0af-4ef2-8abe-e1e4deafbb29 None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:14.162910 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 15/29] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:04:14 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:04:14.165702 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6403210f-d63f-4faa-8575-cdcfccca522b None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:14.166664 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6403210f-d63f-4faa-8575-cdcfccca522b None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:14.167449 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6403210f-d63f-4faa-8575-cdcfccca522b None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:14.176795 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 16/30] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:04:14 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:04:14.179008 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d24b9b5-24f5-4b83-980a-db93620606d8 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:14.179756 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d24b9b5-24f5-4b83-980a-db93620606d8 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:14.180687 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d24b9b5-24f5-4b83-980a-db93620606d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:14.184093 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 15/31] 10.222.0.18 () {58 vars in 1382 bytes} [Tue Oct 12 18:04:13 2021] PUT /identity/v3/domains/default/users/31651079c8d04df8a5fb70d40851475c/roles/6c54f239944d46e3b027ccce97eb8b49 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:04:14.191738 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a485b8a1-6c72-45a8-aeb9-10adb54090b0 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:14.192605 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a485b8a1-6c72-45a8-aeb9-10adb54090b0 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:14.193367 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a485b8a1-6c72-45a8-aeb9-10adb54090b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:14.236674 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-9d24b9b5-24f5-4b83-980a-db93620606d8 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:04:14.238658 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-a485b8a1-6c72-45a8-aeb9-10adb54090b0 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:04:14.240852 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-9d24b9b5-24f5-4b83-980a-db93620606d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:04:14.244162 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-a485b8a1-6c72-45a8-aeb9-10adb54090b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:04:14.272885 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 17/32] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:04:14 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:04:14.274735 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d24b9b5-24f5-4b83-980a-db93620606d8 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:14.275381 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 16/33] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:04:14 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:04:14.296895 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d24b9b5-24f5-4b83-980a-db93620606d8 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:14.311652 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f85ea-db59-472c-a878-dd0bad1a3674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:14.313454 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f85ea-db59-472c-a878-dd0bad1a3674 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:14.314229 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f85ea-db59-472c-a878-dd0bad1a3674 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:14.315019 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f85ea-db59-472c-a878-dd0bad1a3674 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:14.341515 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456f85ea-db59-472c-a878-dd0bad1a3674 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:14.345308 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456f85ea-db59-472c-a878-dd0bad1a3674 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:14.350356 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a485b8a1-6c72-45a8-aeb9-10adb54090b0 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:14.374423 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a485b8a1-6c72-45a8-aeb9-10adb54090b0 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:14.401245 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20fcc91-4f16-4c38-a349-0573c74d2f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:14.402761 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20fcc91-4f16-4c38-a349-0573c74d2f63 admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:14.403508 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20fcc91-4f16-4c38-a349-0573c74d2f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:14.404222 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20fcc91-4f16-4c38-a349-0573c74d2f63 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:14.405854 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20fcc91-4f16-4c38-a349-0573c74d2f63 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:14.408308 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING py.warnings [None req-d20fcc91-4f16-4c38-a349-0573c74d2f63 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:04:14.408308 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: warnings.warn(msg) Oct 12 18:04:14.408308 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: Oct 12 18:04:14.414690 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20fcc91-4f16-4c38-a349-0573c74d2f63 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:14.421218 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-456f85ea-db59-472c-a878-dd0bad1a3674 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 18:04:14.423609 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 18/34] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:04:14 2021] GET /identity/v3/domains/Default => generated 87 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:04:14.425566 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f85ea-db59-472c-a878-dd0bad1a3674 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:14.441934 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f85ea-db59-472c-a878-dd0bad1a3674 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:14.452666 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91874109-37c3-47ae-abba-e99789e2f2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:14.452666 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91874109-37c3-47ae-abba-e99789e2f2ee admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:14.452666 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91874109-37c3-47ae-abba-e99789e2f2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:14.452666 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91874109-37c3-47ae-abba-e99789e2f2ee admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:14.453008 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91874109-37c3-47ae-abba-e99789e2f2ee admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:14.454377 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING py.warnings [None req-91874109-37c3-47ae-abba-e99789e2f2ee admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:04:14.454377 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: warnings.warn(msg) Oct 12 18:04:14.454377 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: Oct 12 18:04:14.456004 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91874109-37c3-47ae-abba-e99789e2f2ee admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:14.561504 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 17/35] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:04:14 2021] POST /identity/v3/roles => generated 225 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 18:04:14.562351 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20fcc91-4f16-4c38-a349-0573c74d2f63 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:14.578926 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20fcc91-4f16-4c38-a349-0573c74d2f63 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:14.608584 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3e436e-2fee-482f-a08f-f41af97c28ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:14.609275 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e436e-2fee-482f-a08f-f41af97c28ca admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:14.609565 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e436e-2fee-482f-a08f-f41af97c28ca admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:14.609849 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e436e-2fee-482f-a08f-f41af97c28ca admin admin] PATH_INFO: `/v3/domains` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:14.610606 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3e436e-2fee-482f-a08f-f41af97c28ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:14.610911 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3e436e-2fee-482f-a08f-f41af97c28ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:14.614973 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING py.warnings [None req-aa3e436e-2fee-482f-a08f-f41af97c28ca admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:04:14.614973 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: warnings.warn(msg) Oct 12 18:04:14.614973 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: Oct 12 18:04:14.616052 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3e436e-2fee-482f-a08f-f41af97c28ca admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:14.660045 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 18/36] 10.222.0.18 () {56 vars in 1130 bytes} [Tue Oct 12 18:04:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:14.666733 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3e436e-2fee-482f-a08f-f41af97c28ca admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:14.695037 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3e436e-2fee-482f-a08f-f41af97c28ca admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:14.710050 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6821c5ee-09b5-40e9-a007-5b661f2f1b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:14.711099 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821c5ee-09b5-40e9-a007-5b661f2f1b34 admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:14.711541 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821c5ee-09b5-40e9-a007-5b661f2f1b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:14.711980 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821c5ee-09b5-40e9-a007-5b661f2f1b34 admin admin] PATH_INFO: `/v3/projects` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:14.712889 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6821c5ee-09b5-40e9-a007-5b661f2f1b34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:14.714070 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING py.warnings [None req-6821c5ee-09b5-40e9-a007-5b661f2f1b34 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:04:14.714070 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: warnings.warn(msg) Oct 12 18:04:14.714070 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: Oct 12 18:04:14.715604 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6821c5ee-09b5-40e9-a007-5b661f2f1b34 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:14.739628 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 19/37] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:04:14 2021] POST /identity/v3/roles => generated 219 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:04:14.873943 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 19/38] 10.222.0.18 () {60 vars in 1162 bytes} [Tue Oct 12 18:04:14 2021] POST /identity/v3/projects => generated 301 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:04:15.105136 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa35c8a0-bceb-4865-93a2-8dda8b8b3f7c None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:15.105852 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa35c8a0-bceb-4865-93a2-8dda8b8b3f7c None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:15.106347 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa35c8a0-bceb-4865-93a2-8dda8b8b3f7c None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:15.108892 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 20/39] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:04:15 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:04:15.115448 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741cf4c0-0ad0-442e-a193-215867dce755 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:15.116080 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741cf4c0-0ad0-442e-a193-215867dce755 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:15.116614 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741cf4c0-0ad0-442e-a193-215867dce755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:15.138431 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-741cf4c0-0ad0-442e-a193-215867dce755 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:04:15.140140 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-741cf4c0-0ad0-442e-a193-215867dce755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:04:15.213915 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 20/40] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:04:15 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:04:15.240682 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa35c8a0-bceb-4865-93a2-8dda8b8b3f7c None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:15.255961 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa35c8a0-bceb-4865-93a2-8dda8b8b3f7c None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:15.261406 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ede8d4-fc91-4fb5-9e1e-bf90e4aab34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:15.262325 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ede8d4-fc91-4fb5-9e1e-bf90e4aab34e admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:15.262806 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ede8d4-fc91-4fb5-9e1e-bf90e4aab34e admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:15.263263 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ede8d4-fc91-4fb5-9e1e-bf90e4aab34e admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:15.264228 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ede8d4-fc91-4fb5-9e1e-bf90e4aab34e admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:15.266552 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ede8d4-fc91-4fb5-9e1e-bf90e4aab34e admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:15.269358 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd04a8f-b37e-49ba-8bad-09c56da0e0b8 None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:15.269655 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd04a8f-b37e-49ba-8bad-09c56da0e0b8 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:15.269939 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd04a8f-b37e-49ba-8bad-09c56da0e0b8 None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:15.271753 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 21/41] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:04:15 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 18:04:15.277980 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc3c31a-0c84-4655-8c45-4a1641eaeac2 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:15.284960 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc3c31a-0c84-4655-8c45-4a1641eaeac2 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:15.284960 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc3c31a-0c84-4655-8c45-4a1641eaeac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:15.295823 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-7dc3c31a-0c84-4655-8c45-4a1641eaeac2 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:04:15.297050 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-7dc3c31a-0c84-4655-8c45-4a1641eaeac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:04:15.304647 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 22/42] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:04:15 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:04:15.328866 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc3c31a-0c84-4655-8c45-4a1641eaeac2 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:15.334998 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 21/43] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:04:15 2021] POST /identity/v3/roles => generated 223 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:04:15.338501 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc3c31a-0c84-4655-8c45-4a1641eaeac2 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:15.343254 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114ec040-e681-48cd-8687-304ef54109e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:15.344132 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ec040-e681-48cd-8687-304ef54109e5 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:15.344448 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ec040-e681-48cd-8687-304ef54109e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:15.344802 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ec040-e681-48cd-8687-304ef54109e5 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:15.346100 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114ec040-e681-48cd-8687-304ef54109e5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:15.348043 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114ec040-e681-48cd-8687-304ef54109e5 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:15.350274 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 23/44] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:04:15 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:15.356618 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ede8d4-fc91-4fb5-9e1e-bf90e4aab34e admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:15.367099 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ede8d4-fc91-4fb5-9e1e-bf90e4aab34e admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:15.374899 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14196ad9-472b-44b9-a489-7306f80936ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:15.374899 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14196ad9-472b-44b9-a489-7306f80936ba admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:15.374899 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14196ad9-472b-44b9-a489-7306f80936ba admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:15.374899 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14196ad9-472b-44b9-a489-7306f80936ba admin admin] PATH_INFO: `/v3/projects` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:15.375270 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14196ad9-472b-44b9-a489-7306f80936ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:15.375685 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING py.warnings [None req-14196ad9-472b-44b9-a489-7306f80936ba admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:04:15.375685 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: warnings.warn(msg) Oct 12 18:04:15.375685 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: Oct 12 18:04:15.377079 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14196ad9-472b-44b9-a489-7306f80936ba admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:15.467778 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 22/45] 10.222.0.18 () {60 vars in 1162 bytes} [Tue Oct 12 18:04:15 2021] POST /identity/v3/projects => generated 312 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:04:16.708264 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5658bcca-49fd-473e-9f27-f51947ea0305 None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:16.708839 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5658bcca-49fd-473e-9f27-f51947ea0305 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:16.708942 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5658bcca-49fd-473e-9f27-f51947ea0305 None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:16.710634 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 24/46] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:04:16 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:04:16.717183 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e39c5a-33b3-479e-af35-288e2dd6c5c1 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:16.717592 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e39c5a-33b3-479e-af35-288e2dd6c5c1 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:16.717833 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e39c5a-33b3-479e-af35-288e2dd6c5c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:16.735528 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-05e39c5a-33b3-479e-af35-288e2dd6c5c1 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:04:16.737068 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-05e39c5a-33b3-479e-af35-288e2dd6c5c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:04:16.792089 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 23/47] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:04:16 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:04:16.815209 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5658bcca-49fd-473e-9f27-f51947ea0305 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:16.827486 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5658bcca-49fd-473e-9f27-f51947ea0305 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:16.831643 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18562ada-d24b-412f-8148-96221cac9fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:16.832440 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18562ada-d24b-412f-8148-96221cac9fce admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:16.832725 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18562ada-d24b-412f-8148-96221cac9fce admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:16.832997 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18562ada-d24b-412f-8148-96221cac9fce admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:16.843339 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18562ada-d24b-412f-8148-96221cac9fce admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 18:04:16.850276 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-18562ada-d24b-412f-8148-96221cac9fce admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 18:04:16.851464 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 25/48] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Oct 12 18:04:16 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:04:16.857595 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e39c5a-33b3-479e-af35-288e2dd6c5c1 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:16.866328 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e39c5a-33b3-479e-af35-288e2dd6c5c1 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:16.870599 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afecd338-0dc2-40b9-9ba5-733a2d1772c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:16.871248 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afecd338-0dc2-40b9-9ba5-733a2d1772c6 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:16.871529 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afecd338-0dc2-40b9-9ba5-733a2d1772c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:16.871803 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afecd338-0dc2-40b9-9ba5-733a2d1772c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:16.872614 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afecd338-0dc2-40b9-9ba5-733a2d1772c6 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:16.872917 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afecd338-0dc2-40b9-9ba5-733a2d1772c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:16.874548 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afecd338-0dc2-40b9-9ba5-733a2d1772c6 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:16.883137 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 24/49] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Oct 12 18:04:16 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:04:16.888879 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18562ada-d24b-412f-8148-96221cac9fce admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:16.899607 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18562ada-d24b-412f-8148-96221cac9fce admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:16.904069 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fc2fe7-90c7-4bf0-99ba-df6040fcf7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:16.904929 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc2fe7-90c7-4bf0-99ba-df6040fcf7b3 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:16.905213 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc2fe7-90c7-4bf0-99ba-df6040fcf7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:16.905486 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc2fe7-90c7-4bf0-99ba-df6040fcf7b3 admin admin] PATH_INFO: `/v3/users/31651079c8d04df8a5fb70d40851475c` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:16.906693 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fc2fe7-90c7-4bf0-99ba-df6040fcf7b3 admin admin] RBAC: Authorizing `identity:get_user(user_id=31651079c8d04df8a5fb70d40851475c)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:16.908564 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fc2fe7-90c7-4bf0-99ba-df6040fcf7b3 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:16.910129 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 26/50] 10.222.0.18 () {56 vars in 1198 bytes} [Tue Oct 12 18:04:16 2021] GET /identity/v3/users/31651079c8d04df8a5fb70d40851475c => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:04:16.915670 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afecd338-0dc2-40b9-9ba5-733a2d1772c6 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:16.924779 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afecd338-0dc2-40b9-9ba5-733a2d1772c6 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:16.929033 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a74d8e4-0cb3-4c0e-a1ed-3d77ded3fa47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:16.930316 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74d8e4-0cb3-4c0e-a1ed-3d77ded3fa47 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:16.930596 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74d8e4-0cb3-4c0e-a1ed-3d77ded3fa47 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:16.930871 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74d8e4-0cb3-4c0e-a1ed-3d77ded3fa47 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:16.932035 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a74d8e4-0cb3-4c0e-a1ed-3d77ded3fa47 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:16.933747 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a74d8e4-0cb3-4c0e-a1ed-3d77ded3fa47 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:16.935240 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 25/51] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:04:16 2021] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:16.940836 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fc2fe7-90c7-4bf0-99ba-df6040fcf7b3 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:16.950419 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fc2fe7-90c7-4bf0-99ba-df6040fcf7b3 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:16.954739 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1323489f-d9bf-48c6-9024-117804f36c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:16.955359 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323489f-d9bf-48c6-9024-117804f36c06 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:16.955629 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323489f-d9bf-48c6-9024-117804f36c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:16.955908 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323489f-d9bf-48c6-9024-117804f36c06 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:16.956770 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1323489f-d9bf-48c6-9024-117804f36c06 admin admin] RBAC: Adding query filter params (role.id=6c54f239944d46e3b027ccce97eb8b49, scope.domain.id=default, user.id=31651079c8d04df8a5fb70d40851475c) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:16.957081 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1323489f-d9bf-48c6-9024-117804f36c06 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:16.958041 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING py.warnings [None req-1323489f-d9bf-48c6-9024-117804f36c06 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:04:16.958041 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: warnings.warn(msg) Oct 12 18:04:16.958041 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: Oct 12 18:04:16.959178 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1323489f-d9bf-48c6-9024-117804f36c06 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:16.966079 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 27/52] 10.222.0.18 () {56 vars in 1343 bytes} [Tue Oct 12 18:04:16 2021] GET /identity/v3/role_assignments?user.id=31651079c8d04df8a5fb70d40851475c&scope.domain.id=default&role.id=6c54f239944d46e3b027ccce97eb8b49 => generated 530 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:04:17.722755 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2550a4-9adf-476d-8fa3-4ab12aaa3f3b None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:17.723274 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2550a4-9adf-476d-8fa3-4ab12aaa3f3b None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:17.723373 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2550a4-9adf-476d-8fa3-4ab12aaa3f3b None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:17.725080 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 26/53] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:04:17 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:04:17.731632 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc45311-4a3d-4af1-8e93-62aec8331767 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:17.732009 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc45311-4a3d-4af1-8e93-62aec8331767 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:17.732190 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc45311-4a3d-4af1-8e93-62aec8331767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:17.749413 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-ecc45311-4a3d-4af1-8e93-62aec8331767 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:04:17.750612 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-ecc45311-4a3d-4af1-8e93-62aec8331767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:04:17.758028 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 28/54] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:04:17 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:04:17.781647 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2550a4-9adf-476d-8fa3-4ab12aaa3f3b None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:17.793828 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2550a4-9adf-476d-8fa3-4ab12aaa3f3b None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:17.797981 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623c143b-a8c1-4e3f-b43b-cd4e8a693780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:17.798749 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623c143b-a8c1-4e3f-b43b-cd4e8a693780 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:17.799025 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623c143b-a8c1-4e3f-b43b-cd4e8a693780 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:17.799296 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623c143b-a8c1-4e3f-b43b-cd4e8a693780 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:17.800502 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623c143b-a8c1-4e3f-b43b-cd4e8a693780 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:17.802178 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623c143b-a8c1-4e3f-b43b-cd4e8a693780 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:17.803693 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 27/55] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:04:17 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:17.809261 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc45311-4a3d-4af1-8e93-62aec8331767 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:17.817845 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc45311-4a3d-4af1-8e93-62aec8331767 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:17.822145 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd081d82-1561-407b-8d37-22e96d2b9398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:17.822774 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd081d82-1561-407b-8d37-22e96d2b9398 admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:17.823057 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd081d82-1561-407b-8d37-22e96d2b9398 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:17.823334 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd081d82-1561-407b-8d37-22e96d2b9398 admin admin] PATH_INFO: `/v3/projects` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:17.824046 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd081d82-1561-407b-8d37-22e96d2b9398 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:17.826005 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd081d82-1561-407b-8d37-22e96d2b9398 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:17.912193 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 29/56] 10.222.0.18 () {60 vars in 1161 bytes} [Tue Oct 12 18:04:17 2021] POST /identity/v3/projects => generated 298 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:04:20.131645 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1155782-9dee-4ca7-915b-3fbda15ab898 None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:20.132161 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1155782-9dee-4ca7-915b-3fbda15ab898 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:20.132327 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1155782-9dee-4ca7-915b-3fbda15ab898 None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:20.134019 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 28/57] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:04:20 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:04:20.139911 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0daf33-c540-42bf-8252-aaa3e16032b9 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:20.140285 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0daf33-c540-42bf-8252-aaa3e16032b9 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:20.140497 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0daf33-c540-42bf-8252-aaa3e16032b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:20.158638 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-be0daf33-c540-42bf-8252-aaa3e16032b9 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:04:20.159823 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-be0daf33-c540-42bf-8252-aaa3e16032b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:04:20.213724 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 30/58] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:04:20 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:04:20.238008 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1155782-9dee-4ca7-915b-3fbda15ab898 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:20.250304 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1155782-9dee-4ca7-915b-3fbda15ab898 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:20.254724 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8123ea-9bf3-49fd-b3d4-cf987dfdbea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:20.255499 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8123ea-9bf3-49fd-b3d4-cf987dfdbea0 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:20.255783 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8123ea-9bf3-49fd-b3d4-cf987dfdbea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:20.256057 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8123ea-9bf3-49fd-b3d4-cf987dfdbea0 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:20.257881 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8123ea-9bf3-49fd-b3d4-cf987dfdbea0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:20.259606 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8123ea-9bf3-49fd-b3d4-cf987dfdbea0 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:20.261201 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 29/59] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:04:20 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:20.266908 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0daf33-c540-42bf-8252-aaa3e16032b9 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:20.275436 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0daf33-c540-42bf-8252-aaa3e16032b9 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:20.279714 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fab382-4e3c-42c4-bddd-68d98638f995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:20.280352 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fab382-4e3c-42c4-bddd-68d98638f995 admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:20.280666 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fab382-4e3c-42c4-bddd-68d98638f995 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:20.280942 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fab382-4e3c-42c4-bddd-68d98638f995 admin admin] PATH_INFO: `/v3/users` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:20.281650 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fab382-4e3c-42c4-bddd-68d98638f995 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:20.282651 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING py.warnings [None req-64fab382-4e3c-42c4-bddd-68d98638f995 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:04:20.282651 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: warnings.warn(msg) Oct 12 18:04:20.282651 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: Oct 12 18:04:20.283874 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fab382-4e3c-42c4-bddd-68d98638f995 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:20.385374 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 31/60] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Oct 12 18:04:20 2021] POST /identity/v3/users => generated 275 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:04:23.864811 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c3ecb-bcbe-455f-abe7-deef2836ad4b None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:23.865312 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c3ecb-bcbe-455f-abe7-deef2836ad4b None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:23.865384 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c3ecb-bcbe-455f-abe7-deef2836ad4b None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:23.868002 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 30/61] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:04:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:04:23.873831 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b63909-52c1-429c-9393-3cd66d6c6a72 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:23.874656 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b63909-52c1-429c-9393-3cd66d6c6a72 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:23.875145 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b63909-52c1-429c-9393-3cd66d6c6a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:23.905458 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-b4b63909-52c1-429c-9393-3cd66d6c6a72 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:04:23.906701 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-b4b63909-52c1-429c-9393-3cd66d6c6a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:04:23.915026 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 32/62] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:04:23 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:04:23.926658 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b9394d-6012-45ff-bfe8-603763981f3c None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:23.926949 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b9394d-6012-45ff-bfe8-603763981f3c None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:23.927233 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b9394d-6012-45ff-bfe8-603763981f3c None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:23.929854 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 31/63] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:04:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:04:23.935786 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b22ae26-f091-4c1b-bb15-f4b3a8c74f30 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:23.936086 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b22ae26-f091-4c1b-bb15-f4b3a8c74f30 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:23.936369 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b22ae26-f091-4c1b-bb15-f4b3a8c74f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:23.945385 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b9394d-6012-45ff-bfe8-603763981f3c None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:23.958007 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b9394d-6012-45ff-bfe8-603763981f3c None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:23.962545 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-5b22ae26-f091-4c1b-bb15-f4b3a8c74f30 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:04:23.963823 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-5b22ae26-f091-4c1b-bb15-f4b3a8c74f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:04:23.970553 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d979d8-de0e-4758-8d6b-77bbacfb9bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:23.971469 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d979d8-de0e-4758-8d6b-77bbacfb9bf4 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:23.971764 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d979d8-de0e-4758-8d6b-77bbacfb9bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:23.972050 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d979d8-de0e-4758-8d6b-77bbacfb9bf4 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:23.987509 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 33/64] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:04:23 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:04:24.000336 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d979d8-de0e-4758-8d6b-77bbacfb9bf4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 18:04:24.012577 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-f9d979d8-de0e-4758-8d6b-77bbacfb9bf4 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 18:04:24.014327 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 32/65] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Oct 12 18:04:23 2021] GET /identity/v3/roles/member => generated 84 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:04:24.021402 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b22ae26-f091-4c1b-bb15-f4b3a8c74f30 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:24.033548 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b22ae26-f091-4c1b-bb15-f4b3a8c74f30 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:24.043040 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c1ac68-e363-476b-a93f-d89207d0727a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:24.043721 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c1ac68-e363-476b-a93f-d89207d0727a admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:24.044013 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c1ac68-e363-476b-a93f-d89207d0727a admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:24.044293 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c1ac68-e363-476b-a93f-d89207d0727a admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:24.045140 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c1ac68-e363-476b-a93f-d89207d0727a admin admin] RBAC: Adding query filter params (name=member) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:24.045451 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c1ac68-e363-476b-a93f-d89207d0727a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:24.047097 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c1ac68-e363-476b-a93f-d89207d0727a admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:24.050072 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d979d8-de0e-4758-8d6b-77bbacfb9bf4 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:24.062297 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 34/66] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Oct 12 18:04:24 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:24.065743 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d979d8-de0e-4758-8d6b-77bbacfb9bf4 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:24.069370 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c1ac68-e363-476b-a93f-d89207d0727a admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:24.081268 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c1ac68-e363-476b-a93f-d89207d0727a admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:24.082779 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c94fd81-f2a1-4a69-8f32-d822a3464100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:24.083867 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c94fd81-f2a1-4a69-8f32-d822a3464100 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:24.084751 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c94fd81-f2a1-4a69-8f32-d822a3464100 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:24.085687 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c94fd81-f2a1-4a69-8f32-d822a3464100 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:24.093969 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5067987-755b-40ea-a109-2992593fb72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:24.095113 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5067987-755b-40ea-a109-2992593fb72c admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:24.095615 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5067987-755b-40ea-a109-2992593fb72c admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:24.096104 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5067987-755b-40ea-a109-2992593fb72c admin admin] PATH_INFO: `/v3/users/f7cf3b0b3886414d8205a6258403e8e2` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:24.109702 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c94fd81-f2a1-4a69-8f32-d822a3464100 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 18:04:24.118858 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-2c94fd81-f2a1-4a69-8f32-d822a3464100 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 18:04:24.123825 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 33/67] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Oct 12 18:04:24 2021] GET /identity/v3/roles/admin => generated 83 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 18:04:24.124864 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5067987-755b-40ea-a109-2992593fb72c admin admin] RBAC: Authorizing `identity:get_user(user_id=f7cf3b0b3886414d8205a6258403e8e2)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:24.127408 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5067987-755b-40ea-a109-2992593fb72c admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:24.130591 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c94fd81-f2a1-4a69-8f32-d822a3464100 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:24.131931 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 35/68] 10.222.0.18 () {56 vars in 1198 bytes} [Tue Oct 12 18:04:24 2021] GET /identity/v3/users/f7cf3b0b3886414d8205a6258403e8e2 => generated 275 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:24.138148 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3058dc8-d6df-4272-9d80-0a725c529f76 None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:24.138773 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3058dc8-d6df-4272-9d80-0a725c529f76 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:24.139283 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3058dc8-d6df-4272-9d80-0a725c529f76 None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:24.141663 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 36/69] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:04:24 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:04:24.144967 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3058dc8-d6df-4272-9d80-0a725c529f76 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:24.149202 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c94fd81-f2a1-4a69-8f32-d822a3464100 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:24.153840 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5c2bc3-3357-43fb-bcbc-e21c581abada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:24.154536 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c2bc3-3357-43fb-bcbc-e21c581abada admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:24.154823 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c2bc3-3357-43fb-bcbc-e21c581abada admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:24.155218 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c2bc3-3357-43fb-bcbc-e21c581abada admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:24.155892 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5c2bc3-3357-43fb-bcbc-e21c581abada admin admin] RBAC: Adding query filter params (name=admin) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:24.156203 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5c2bc3-3357-43fb-bcbc-e21c581abada admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:24.158101 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5c2bc3-3357-43fb-bcbc-e21c581abada admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:24.158498 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3058dc8-d6df-4272-9d80-0a725c529f76 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:24.163044 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffa17ee-957c-49e6-bbc4-807d3feb9bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:24.164234 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa17ee-957c-49e6-bbc4-807d3feb9bed admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:24.164560 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa17ee-957c-49e6-bbc4-807d3feb9bed admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:24.164840 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa17ee-957c-49e6-bbc4-807d3feb9bed admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:24.167817 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 34/70] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Oct 12 18:04:24 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:24.170062 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0327084-3c6a-4f13-aa1e-31bed4c4d265 None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:24.170562 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0327084-3c6a-4f13-aa1e-31bed4c4d265 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:24.171591 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0327084-3c6a-4f13-aa1e-31bed4c4d265 None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:24.173375 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffa17ee-957c-49e6-bbc4-807d3feb9bed admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:24.174356 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 35/71] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:04:24 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:04:24.175610 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffa17ee-957c-49e6-bbc4-807d3feb9bed admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:24.175717 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa5117-1778-4d80-8384-323a738c7e2d None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:24.175717 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa5117-1778-4d80-8384-323a738c7e2d None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:24.175963 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa5117-1778-4d80-8384-323a738c7e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:24.184942 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 37/72] 10.222.0.18 () {58 vars in 1324 bytes} [Tue Oct 12 18:04:24 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:04:24.185748 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffa17ee-957c-49e6-bbc4-807d3feb9bed admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:24.194466 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-03fa5117-1778-4d80-8384-323a738c7e2d None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:04:24.195694 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-03fa5117-1778-4d80-8384-323a738c7e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:04:24.197014 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffa17ee-957c-49e6-bbc4-807d3feb9bed admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:24.201446 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fd8646-ba12-40e7-8267-11fe5195fdf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:24.202295 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd8646-ba12-40e7-8267-11fe5195fdf0 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:24.202578 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd8646-ba12-40e7-8267-11fe5195fdf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:24.202854 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd8646-ba12-40e7-8267-11fe5195fdf0 admin admin] PATH_INFO: `/v3/users/31651079c8d04df8a5fb70d40851475c` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:24.206785 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 36/73] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:04:24 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:04:24.206917 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fd8646-ba12-40e7-8267-11fe5195fdf0 admin admin] RBAC: Authorizing `identity:get_user(user_id=31651079c8d04df8a5fb70d40851475c)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:24.207005 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d3ea3-18ed-428a-90f3-e4896170438b None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:24.207005 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d3ea3-18ed-428a-90f3-e4896170438b None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:24.207005 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d3ea3-18ed-428a-90f3-e4896170438b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:24.207218 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fd8646-ba12-40e7-8267-11fe5195fdf0 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:24.207997 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 38/74] 10.222.0.18 () {56 vars in 1198 bytes} [Tue Oct 12 18:04:24 2021] GET /identity/v3/users/31651079c8d04df8a5fb70d40851475c => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:24.213212 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fd8646-ba12-40e7-8267-11fe5195fdf0 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:24.222645 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fd8646-ba12-40e7-8267-11fe5195fdf0 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:24.224045 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-173d3ea3-18ed-428a-90f3-e4896170438b None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:04:24.225224 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-173d3ea3-18ed-428a-90f3-e4896170438b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:04:24.227985 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b302e6-c608-42b0-aa95-7db7189bbdee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:24.228867 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b302e6-c608-42b0-aa95-7db7189bbdee admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:24.229156 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b302e6-c608-42b0-aa95-7db7189bbdee admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:24.229433 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b302e6-c608-42b0-aa95-7db7189bbdee admin admin] PATH_INFO: `/v3/projects/1065667c5e62410e8db95ee2e1b98135` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:24.230632 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b302e6-c608-42b0-aa95-7db7189bbdee admin admin] RBAC: Authorizing `identity:get_project(project_id=1065667c5e62410e8db95ee2e1b98135)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:24.232777 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b302e6-c608-42b0-aa95-7db7189bbdee admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:24.234208 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 37/75] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:04:24 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:04:24.234929 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d3ea3-18ed-428a-90f3-e4896170438b None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:24.237679 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 39/76] 10.222.0.18 () {56 vars in 1207 bytes} [Tue Oct 12 18:04:24 2021] GET /identity/v3/projects/1065667c5e62410e8db95ee2e1b98135 => generated 298 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:24.238683 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b302e6-c608-42b0-aa95-7db7189bbdee admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:24.249457 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d3ea3-18ed-428a-90f3-e4896170438b None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:24.254240 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b302e6-c608-42b0-aa95-7db7189bbdee admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:24.258417 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442d9857-b61f-4cc8-91a1-7d69c41671f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:24.258895 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e15c111-b4f9-4472-860d-03de194cb304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:24.259113 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442d9857-b61f-4cc8-91a1-7d69c41671f7 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:24.259364 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442d9857-b61f-4cc8-91a1-7d69c41671f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:24.259641 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442d9857-b61f-4cc8-91a1-7d69c41671f7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:24.259733 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15c111-b4f9-4472-860d-03de194cb304 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:24.259946 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15c111-b4f9-4472-860d-03de194cb304 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:24.260228 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15c111-b4f9-4472-860d-03de194cb304 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:24.261442 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e15c111-b4f9-4472-860d-03de194cb304 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:24.263145 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e15c111-b4f9-4472-860d-03de194cb304 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:24.264789 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 40/77] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:04:24 2021] GET /identity/v3/domains/default => generated 199 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:24.265606 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e15c111-b4f9-4472-860d-03de194cb304 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:24.269261 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442d9857-b61f-4cc8-91a1-7d69c41671f7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:24.271519 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442d9857-b61f-4cc8-91a1-7d69c41671f7 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:24.275537 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e15c111-b4f9-4472-860d-03de194cb304 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:24.279902 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc0f1bc-5ca3-488e-9350-eb7b884a042a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:24.280553 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc0f1bc-5ca3-488e-9350-eb7b884a042a admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:24.280667 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 38/78] 10.222.0.18 () {58 vars in 1324 bytes} [Tue Oct 12 18:04:24 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:04:24.280906 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc0f1bc-5ca3-488e-9350-eb7b884a042a admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:24.281196 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc0f1bc-5ca3-488e-9350-eb7b884a042a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:24.281439 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442d9857-b61f-4cc8-91a1-7d69c41671f7 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:24.282094 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc0f1bc-5ca3-488e-9350-eb7b884a042a admin admin] RBAC: Adding query filter params (role.id=33b8a5a8d1d643f2a98f598e6ab0a1cf, scope.project.id=1065667c5e62410e8db95ee2e1b98135, user.id=f7cf3b0b3886414d8205a6258403e8e2) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:24.282414 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc0f1bc-5ca3-488e-9350-eb7b884a042a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:24.284252 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc0f1bc-5ca3-488e-9350-eb7b884a042a admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:24.290317 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 41/79] 10.222.0.18 () {56 vars in 1395 bytes} [Tue Oct 12 18:04:24 2021] GET /identity/v3/role_assignments?user.id=f7cf3b0b3886414d8205a6258403e8e2&scope.project.id=1065667c5e62410e8db95ee2e1b98135&role.id=33b8a5a8d1d643f2a98f598e6ab0a1cf => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:24.290426 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442d9857-b61f-4cc8-91a1-7d69c41671f7 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:24.290990 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc0f1bc-5ca3-488e-9350-eb7b884a042a admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:24.294619 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2509e84f-2c43-4259-9b3e-e6a24fb5bfaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:24.295427 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2509e84f-2c43-4259-9b3e-e6a24fb5bfaf admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:24.295711 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2509e84f-2c43-4259-9b3e-e6a24fb5bfaf admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:24.295979 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2509e84f-2c43-4259-9b3e-e6a24fb5bfaf admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:24.300796 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc0f1bc-5ca3-488e-9350-eb7b884a042a admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:24.306094 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6650e7-7da3-4af7-925e-afd659e932db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:24.306773 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6650e7-7da3-4af7-925e-afd659e932db admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:24.307056 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6650e7-7da3-4af7-925e-afd659e932db admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:24.307332 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6650e7-7da3-4af7-925e-afd659e932db admin admin] PATH_INFO: `/v3/projects` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:24.308078 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6650e7-7da3-4af7-925e-afd659e932db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:24.308600 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2509e84f-2c43-4259-9b3e-e6a24fb5bfaf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 18:04:24.310132 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6650e7-7da3-4af7-925e-afd659e932db admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:24.316194 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-2509e84f-2c43-4259-9b3e-e6a24fb5bfaf admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 18:04:24.317660 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 39/80] 10.222.0.18 () {56 vars in 1135 bytes} [Tue Oct 12 18:04:24 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:04:24.318940 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f0e8aa-44cb-4576-9e6b-b447eae8cce8 None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:24.319229 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f0e8aa-44cb-4576-9e6b-b447eae8cce8 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:24.319539 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f0e8aa-44cb-4576-9e6b-b447eae8cce8 None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:24.323105 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 40/81] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:04:24 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:04:24.323105 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f0e8aa-44cb-4576-9e6b-b447eae8cce8 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:24.336525 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f0e8aa-44cb-4576-9e6b-b447eae8cce8 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:24.340875 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f89503-4139-4cfe-987c-562f4c5ad9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:24.341748 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f89503-4139-4cfe-987c-562f4c5ad9f3 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:24.342029 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f89503-4139-4cfe-987c-562f4c5ad9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:24.342301 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f89503-4139-4cfe-987c-562f4c5ad9f3 admin admin] PATH_INFO: `/v3/projects/1065667c5e62410e8db95ee2e1b98135` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:24.347449 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f89503-4139-4cfe-987c-562f4c5ad9f3 admin admin] RBAC: Authorizing `identity:get_project(project_id=1065667c5e62410e8db95ee2e1b98135)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:24.347449 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f89503-4139-4cfe-987c-562f4c5ad9f3 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:24.347449 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 41/82] 10.222.0.18 () {56 vars in 1207 bytes} [Tue Oct 12 18:04:24 2021] GET /identity/v3/projects/1065667c5e62410e8db95ee2e1b98135 => generated 298 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:24.348265 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f89503-4139-4cfe-987c-562f4c5ad9f3 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:24.359388 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f89503-4139-4cfe-987c-562f4c5ad9f3 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:24.363800 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eaa5ce-f65c-44ae-bbca-4d2bf4b9d864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:24.364504 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eaa5ce-f65c-44ae-bbca-4d2bf4b9d864 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:24.364791 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eaa5ce-f65c-44ae-bbca-4d2bf4b9d864 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:24.365073 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eaa5ce-f65c-44ae-bbca-4d2bf4b9d864 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:24.365854 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eaa5ce-f65c-44ae-bbca-4d2bf4b9d864 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:24.366163 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eaa5ce-f65c-44ae-bbca-4d2bf4b9d864 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:24.368510 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eaa5ce-f65c-44ae-bbca-4d2bf4b9d864 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:24.377549 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 42/83] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Oct 12 18:04:24 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:24.378903 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7ca3e-88c1-4e66-848c-b9688b6eabec None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:24.379193 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7ca3e-88c1-4e66-848c-b9688b6eabec None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:24.379473 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7ca3e-88c1-4e66-848c-b9688b6eabec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:24.399669 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-17a7ca3e-88c1-4e66-848c-b9688b6eabec None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:04:24.400935 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-17a7ca3e-88c1-4e66-848c-b9688b6eabec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:04:24.408852 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 43/84] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:04:24 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:04:24.409722 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a7ca3e-88c1-4e66-848c-b9688b6eabec None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:24.420006 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a7ca3e-88c1-4e66-848c-b9688b6eabec None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:24.424636 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab2c4cf-0304-4f9e-8f40-ea038366ddb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:24.425289 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab2c4cf-0304-4f9e-8f40-ea038366ddb8 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:24.425586 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab2c4cf-0304-4f9e-8f40-ea038366ddb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:24.425855 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab2c4cf-0304-4f9e-8f40-ea038366ddb8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:24.426715 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab2c4cf-0304-4f9e-8f40-ea038366ddb8 admin admin] RBAC: Adding query filter params (role.id=6c54f239944d46e3b027ccce97eb8b49, scope.project.id=1065667c5e62410e8db95ee2e1b98135, user.id=31651079c8d04df8a5fb70d40851475c) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:24.427029 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab2c4cf-0304-4f9e-8f40-ea038366ddb8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:24.429012 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab2c4cf-0304-4f9e-8f40-ea038366ddb8 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:24.438191 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 44/85] 10.222.0.18 () {56 vars in 1395 bytes} [Tue Oct 12 18:04:24 2021] GET /identity/v3/role_assignments?user.id=31651079c8d04df8a5fb70d40851475c&scope.project.id=1065667c5e62410e8db95ee2e1b98135&role.id=6c54f239944d46e3b027ccce97eb8b49 => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:24.438866 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab2c4cf-0304-4f9e-8f40-ea038366ddb8 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:24.449433 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab2c4cf-0304-4f9e-8f40-ea038366ddb8 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:24.456739 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 42/86] 10.222.0.18 () {60 vars in 1162 bytes} [Tue Oct 12 18:04:24 2021] POST /identity/v3/projects => generated 302 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:04:24.456739 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6650e7-7da3-4af7-925e-afd659e932db admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:24.565240 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a71f1c-096e-4b0a-a604-793adabd3c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:24.566146 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a71f1c-096e-4b0a-a604-793adabd3c7a admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:24.566434 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a71f1c-096e-4b0a-a604-793adabd3c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:24.566715 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a71f1c-096e-4b0a-a604-793adabd3c7a admin admin] PATH_INFO: `/v3/users/f7cf3b0b3886414d8205a6258403e8e2` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:24.568497 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a71f1c-096e-4b0a-a604-793adabd3c7a admin admin] RBAC: Authorizing `identity:get_user(user_id=f7cf3b0b3886414d8205a6258403e8e2)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:24.570807 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a71f1c-096e-4b0a-a604-793adabd3c7a admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:24.574004 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 45/87] 10.222.0.18 () {56 vars in 1198 bytes} [Tue Oct 12 18:04:24 2021] GET /identity/v3/users/f7cf3b0b3886414d8205a6258403e8e2 => generated 275 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:24.579076 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a71f1c-096e-4b0a-a604-793adabd3c7a admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:24.590038 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a71f1c-096e-4b0a-a604-793adabd3c7a admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:24.591724 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6650e7-7da3-4af7-925e-afd659e932db admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:24.594774 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af1dea5-00ba-4257-9483-1047436f4066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:24.595525 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af1dea5-00ba-4257-9483-1047436f4066 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:24.595889 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af1dea5-00ba-4257-9483-1047436f4066 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:24.596253 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af1dea5-00ba-4257-9483-1047436f4066 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:24.602689 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7738883-ba37-45c2-a8f1-a430eb8f4531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:24.603867 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7738883-ba37-45c2-a8f1-a430eb8f4531 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:24.604360 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7738883-ba37-45c2-a8f1-a430eb8f4531 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:24.604851 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7738883-ba37-45c2-a8f1-a430eb8f4531 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:24.606140 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af1dea5-00ba-4257-9483-1047436f4066 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:24.608235 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af1dea5-00ba-4257-9483-1047436f4066 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:24.631470 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 46/88] 10.222.0.18 () {58 vars in 1324 bytes} [Tue Oct 12 18:04:24 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 18:04:24.642655 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af1dea5-00ba-4257-9483-1047436f4066 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:24.643497 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7738883-ba37-45c2-a8f1-a430eb8f4531 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 18:04:24.655926 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-d7738883-ba37-45c2-a8f1-a430eb8f4531 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 18:04:24.658801 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 43/89] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Oct 12 18:04:24 2021] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:04:24.662695 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af1dea5-00ba-4257-9483-1047436f4066 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:24.666470 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7738883-ba37-45c2-a8f1-a430eb8f4531 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:24.674748 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b9b708-4384-4c09-b000-28554eb92089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:24.678027 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b9b708-4384-4c09-b000-28554eb92089 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:24.678314 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b9b708-4384-4c09-b000-28554eb92089 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:24.678583 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b9b708-4384-4c09-b000-28554eb92089 admin admin] PATH_INFO: `/v3/projects/1065667c5e62410e8db95ee2e1b98135` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:24.681137 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b9b708-4384-4c09-b000-28554eb92089 admin admin] RBAC: Authorizing `identity:get_project(project_id=1065667c5e62410e8db95ee2e1b98135)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:24.683253 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b9b708-4384-4c09-b000-28554eb92089 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:24.685258 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 47/90] 10.222.0.18 () {56 vars in 1207 bytes} [Tue Oct 12 18:04:24 2021] GET /identity/v3/projects/1065667c5e62410e8db95ee2e1b98135 => generated 298 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:04:24.687701 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7738883-ba37-45c2-a8f1-a430eb8f4531 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:24.691620 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b9b708-4384-4c09-b000-28554eb92089 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:24.697790 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc135fe7-911f-4f96-957a-a87a28a66a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:24.698708 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc135fe7-911f-4f96-957a-a87a28a66a0e admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:24.699169 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc135fe7-911f-4f96-957a-a87a28a66a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:24.699449 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc135fe7-911f-4f96-957a-a87a28a66a0e admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:24.700236 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc135fe7-911f-4f96-957a-a87a28a66a0e admin admin] RBAC: Adding query filter params (name=member) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:24.700575 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc135fe7-911f-4f96-957a-a87a28a66a0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:24.702257 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc135fe7-911f-4f96-957a-a87a28a66a0e admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:24.703819 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b9b708-4384-4c09-b000-28554eb92089 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:24.711219 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d9d49-d511-40b9-a32f-5a12e1f69c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:24.712218 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d9d49-d511-40b9-a32f-5a12e1f69c51 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:24.712742 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d9d49-d511-40b9-a32f-5a12e1f69c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:24.713242 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d9d49-d511-40b9-a32f-5a12e1f69c51 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:24.714311 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688d9d49-d511-40b9-a32f-5a12e1f69c51 admin admin] RBAC: Adding query filter params (role.id=17c81d2cd8f34ad49f4c495ecb2d982e, scope.project.id=1065667c5e62410e8db95ee2e1b98135, user.id=f7cf3b0b3886414d8205a6258403e8e2) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:24.714850 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688d9d49-d511-40b9-a32f-5a12e1f69c51 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:24.716314 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 44/91] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Oct 12 18:04:24 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:24.717278 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688d9d49-d511-40b9-a32f-5a12e1f69c51 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:24.726585 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc135fe7-911f-4f96-957a-a87a28a66a0e admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:24.733170 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 48/92] 10.222.0.18 () {56 vars in 1395 bytes} [Tue Oct 12 18:04:24 2021] GET /identity/v3/role_assignments?user.id=f7cf3b0b3886414d8205a6258403e8e2&scope.project.id=1065667c5e62410e8db95ee2e1b98135&role.id=17c81d2cd8f34ad49f4c495ecb2d982e => generated 259 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:04:24.736174 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc135fe7-911f-4f96-957a-a87a28a66a0e admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:24.740827 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d36648-11ef-43ff-9e10-96aafede1ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:24.741750 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d36648-11ef-43ff-9e10-96aafede1ac9 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:24.742023 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d36648-11ef-43ff-9e10-96aafede1ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:24.742299 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d36648-11ef-43ff-9e10-96aafede1ac9 admin admin] PATH_INFO: `/v3/users/f7cf3b0b3886414d8205a6258403e8e2` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:24.743574 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d36648-11ef-43ff-9e10-96aafede1ac9 admin admin] RBAC: Authorizing `identity:get_user(user_id=f7cf3b0b3886414d8205a6258403e8e2)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:24.745875 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d36648-11ef-43ff-9e10-96aafede1ac9 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:24.747924 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 45/93] 10.222.0.18 () {56 vars in 1198 bytes} [Tue Oct 12 18:04:24 2021] GET /identity/v3/users/f7cf3b0b3886414d8205a6258403e8e2 => generated 275 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:24.754043 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d9d49-d511-40b9-a32f-5a12e1f69c51 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:24.764563 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d9d49-d511-40b9-a32f-5a12e1f69c51 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:24.770217 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7186ce6-10a6-4650-8825-fca24410d23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:24.770882 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7186ce6-10a6-4650-8825-fca24410d23d admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:24.771209 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7186ce6-10a6-4650-8825-fca24410d23d admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:24.771482 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7186ce6-10a6-4650-8825-fca24410d23d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:24.781188 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7186ce6-10a6-4650-8825-fca24410d23d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:24.782993 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7186ce6-10a6-4650-8825-fca24410d23d admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:24.794454 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 49/94] 10.222.0.18 () {58 vars in 1324 bytes} [Tue Oct 12 18:04:24 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:04:24.801010 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d36648-11ef-43ff-9e10-96aafede1ac9 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:24.811636 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d36648-11ef-43ff-9e10-96aafede1ac9 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:24.817252 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f879d932-9060-4901-86cf-e74d2fbe4890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:24.818174 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f879d932-9060-4901-86cf-e74d2fbe4890 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:24.818458 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f879d932-9060-4901-86cf-e74d2fbe4890 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:24.818738 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f879d932-9060-4901-86cf-e74d2fbe4890 admin admin] PATH_INFO: `/v3/projects/93e289af362942d0b18d319165d0e31e` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:24.820543 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f879d932-9060-4901-86cf-e74d2fbe4890 admin admin] RBAC: Authorizing `identity:get_project(project_id=93e289af362942d0b18d319165d0e31e)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:24.822718 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f879d932-9060-4901-86cf-e74d2fbe4890 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:24.824498 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 46/95] 10.222.0.18 () {56 vars in 1207 bytes} [Tue Oct 12 18:04:24 2021] GET /identity/v3/projects/93e289af362942d0b18d319165d0e31e => generated 312 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:24.831407 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7186ce6-10a6-4650-8825-fca24410d23d admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:24.841074 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7186ce6-10a6-4650-8825-fca24410d23d admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:24.846674 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35c4c73-f5ab-487a-a5a2-fd8f4a497b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:24.847348 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c4c73-f5ab-487a-a5a2-fd8f4a497b04 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:24.847685 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c4c73-f5ab-487a-a5a2-fd8f4a497b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:24.847969 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c4c73-f5ab-487a-a5a2-fd8f4a497b04 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:24.848922 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35c4c73-f5ab-487a-a5a2-fd8f4a497b04 admin admin] RBAC: Adding query filter params (role.id=33b8a5a8d1d643f2a98f598e6ab0a1cf, scope.project.id=93e289af362942d0b18d319165d0e31e, user.id=f7cf3b0b3886414d8205a6258403e8e2) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:24.849236 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35c4c73-f5ab-487a-a5a2-fd8f4a497b04 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:24.851710 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35c4c73-f5ab-487a-a5a2-fd8f4a497b04 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:24.858211 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 50/96] 10.222.0.18 () {56 vars in 1395 bytes} [Tue Oct 12 18:04:24 2021] GET /identity/v3/role_assignments?user.id=f7cf3b0b3886414d8205a6258403e8e2&scope.project.id=93e289af362942d0b18d319165d0e31e&role.id=33b8a5a8d1d643f2a98f598e6ab0a1cf => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:27.030690 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359804b-b4eb-448e-873a-026983157e4d None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:27.031202 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359804b-b4eb-448e-873a-026983157e4d None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:27.031304 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359804b-b4eb-448e-873a-026983157e4d None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:27.033301 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 47/97] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:04:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:04:27.039899 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1cf96b-a2d7-404b-9a59-ee1a55617452 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:27.040308 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1cf96b-a2d7-404b-9a59-ee1a55617452 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:27.040499 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1cf96b-a2d7-404b-9a59-ee1a55617452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:27.058701 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-ea1cf96b-a2d7-404b-9a59-ee1a55617452 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:04:27.059898 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-ea1cf96b-a2d7-404b-9a59-ee1a55617452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:04:27.080234 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 51/98] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:04:27 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:04:27.124146 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0359804b-b4eb-448e-873a-026983157e4d None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:27.143127 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0359804b-b4eb-448e-873a-026983157e4d None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:27.150085 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1212524-bd22-42d2-8ea8-2d1dc2bfa420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:27.150894 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1212524-bd22-42d2-8ea8-2d1dc2bfa420 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:27.151176 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1212524-bd22-42d2-8ea8-2d1dc2bfa420 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:27.151450 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1212524-bd22-42d2-8ea8-2d1dc2bfa420 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:27.165294 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1212524-bd22-42d2-8ea8-2d1dc2bfa420 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 18:04:27.173171 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-b1212524-bd22-42d2-8ea8-2d1dc2bfa420 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 18:04:27.174965 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 48/99] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Oct 12 18:04:27 2021] GET /identity/v3/roles/member => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:04:27.181578 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1cf96b-a2d7-404b-9a59-ee1a55617452 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:27.190599 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1cf96b-a2d7-404b-9a59-ee1a55617452 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:27.203667 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6edeb96-8bd0-418f-b050-cca0373b5b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:27.204348 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6edeb96-8bd0-418f-b050-cca0373b5b31 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:27.204700 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6edeb96-8bd0-418f-b050-cca0373b5b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:27.204981 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6edeb96-8bd0-418f-b050-cca0373b5b31 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:27.205745 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6edeb96-8bd0-418f-b050-cca0373b5b31 admin admin] RBAC: Adding query filter params (name=member) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:27.206048 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6edeb96-8bd0-418f-b050-cca0373b5b31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:27.207667 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6edeb96-8bd0-418f-b050-cca0373b5b31 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:27.222704 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 52/100] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Oct 12 18:04:27 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:27.229410 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1212524-bd22-42d2-8ea8-2d1dc2bfa420 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:27.245592 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1212524-bd22-42d2-8ea8-2d1dc2bfa420 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:27.254936 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a3ccd-591d-4bf7-b55b-eef2570f77bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:27.256054 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a3ccd-591d-4bf7-b55b-eef2570f77bd admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:27.256573 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a3ccd-591d-4bf7-b55b-eef2570f77bd admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:27.257572 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a3ccd-591d-4bf7-b55b-eef2570f77bd admin admin] PATH_INFO: `/v3/users/f7cf3b0b3886414d8205a6258403e8e2` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:27.259236 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297a3ccd-591d-4bf7-b55b-eef2570f77bd admin admin] RBAC: Authorizing `identity:get_user(user_id=f7cf3b0b3886414d8205a6258403e8e2)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:27.261666 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297a3ccd-591d-4bf7-b55b-eef2570f77bd admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:27.263815 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 49/101] 10.222.0.18 () {56 vars in 1198 bytes} [Tue Oct 12 18:04:27 2021] GET /identity/v3/users/f7cf3b0b3886414d8205a6258403e8e2 => generated 275 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:27.269793 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6edeb96-8bd0-418f-b050-cca0373b5b31 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:27.280355 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6edeb96-8bd0-418f-b050-cca0373b5b31 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:27.281347 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8ff09-ad52-45ed-8e14-49bec9a42648 None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:27.281581 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8ff09-ad52-45ed-8e14-49bec9a42648 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:27.281859 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8ff09-ad52-45ed-8e14-49bec9a42648 None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:27.283740 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 50/102] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:04:27 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 18:04:27.289200 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd875e-064b-4319-8482-dc198bc41aaa None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:27.289488 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd875e-064b-4319-8482-dc198bc41aaa None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:27.289772 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd875e-064b-4319-8482-dc198bc41aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:27.292652 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c7ff84-3d4b-4a0b-814f-26c380cfdc0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:27.293514 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7ff84-3d4b-4a0b-814f-26c380cfdc0f admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:27.293795 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7ff84-3d4b-4a0b-814f-26c380cfdc0f admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:27.294068 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7ff84-3d4b-4a0b-814f-26c380cfdc0f admin admin] PATH_INFO: `/v3/projects/1065667c5e62410e8db95ee2e1b98135` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:27.295270 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c7ff84-3d4b-4a0b-814f-26c380cfdc0f admin admin] RBAC: Authorizing `identity:get_project(project_id=1065667c5e62410e8db95ee2e1b98135)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:27.297459 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c7ff84-3d4b-4a0b-814f-26c380cfdc0f admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:27.299135 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 53/103] 10.222.0.18 () {56 vars in 1207 bytes} [Tue Oct 12 18:04:27 2021] GET /identity/v3/projects/1065667c5e62410e8db95ee2e1b98135 => generated 298 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:27.305118 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c7ff84-3d4b-4a0b-814f-26c380cfdc0f admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:27.308453 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-81fd875e-064b-4319-8482-dc198bc41aaa None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:04:27.309774 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-81fd875e-064b-4319-8482-dc198bc41aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:04:27.324417 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c7ff84-3d4b-4a0b-814f-26c380cfdc0f admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:27.324657 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 51/104] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:04:27 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:04:27.331609 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74821200-986b-4793-be2d-753f586bed3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:27.332524 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74821200-986b-4793-be2d-753f586bed3d admin admin] REQUEST_METHOD: `PUT` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:27.332804 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74821200-986b-4793-be2d-753f586bed3d admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:27.333075 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74821200-986b-4793-be2d-753f586bed3d admin admin] PATH_INFO: `/v3/projects/1065667c5e62410e8db95ee2e1b98135/users/f7cf3b0b3886414d8205a6258403e8e2/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:27.335091 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74821200-986b-4793-be2d-753f586bed3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1065667c5e62410e8db95ee2e1b98135, user_id=f7cf3b0b3886414d8205a6258403e8e2, role_id=33b8a5a8d1d643f2a98f598e6ab0a1cf)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:27.336661 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING py.warnings [None req-74821200-986b-4793-be2d-753f586bed3d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:04:27.336661 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: warnings.warn(msg) Oct 12 18:04:27.336661 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: Oct 12 18:04:27.338635 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74821200-986b-4793-be2d-753f586bed3d admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:27.343867 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd875e-064b-4319-8482-dc198bc41aaa None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:27.354127 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd875e-064b-4319-8482-dc198bc41aaa None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:27.359436 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175b557f-2d0e-4003-bdc5-58ec6dd84426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:27.360653 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b557f-2d0e-4003-bdc5-58ec6dd84426 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:27.361088 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b557f-2d0e-4003-bdc5-58ec6dd84426 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:27.364637 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b557f-2d0e-4003-bdc5-58ec6dd84426 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:27.375736 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175b557f-2d0e-4003-bdc5-58ec6dd84426 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 18:04:27.384223 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-175b557f-2d0e-4003-bdc5-58ec6dd84426 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 18:04:27.391957 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 52/105] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Oct 12 18:04:27 2021] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:04:27.393612 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175b557f-2d0e-4003-bdc5-58ec6dd84426 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:27.403917 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175b557f-2d0e-4003-bdc5-58ec6dd84426 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:27.408545 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01614f72-d13f-406d-8a4d-42dc29592ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:27.409216 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01614f72-d13f-406d-8a4d-42dc29592ea8 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:27.409504 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01614f72-d13f-406d-8a4d-42dc29592ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:27.415956 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01614f72-d13f-406d-8a4d-42dc29592ea8 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:27.415956 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01614f72-d13f-406d-8a4d-42dc29592ea8 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:27.415956 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01614f72-d13f-406d-8a4d-42dc29592ea8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:27.415956 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01614f72-d13f-406d-8a4d-42dc29592ea8 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:27.421806 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 53/106] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Oct 12 18:04:27 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:04:27.429924 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01614f72-d13f-406d-8a4d-42dc29592ea8 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:27.439982 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01614f72-d13f-406d-8a4d-42dc29592ea8 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:27.445397 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1a81a2-df63-4265-9311-bd476c449393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:27.446343 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a81a2-df63-4265-9311-bd476c449393 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:27.446626 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a81a2-df63-4265-9311-bd476c449393 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:27.446946 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a81a2-df63-4265-9311-bd476c449393 admin admin] PATH_INFO: `/v3/users/31651079c8d04df8a5fb70d40851475c` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:27.448592 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1a81a2-df63-4265-9311-bd476c449393 admin admin] RBAC: Authorizing `identity:get_user(user_id=31651079c8d04df8a5fb70d40851475c)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:27.450613 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1a81a2-df63-4265-9311-bd476c449393 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:27.456564 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 54/107] 10.222.0.18 () {56 vars in 1198 bytes} [Tue Oct 12 18:04:27 2021] GET /identity/v3/users/31651079c8d04df8a5fb70d40851475c => generated 247 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:27.458040 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 54/108] 10.222.0.18 () {58 vars in 1460 bytes} [Tue Oct 12 18:04:27 2021] PUT /identity/v3/projects/1065667c5e62410e8db95ee2e1b98135/users/f7cf3b0b3886414d8205a6258403e8e2/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 18:04:27.459930 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1a81a2-df63-4265-9311-bd476c449393 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:27.471420 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1a81a2-df63-4265-9311-bd476c449393 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:27.519988 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d8257-ba63-4a0c-9f4b-34411e3fea91 None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:27.520277 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d8257-ba63-4a0c-9f4b-34411e3fea91 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:27.520585 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d8257-ba63-4a0c-9f4b-34411e3fea91 None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:27.522501 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 55/109] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:04:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 18:04:27.529206 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a12f94f-1fb7-4ac7-b1da-ffd3fc7be5c4 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:27.529498 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a12f94f-1fb7-4ac7-b1da-ffd3fc7be5c4 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:27.529778 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a12f94f-1fb7-4ac7-b1da-ffd3fc7be5c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:27.541008 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a25ed67-a952-42f5-abf3-bed7752bb8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:27.542178 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a25ed67-a952-42f5-abf3-bed7752bb8a1 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:27.542603 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a25ed67-a952-42f5-abf3-bed7752bb8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:27.543015 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a25ed67-a952-42f5-abf3-bed7752bb8a1 admin admin] PATH_INFO: `/v3/projects/1065667c5e62410e8db95ee2e1b98135` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:27.544564 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a25ed67-a952-42f5-abf3-bed7752bb8a1 admin admin] RBAC: Authorizing `identity:get_project(project_id=1065667c5e62410e8db95ee2e1b98135)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:27.546954 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a25ed67-a952-42f5-abf3-bed7752bb8a1 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:27.554962 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 55/110] 10.222.0.18 () {56 vars in 1207 bytes} [Tue Oct 12 18:04:27 2021] GET /identity/v3/projects/1065667c5e62410e8db95ee2e1b98135 => generated 298 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:27.556564 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a25ed67-a952-42f5-abf3-bed7752bb8a1 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:27.562378 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-8a12f94f-1fb7-4ac7-b1da-ffd3fc7be5c4 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:04:27.563598 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-8a12f94f-1fb7-4ac7-b1da-ffd3fc7be5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:04:27.567423 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a25ed67-a952-42f5-abf3-bed7752bb8a1 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:27.572714 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7336d62-9323-499d-bb0e-8468ca54650e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:27.573376 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 56/111] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:04:27 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:04:27.574058 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7336d62-9323-499d-bb0e-8468ca54650e admin admin] REQUEST_METHOD: `PUT` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:27.574583 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7336d62-9323-499d-bb0e-8468ca54650e admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:27.574701 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a74a4c0-47c3-4dbd-bc74-8d0297d6f67e None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:27.574985 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a74a4c0-47c3-4dbd-bc74-8d0297d6f67e None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:27.575258 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a74a4c0-47c3-4dbd-bc74-8d0297d6f67e None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:27.575494 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7336d62-9323-499d-bb0e-8468ca54650e admin admin] PATH_INFO: `/v3/projects/1065667c5e62410e8db95ee2e1b98135/users/31651079c8d04df8a5fb70d40851475c/roles/6c54f239944d46e3b027ccce97eb8b49` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:27.577004 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 57/112] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:04:27 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:04:27.577930 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7336d62-9323-499d-bb0e-8468ca54650e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1065667c5e62410e8db95ee2e1b98135, user_id=31651079c8d04df8a5fb70d40851475c, role_id=6c54f239944d46e3b027ccce97eb8b49)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:27.580969 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7336d62-9323-499d-bb0e-8468ca54650e admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:27.582795 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce2bdb-2d4c-425a-a24f-2c85f70f70ca None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:27.583076 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce2bdb-2d4c-425a-a24f-2c85f70f70ca None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:27.583403 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce2bdb-2d4c-425a-a24f-2c85f70f70ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:27.612990 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-a2ce2bdb-2d4c-425a-a24f-2c85f70f70ca None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:04:27.614230 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-a2ce2bdb-2d4c-425a-a24f-2c85f70f70ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:04:27.622891 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 58/113] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:04:27 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:04:27.623565 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ce2bdb-2d4c-425a-a24f-2c85f70f70ca None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:27.634061 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ce2bdb-2d4c-425a-a24f-2c85f70f70ca None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:27.638446 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157688cd-568a-420e-8498-bf93216e1fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:27.639368 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157688cd-568a-420e-8498-bf93216e1fde admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:27.639658 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157688cd-568a-420e-8498-bf93216e1fde admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:27.639934 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157688cd-568a-420e-8498-bf93216e1fde admin admin] PATH_INFO: `/v3/roles/member` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:27.651804 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157688cd-568a-420e-8498-bf93216e1fde admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 18:04:27.659068 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-157688cd-568a-420e-8498-bf93216e1fde admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 18:04:27.660345 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 59/114] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Oct 12 18:04:27 2021] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:04:27.661647 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d276f5ac-0fe3-44b3-9e9d-539c080faf20 None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:27.661931 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d276f5ac-0fe3-44b3-9e9d-539c080faf20 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:27.662204 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d276f5ac-0fe3-44b3-9e9d-539c080faf20 None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:27.663909 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 60/115] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:04:27 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:04:27.666117 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d276f5ac-0fe3-44b3-9e9d-539c080faf20 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:27.677397 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d276f5ac-0fe3-44b3-9e9d-539c080faf20 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:27.682511 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8566ae79-a94c-494c-9b00-92ad93bd2f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:27.683870 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8566ae79-a94c-494c-9b00-92ad93bd2f8c admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:27.683870 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8566ae79-a94c-494c-9b00-92ad93bd2f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:27.683870 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8566ae79-a94c-494c-9b00-92ad93bd2f8c admin admin] PATH_INFO: `/v3/domains/default` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:27.684987 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8566ae79-a94c-494c-9b00-92ad93bd2f8c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:27.686832 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8566ae79-a94c-494c-9b00-92ad93bd2f8c admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:27.688487 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 61/116] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:04:27 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:27.693767 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8566ae79-a94c-494c-9b00-92ad93bd2f8c admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:27.695069 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 56/117] 10.222.0.18 () {58 vars in 1460 bytes} [Tue Oct 12 18:04:27 2021] PUT /identity/v3/projects/1065667c5e62410e8db95ee2e1b98135/users/31651079c8d04df8a5fb70d40851475c/roles/6c54f239944d46e3b027ccce97eb8b49 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 18:04:27.696778 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e3032-2790-40bf-acd8-54d5f72f8d38 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:27.697151 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e3032-2790-40bf-acd8-54d5f72f8d38 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:27.697508 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e3032-2790-40bf-acd8-54d5f72f8d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:27.705829 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8566ae79-a94c-494c-9b00-92ad93bd2f8c admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:27.717879 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-164e3032-2790-40bf-acd8-54d5f72f8d38 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:04:27.719823 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-164e3032-2790-40bf-acd8-54d5f72f8d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:04:27.777950 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd2a673-a6d9-40b4-8c47-261f3cc3495b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:27.778770 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd2a673-a6d9-40b4-8c47-261f3cc3495b admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:27.779128 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd2a673-a6d9-40b4-8c47-261f3cc3495b admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:27.779415 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd2a673-a6d9-40b4-8c47-261f3cc3495b admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:27.780220 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd2a673-a6d9-40b4-8c47-261f3cc3495b admin admin] RBAC: Adding query filter params (name=member) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:27.780577 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd2a673-a6d9-40b4-8c47-261f3cc3495b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:27.782356 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd2a673-a6d9-40b4-8c47-261f3cc3495b admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:27.793128 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 62/118] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Oct 12 18:04:27 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:27.793899 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd2a673-a6d9-40b4-8c47-261f3cc3495b admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:27.799053 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 57/119] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:04:27 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:04:27.800631 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e3032-2790-40bf-acd8-54d5f72f8d38 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:27.810328 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd2a673-a6d9-40b4-8c47-261f3cc3495b admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:27.819190 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb41567-2289-4300-9c56-cebc1fd2bf3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:27.822270 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e3032-2790-40bf-acd8-54d5f72f8d38 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:27.822574 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb41567-2289-4300-9c56-cebc1fd2bf3c admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:27.822954 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb41567-2289-4300-9c56-cebc1fd2bf3c admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:27.823271 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb41567-2289-4300-9c56-cebc1fd2bf3c admin admin] PATH_INFO: `/v3/users` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:27.824065 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb41567-2289-4300-9c56-cebc1fd2bf3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:27.826140 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING py.warnings [None req-7eb41567-2289-4300-9c56-cebc1fd2bf3c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:04:27.826140 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: warnings.warn(msg) Oct 12 18:04:27.826140 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: Oct 12 18:04:27.827870 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb41567-2289-4300-9c56-cebc1fd2bf3c admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:27.832026 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53d1372-1e7d-410d-8ad8-970fd3c89668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:27.833382 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d1372-1e7d-410d-8ad8-970fd3c89668 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:27.833888 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d1372-1e7d-410d-8ad8-970fd3c89668 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:27.834371 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d1372-1e7d-410d-8ad8-970fd3c89668 admin admin] PATH_INFO: `/v3/users/f7cf3b0b3886414d8205a6258403e8e2` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:27.836702 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53d1372-1e7d-410d-8ad8-970fd3c89668 admin admin] RBAC: Authorizing `identity:get_user(user_id=f7cf3b0b3886414d8205a6258403e8e2)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:27.840113 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53d1372-1e7d-410d-8ad8-970fd3c89668 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:27.842601 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 58/120] 10.222.0.18 () {56 vars in 1198 bytes} [Tue Oct 12 18:04:27 2021] GET /identity/v3/users/f7cf3b0b3886414d8205a6258403e8e2 => generated 275 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:27.843687 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53d1372-1e7d-410d-8ad8-970fd3c89668 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:27.854496 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53d1372-1e7d-410d-8ad8-970fd3c89668 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:27.859210 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e272ab7-bda5-4e93-ad23-d4a9b72e033d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:27.860047 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e272ab7-bda5-4e93-ad23-d4a9b72e033d admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:27.861238 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e272ab7-bda5-4e93-ad23-d4a9b72e033d admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:27.861238 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e272ab7-bda5-4e93-ad23-d4a9b72e033d admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:27.872518 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e272ab7-bda5-4e93-ad23-d4a9b72e033d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 18:04:27.880246 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-9e272ab7-bda5-4e93-ad23-d4a9b72e033d admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 18:04:27.881819 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 59/121] 10.222.0.18 () {56 vars in 1135 bytes} [Tue Oct 12 18:04:27 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:04:27.884609 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e272ab7-bda5-4e93-ad23-d4a9b72e033d admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:27.895446 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e272ab7-bda5-4e93-ad23-d4a9b72e033d admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:27.900737 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce183275-aad1-445b-b422-a41b3c1bd3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:27.901669 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce183275-aad1-445b-b422-a41b3c1bd3dd admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:27.901961 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce183275-aad1-445b-b422-a41b3c1bd3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:27.902232 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce183275-aad1-445b-b422-a41b3c1bd3dd admin admin] PATH_INFO: `/v3/projects/93e289af362942d0b18d319165d0e31e` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:27.903512 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce183275-aad1-445b-b422-a41b3c1bd3dd admin admin] RBAC: Authorizing `identity:get_project(project_id=93e289af362942d0b18d319165d0e31e)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:27.905701 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce183275-aad1-445b-b422-a41b3c1bd3dd admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:27.907628 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 60/122] 10.222.0.18 () {56 vars in 1207 bytes} [Tue Oct 12 18:04:27 2021] GET /identity/v3/projects/93e289af362942d0b18d319165d0e31e => generated 312 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:27.908233 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce183275-aad1-445b-b422-a41b3c1bd3dd admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:27.918490 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce183275-aad1-445b-b422-a41b3c1bd3dd admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:27.924233 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b93707-c165-4ed7-b395-844270c7bca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:27.925016 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b93707-c165-4ed7-b395-844270c7bca4 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:27.925304 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b93707-c165-4ed7-b395-844270c7bca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:27.925583 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b93707-c165-4ed7-b395-844270c7bca4 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:27.926041 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 63/123] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Oct 12 18:04:27 2021] POST /identity/v3/users => generated 283 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:04:27.926420 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b93707-c165-4ed7-b395-844270c7bca4 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:27.926731 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b93707-c165-4ed7-b395-844270c7bca4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:27.927627 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb41567-2289-4300-9c56-cebc1fd2bf3c admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:27.928921 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b93707-c165-4ed7-b395-844270c7bca4 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:27.939477 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 61/124] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Oct 12 18:04:27 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:27.941578 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb41567-2289-4300-9c56-cebc1fd2bf3c admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:27.946553 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b93707-c165-4ed7-b395-844270c7bca4 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:27.947946 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd101e67-560f-4cc4-941e-5cc432ebb1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:27.949175 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd101e67-560f-4cc4-941e-5cc432ebb1b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:27.949660 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd101e67-560f-4cc4-941e-5cc432ebb1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:27.950142 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd101e67-560f-4cc4-941e-5cc432ebb1b4 admin admin] PATH_INFO: `/v3/projects/93e289af362942d0b18d319165d0e31e/users/f7cf3b0b3886414d8205a6258403e8e2/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:27.952756 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd101e67-560f-4cc4-941e-5cc432ebb1b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93e289af362942d0b18d319165d0e31e, user_id=f7cf3b0b3886414d8205a6258403e8e2, role_id=33b8a5a8d1d643f2a98f598e6ab0a1cf)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:27.957138 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b93707-c165-4ed7-b395-844270c7bca4 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:27.959271 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd101e67-560f-4cc4-941e-5cc432ebb1b4 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:27.962610 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe138ee-4d7f-4280-a584-27669c81cf4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:27.963898 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe138ee-4d7f-4280-a584-27669c81cf4e admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:27.964191 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe138ee-4d7f-4280-a584-27669c81cf4e admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:27.964513 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe138ee-4d7f-4280-a584-27669c81cf4e admin admin] PATH_INFO: `/v3/users/f7cf3b0b3886414d8205a6258403e8e2` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:27.966279 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe138ee-4d7f-4280-a584-27669c81cf4e admin admin] RBAC: Authorizing `identity:get_user(user_id=f7cf3b0b3886414d8205a6258403e8e2)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:27.969175 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe138ee-4d7f-4280-a584-27669c81cf4e admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:27.970734 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 62/125] 10.222.0.18 () {56 vars in 1198 bytes} [Tue Oct 12 18:04:27 2021] GET /identity/v3/users/f7cf3b0b3886414d8205a6258403e8e2 => generated 275 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:04:27.977325 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe138ee-4d7f-4280-a584-27669c81cf4e admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:27.990667 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe138ee-4d7f-4280-a584-27669c81cf4e admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:27.995152 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2d041e-6082-4b34-aab6-67fe77f78c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:27.996025 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d041e-6082-4b34-aab6-67fe77f78c43 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:27.996312 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d041e-6082-4b34-aab6-67fe77f78c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:27.996633 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d041e-6082-4b34-aab6-67fe77f78c43 admin admin] PATH_INFO: `/v3/projects/1065667c5e62410e8db95ee2e1b98135` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:27.997896 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2d041e-6082-4b34-aab6-67fe77f78c43 admin admin] RBAC: Authorizing `identity:get_project(project_id=1065667c5e62410e8db95ee2e1b98135)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:28.000044 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2d041e-6082-4b34-aab6-67fe77f78c43 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:28.002152 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 63/126] 10.222.0.18 () {56 vars in 1207 bytes} [Tue Oct 12 18:04:27 2021] GET /identity/v3/projects/1065667c5e62410e8db95ee2e1b98135 => generated 298 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:04:28.009187 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2d041e-6082-4b34-aab6-67fe77f78c43 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:28.021781 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 64/127] 10.222.0.18 () {58 vars in 1460 bytes} [Tue Oct 12 18:04:27 2021] PUT /identity/v3/projects/93e289af362942d0b18d319165d0e31e/users/f7cf3b0b3886414d8205a6258403e8e2/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:04:28.024019 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2d041e-6082-4b34-aab6-67fe77f78c43 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:28.105122 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b29c0-e9f8-445c-8f8a-570ccac7b788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:28.106821 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b29c0-e9f8-445c-8f8a-570ccac7b788 admin admin] REQUEST_METHOD: `PUT` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:28.107309 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b29c0-e9f8-445c-8f8a-570ccac7b788 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:28.107788 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b29c0-e9f8-445c-8f8a-570ccac7b788 admin admin] PATH_INFO: `/v3/projects/1065667c5e62410e8db95ee2e1b98135/users/f7cf3b0b3886414d8205a6258403e8e2/roles/17c81d2cd8f34ad49f4c495ecb2d982e` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:28.110830 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20b29c0-e9f8-445c-8f8a-570ccac7b788 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1065667c5e62410e8db95ee2e1b98135, user_id=f7cf3b0b3886414d8205a6258403e8e2, role_id=17c81d2cd8f34ad49f4c495ecb2d982e)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:28.113990 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20b29c0-e9f8-445c-8f8a-570ccac7b788 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:28.197845 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 64/128] 10.222.0.18 () {58 vars in 1460 bytes} [Tue Oct 12 18:04:28 2021] PUT /identity/v3/projects/1065667c5e62410e8db95ee2e1b98135/users/f7cf3b0b3886414d8205a6258403e8e2/roles/17c81d2cd8f34ad49f4c495ecb2d982e => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 18:04:30.415638 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de4ede-0f77-4b49-8ea2-ee3ba15c31ed None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:30.416182 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de4ede-0f77-4b49-8ea2-ee3ba15c31ed None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:30.416182 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de4ede-0f77-4b49-8ea2-ee3ba15c31ed None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:30.418351 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 65/129] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:04:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:04:30.424113 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36a083-ee53-4fab-8b21-ed3657b67d69 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:30.425095 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36a083-ee53-4fab-8b21-ed3657b67d69 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:30.425589 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36a083-ee53-4fab-8b21-ed3657b67d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:30.452434 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-9f36a083-ee53-4fab-8b21-ed3657b67d69 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:04:30.454053 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-9f36a083-ee53-4fab-8b21-ed3657b67d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:04:30.534124 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 65/130] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:04:30 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:04:30.573856 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8de4ede-0f77-4b49-8ea2-ee3ba15c31ed None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:30.594208 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8de4ede-0f77-4b49-8ea2-ee3ba15c31ed None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:30.605296 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482c985b-5e86-4071-8243-b2a394166e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:30.606129 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c985b-5e86-4071-8243-b2a394166e99 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:30.606416 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c985b-5e86-4071-8243-b2a394166e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:30.606694 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c985b-5e86-4071-8243-b2a394166e99 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:30.619584 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482c985b-5e86-4071-8243-b2a394166e99 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 18:04:30.626637 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-482c985b-5e86-4071-8243-b2a394166e99 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 18:04:30.632851 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 66/131] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Oct 12 18:04:30 2021] GET /identity/v3/roles/admin => generated 83 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:04:30.639339 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f36a083-ee53-4fab-8b21-ed3657b67d69 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:30.653697 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f36a083-ee53-4fab-8b21-ed3657b67d69 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:30.664176 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58beeca1-b7a6-4008-a9d8-5188b4b65306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:30.665197 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58beeca1-b7a6-4008-a9d8-5188b4b65306 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:30.665743 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58beeca1-b7a6-4008-a9d8-5188b4b65306 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:30.666225 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58beeca1-b7a6-4008-a9d8-5188b4b65306 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:30.667215 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58beeca1-b7a6-4008-a9d8-5188b4b65306 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:30.667718 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58beeca1-b7a6-4008-a9d8-5188b4b65306 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:30.669571 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58beeca1-b7a6-4008-a9d8-5188b4b65306 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:30.684386 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 66/132] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Oct 12 18:04:30 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:30.690874 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482c985b-5e86-4071-8243-b2a394166e99 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:30.701479 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482c985b-5e86-4071-8243-b2a394166e99 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:30.713147 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4dc959-e21a-4120-a26e-35dace4c7c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:30.714042 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4dc959-e21a-4120-a26e-35dace4c7c07 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:30.714328 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4dc959-e21a-4120-a26e-35dace4c7c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:30.714609 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4dc959-e21a-4120-a26e-35dace4c7c07 admin admin] PATH_INFO: `/v3/users/31651079c8d04df8a5fb70d40851475c` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:30.721460 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4dc959-e21a-4120-a26e-35dace4c7c07 admin admin] RBAC: Authorizing `identity:get_user(user_id=31651079c8d04df8a5fb70d40851475c)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:30.723354 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4dc959-e21a-4120-a26e-35dace4c7c07 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:30.725128 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 67/133] 10.222.0.18 () {56 vars in 1198 bytes} [Tue Oct 12 18:04:30 2021] GET /identity/v3/users/31651079c8d04df8a5fb70d40851475c => generated 247 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:30.731888 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58beeca1-b7a6-4008-a9d8-5188b4b65306 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:30.746033 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58beeca1-b7a6-4008-a9d8-5188b4b65306 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:30.755348 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d01cd-e1df-4e43-a29a-f80cff95c47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:30.756238 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d01cd-e1df-4e43-a29a-f80cff95c47c admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:30.756789 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d01cd-e1df-4e43-a29a-f80cff95c47c admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:30.757292 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d01cd-e1df-4e43-a29a-f80cff95c47c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:30.773237 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860d01cd-e1df-4e43-a29a-f80cff95c47c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:30.775398 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860d01cd-e1df-4e43-a29a-f80cff95c47c admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:30.790525 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 67/134] 10.222.0.18 () {58 vars in 1324 bytes} [Tue Oct 12 18:04:30 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:04:30.797012 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4dc959-e21a-4120-a26e-35dace4c7c07 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:30.809634 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4dc959-e21a-4120-a26e-35dace4c7c07 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:30.821109 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d8609-e3e6-4a05-a4de-0e4bff93e3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:30.821982 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d8609-e3e6-4a05-a4de-0e4bff93e3d4 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:30.822270 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d8609-e3e6-4a05-a4de-0e4bff93e3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:30.822550 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d8609-e3e6-4a05-a4de-0e4bff93e3d4 admin admin] PATH_INFO: `/v3/projects/1065667c5e62410e8db95ee2e1b98135` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:30.829179 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5d8609-e3e6-4a05-a4de-0e4bff93e3d4 admin admin] RBAC: Authorizing `identity:get_project(project_id=1065667c5e62410e8db95ee2e1b98135)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:30.831309 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5d8609-e3e6-4a05-a4de-0e4bff93e3d4 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:30.833066 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 68/135] 10.222.0.18 () {56 vars in 1207 bytes} [Tue Oct 12 18:04:30 2021] GET /identity/v3/projects/1065667c5e62410e8db95ee2e1b98135 => generated 298 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:30.840122 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d01cd-e1df-4e43-a29a-f80cff95c47c admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:30.853297 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d01cd-e1df-4e43-a29a-f80cff95c47c admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:30.863305 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eca4a2-29c5-44c8-ab8e-18cb6856ff06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:30.864197 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eca4a2-29c5-44c8-ab8e-18cb6856ff06 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:30.864726 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eca4a2-29c5-44c8-ab8e-18cb6856ff06 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:30.865202 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eca4a2-29c5-44c8-ab8e-18cb6856ff06 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:30.866293 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eca4a2-29c5-44c8-ab8e-18cb6856ff06 admin admin] RBAC: Adding query filter params (role.id=6c54f239944d46e3b027ccce97eb8b49, scope.project.id=1065667c5e62410e8db95ee2e1b98135, user.id=31651079c8d04df8a5fb70d40851475c) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:30.866820 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eca4a2-29c5-44c8-ab8e-18cb6856ff06 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:30.868920 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eca4a2-29c5-44c8-ab8e-18cb6856ff06 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:30.878996 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 68/136] 10.222.0.18 () {56 vars in 1395 bytes} [Tue Oct 12 18:04:30 2021] GET /identity/v3/role_assignments?user.id=31651079c8d04df8a5fb70d40851475c&scope.project.id=1065667c5e62410e8db95ee2e1b98135&role.id=6c54f239944d46e3b027ccce97eb8b49 => generated 608 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:30.983096 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef38324-f0d7-4253-920b-d96941f27137 None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:30.983394 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef38324-f0d7-4253-920b-d96941f27137 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:30.983584 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef38324-f0d7-4253-920b-d96941f27137 None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:30.985670 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 69/137] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:04:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:04:31.003379 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6efbea3-ab88-44a0-b31f-d7df7379df4c None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:31.004230 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6efbea3-ab88-44a0-b31f-d7df7379df4c None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:31.004732 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6efbea3-ab88-44a0-b31f-d7df7379df4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:31.033654 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-e6efbea3-ab88-44a0-b31f-d7df7379df4c None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:04:31.034938 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3226160-fb87-4f92-b873-0f7d552db4eb None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:31.035228 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3226160-fb87-4f92-b873-0f7d552db4eb None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:31.035509 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3226160-fb87-4f92-b873-0f7d552db4eb None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:31.035846 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-e6efbea3-ab88-44a0-b31f-d7df7379df4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:04:31.037318 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 70/138] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:04:31 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 18:04:31.043742 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3631ef7e-9f55-4db0-b6d8-578c7b7e2193 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:31.044035 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3631ef7e-9f55-4db0-b6d8-578c7b7e2193 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:31.044324 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3631ef7e-9f55-4db0-b6d8-578c7b7e2193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:31.045859 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 69/139] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:04:31 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:04:31.073793 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-3631ef7e-9f55-4db0-b6d8-578c7b7e2193 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:04:31.075031 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-3631ef7e-9f55-4db0-b6d8-578c7b7e2193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:04:31.087365 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 71/140] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:04:31 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Oct 12 18:04:31.088234 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6efbea3-ab88-44a0-b31f-d7df7379df4c None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:31.102075 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6efbea3-ab88-44a0-b31f-d7df7379df4c None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:31.110875 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd107101-50fc-4087-912c-c4472c56ada6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:31.112032 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd107101-50fc-4087-912c-c4472c56ada6 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:31.112545 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd107101-50fc-4087-912c-c4472c56ada6 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:31.113019 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd107101-50fc-4087-912c-c4472c56ada6 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:31.123873 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3631ef7e-9f55-4db0-b6d8-578c7b7e2193 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:31.131255 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd107101-50fc-4087-912c-c4472c56ada6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 18:04:31.137683 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3631ef7e-9f55-4db0-b6d8-578c7b7e2193 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:31.142823 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-cd107101-50fc-4087-912c-c4472c56ada6 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 18:04:31.144270 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 70/141] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Oct 12 18:04:31 2021] GET /identity/v3/roles/member => generated 84 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:04:31.151526 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd107101-50fc-4087-912c-c4472c56ada6 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:31.153582 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7638f69e-3ee1-4a87-b833-4db0beabafef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:31.154393 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638f69e-3ee1-4a87-b833-4db0beabafef admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:31.154676 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638f69e-3ee1-4a87-b833-4db0beabafef admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:31.154952 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638f69e-3ee1-4a87-b833-4db0beabafef admin admin] PATH_INFO: `/v3/roles/member` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:31.166033 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd107101-50fc-4087-912c-c4472c56ada6 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:31.174404 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7dfac8-8211-4347-a042-2d450b276daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:31.175349 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7dfac8-8211-4347-a042-2d450b276daa admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:31.175836 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7dfac8-8211-4347-a042-2d450b276daa admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:31.176329 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7dfac8-8211-4347-a042-2d450b276daa admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:31.176667 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7638f69e-3ee1-4a87-b833-4db0beabafef admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 18:04:31.177553 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7dfac8-8211-4347-a042-2d450b276daa admin admin] RBAC: Adding query filter params (name=member) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:31.178058 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7dfac8-8211-4347-a042-2d450b276daa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:31.185431 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7dfac8-8211-4347-a042-2d450b276daa admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:31.193856 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-7638f69e-3ee1-4a87-b833-4db0beabafef admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 18:04:31.195659 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 72/142] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Oct 12 18:04:31 2021] GET /identity/v3/roles/member => generated 84 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 18:04:31.197112 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 71/143] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Oct 12 18:04:31 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:04:31.202293 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7638f69e-3ee1-4a87-b833-4db0beabafef admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:31.203788 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7dfac8-8211-4347-a042-2d450b276daa admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:31.214045 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7dfac8-8211-4347-a042-2d450b276daa admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:31.218377 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7638f69e-3ee1-4a87-b833-4db0beabafef admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:31.227329 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38687bfc-76bf-4df9-867f-92136a3a3b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:31.228641 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38687bfc-76bf-4df9-867f-92136a3a3b4f admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:31.229130 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38687bfc-76bf-4df9-867f-92136a3a3b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:31.229607 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38687bfc-76bf-4df9-867f-92136a3a3b4f admin admin] PATH_INFO: `/v3/users/f7cf3b0b3886414d8205a6258403e8e2` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:31.233163 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16604693-2e52-46ce-954d-7faa20b1b514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:31.233785 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16604693-2e52-46ce-954d-7faa20b1b514 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:31.234080 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16604693-2e52-46ce-954d-7faa20b1b514 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:31.234365 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16604693-2e52-46ce-954d-7faa20b1b514 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:31.234792 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38687bfc-76bf-4df9-867f-92136a3a3b4f admin admin] RBAC: Authorizing `identity:get_user(user_id=f7cf3b0b3886414d8205a6258403e8e2)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:31.235146 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16604693-2e52-46ce-954d-7faa20b1b514 admin admin] RBAC: Adding query filter params (name=member) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:31.235454 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16604693-2e52-46ce-954d-7faa20b1b514 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:31.237110 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16604693-2e52-46ce-954d-7faa20b1b514 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:31.237925 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38687bfc-76bf-4df9-867f-92136a3a3b4f admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:31.239882 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 72/144] 10.222.0.18 () {56 vars in 1198 bytes} [Tue Oct 12 18:04:31 2021] GET /identity/v3/users/f7cf3b0b3886414d8205a6258403e8e2 => generated 275 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:04:31.246655 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38687bfc-76bf-4df9-867f-92136a3a3b4f admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:31.247727 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 73/145] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Oct 12 18:04:31 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:31.253846 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16604693-2e52-46ce-954d-7faa20b1b514 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:31.258762 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38687bfc-76bf-4df9-867f-92136a3a3b4f admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:31.266258 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16604693-2e52-46ce-954d-7faa20b1b514 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:31.272081 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a916b-1bdb-4ec7-8dae-dad44c1e0d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:31.273778 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a916b-1bdb-4ec7-8dae-dad44c1e0d5c admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:31.274366 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a916b-1bdb-4ec7-8dae-dad44c1e0d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:31.274840 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a916b-1bdb-4ec7-8dae-dad44c1e0d5c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:31.282065 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e6b588-74f3-4ffc-8d24-f59a1434635f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:31.282894 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e6b588-74f3-4ffc-8d24-f59a1434635f admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:31.283181 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e6b588-74f3-4ffc-8d24-f59a1434635f admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:31.283460 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e6b588-74f3-4ffc-8d24-f59a1434635f admin admin] PATH_INFO: `/v3/users/f7cf3b0b3886414d8205a6258403e8e2` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:31.285018 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1a916b-1bdb-4ec7-8dae-dad44c1e0d5c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:31.287026 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1a916b-1bdb-4ec7-8dae-dad44c1e0d5c admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:31.289145 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e6b588-74f3-4ffc-8d24-f59a1434635f admin admin] RBAC: Authorizing `identity:get_user(user_id=f7cf3b0b3886414d8205a6258403e8e2)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:31.291372 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e6b588-74f3-4ffc-8d24-f59a1434635f admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:31.296425 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 74/146] 10.222.0.18 () {56 vars in 1198 bytes} [Tue Oct 12 18:04:31 2021] GET /identity/v3/users/f7cf3b0b3886414d8205a6258403e8e2 => generated 275 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:31.299127 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e6b588-74f3-4ffc-8d24-f59a1434635f admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:31.301989 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 73/147] 10.222.0.18 () {58 vars in 1324 bytes} [Tue Oct 12 18:04:31 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 18:04:31.309234 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a916b-1bdb-4ec7-8dae-dad44c1e0d5c admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:31.314010 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e6b588-74f3-4ffc-8d24-f59a1434635f admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:31.318413 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a916b-1bdb-4ec7-8dae-dad44c1e0d5c admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:31.328423 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0182b0c1-0aa1-47c1-8fbb-d0f145d2cfa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:31.329307 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182b0c1-0aa1-47c1-8fbb-d0f145d2cfa1 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:31.329596 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182b0c1-0aa1-47c1-8fbb-d0f145d2cfa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:31.329870 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182b0c1-0aa1-47c1-8fbb-d0f145d2cfa1 admin admin] PATH_INFO: `/v3/projects/1065667c5e62410e8db95ee2e1b98135` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:31.331117 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0182b0c1-0aa1-47c1-8fbb-d0f145d2cfa1 admin admin] RBAC: Authorizing `identity:get_project(project_id=1065667c5e62410e8db95ee2e1b98135)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:31.337650 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0182b0c1-0aa1-47c1-8fbb-d0f145d2cfa1 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:31.339828 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 74/148] 10.222.0.18 () {56 vars in 1207 bytes} [Tue Oct 12 18:04:31 2021] GET /identity/v3/projects/1065667c5e62410e8db95ee2e1b98135 => generated 298 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:04:31.341108 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99605054-1781-4fb9-9e61-fb09955e1826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:31.341784 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99605054-1781-4fb9-9e61-fb09955e1826 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:31.342077 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99605054-1781-4fb9-9e61-fb09955e1826 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:31.342360 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99605054-1781-4fb9-9e61-fb09955e1826 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:31.347016 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0182b0c1-0aa1-47c1-8fbb-d0f145d2cfa1 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:31.351409 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99605054-1781-4fb9-9e61-fb09955e1826 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:31.353258 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99605054-1781-4fb9-9e61-fb09955e1826 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:31.361871 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0182b0c1-0aa1-47c1-8fbb-d0f145d2cfa1 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:31.372764 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 75/149] 10.222.0.18 () {58 vars in 1324 bytes} [Tue Oct 12 18:04:31 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:04:31.374399 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40198d81-c116-404e-9f8a-488686c1f150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:31.375067 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40198d81-c116-404e-9f8a-488686c1f150 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:31.375346 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40198d81-c116-404e-9f8a-488686c1f150 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:31.375618 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40198d81-c116-404e-9f8a-488686c1f150 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:31.376493 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40198d81-c116-404e-9f8a-488686c1f150 admin admin] RBAC: Adding query filter params (role.id=33b8a5a8d1d643f2a98f598e6ab0a1cf, scope.project.id=1065667c5e62410e8db95ee2e1b98135, user.id=f7cf3b0b3886414d8205a6258403e8e2) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:31.376805 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40198d81-c116-404e-9f8a-488686c1f150 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:31.378780 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40198d81-c116-404e-9f8a-488686c1f150 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:31.378981 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99605054-1781-4fb9-9e61-fb09955e1826 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:31.388336 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99605054-1781-4fb9-9e61-fb09955e1826 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:31.389205 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 75/150] 10.222.0.18 () {56 vars in 1395 bytes} [Tue Oct 12 18:04:31 2021] GET /identity/v3/role_assignments?user.id=f7cf3b0b3886414d8205a6258403e8e2&scope.project.id=1065667c5e62410e8db95ee2e1b98135&role.id=33b8a5a8d1d643f2a98f598e6ab0a1cf => generated 608 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:04:31.403344 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e78bc4d-2d3a-493a-84ea-5b659bf1e84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:31.404236 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78bc4d-2d3a-493a-84ea-5b659bf1e84b admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:31.404585 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78bc4d-2d3a-493a-84ea-5b659bf1e84b admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:31.404870 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78bc4d-2d3a-493a-84ea-5b659bf1e84b admin admin] PATH_INFO: `/v3/projects/93e289af362942d0b18d319165d0e31e` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:31.409315 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e78bc4d-2d3a-493a-84ea-5b659bf1e84b admin admin] RBAC: Authorizing `identity:get_project(project_id=93e289af362942d0b18d319165d0e31e)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:31.411487 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e78bc4d-2d3a-493a-84ea-5b659bf1e84b admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:31.413627 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 76/151] 10.222.0.18 () {56 vars in 1207 bytes} [Tue Oct 12 18:04:31 2021] GET /identity/v3/projects/93e289af362942d0b18d319165d0e31e => generated 312 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:04:31.420192 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40198d81-c116-404e-9f8a-488686c1f150 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:31.434299 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40198d81-c116-404e-9f8a-488686c1f150 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:31.440513 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fde9e6-37d7-417f-bd5d-9f3797140cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:31.441192 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fde9e6-37d7-417f-bd5d-9f3797140cf9 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:31.441472 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fde9e6-37d7-417f-bd5d-9f3797140cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:31.441745 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fde9e6-37d7-417f-bd5d-9f3797140cf9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:31.442595 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fde9e6-37d7-417f-bd5d-9f3797140cf9 admin admin] RBAC: Adding query filter params (role.id=33b8a5a8d1d643f2a98f598e6ab0a1cf, scope.project.id=93e289af362942d0b18d319165d0e31e, user.id=f7cf3b0b3886414d8205a6258403e8e2) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:31.442902 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fde9e6-37d7-417f-bd5d-9f3797140cf9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:31.445411 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fde9e6-37d7-417f-bd5d-9f3797140cf9 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:31.458236 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 76/152] 10.222.0.18 () {56 vars in 1395 bytes} [Tue Oct 12 18:04:31 2021] GET /identity/v3/role_assignments?user.id=f7cf3b0b3886414d8205a6258403e8e2&scope.project.id=93e289af362942d0b18d319165d0e31e&role.id=33b8a5a8d1d643f2a98f598e6ab0a1cf => generated 608 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:32.135276 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ff601-47b6-4af0-b638-af99d1db2ad5 None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:32.135992 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ff601-47b6-4af0-b638-af99d1db2ad5 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:32.135992 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ff601-47b6-4af0-b638-af99d1db2ad5 None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:32.137634 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 77/153] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:04:32 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:04:32.144285 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6572226d-edcf-4342-b987-097a36646527 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:32.144591 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6572226d-edcf-4342-b987-097a36646527 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:32.144860 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6572226d-edcf-4342-b987-097a36646527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:32.165646 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-6572226d-edcf-4342-b987-097a36646527 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:04:32.166853 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-6572226d-edcf-4342-b987-097a36646527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:04:32.179519 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 77/154] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:04:32 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:04:32.227609 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084ff601-47b6-4af0-b638-af99d1db2ad5 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:32.245971 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084ff601-47b6-4af0-b638-af99d1db2ad5 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:32.250562 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ef9303-ad1e-4c9d-8994-5604861f08cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:32.251372 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ef9303-ad1e-4c9d-8994-5604861f08cd admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:32.251658 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ef9303-ad1e-4c9d-8994-5604861f08cd admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:32.251934 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ef9303-ad1e-4c9d-8994-5604861f08cd admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:32.275343 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ef9303-ad1e-4c9d-8994-5604861f08cd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 18:04:32.283066 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-d9ef9303-ad1e-4c9d-8994-5604861f08cd admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 18:04:32.284562 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 78/155] 10.222.0.18 () {56 vars in 1135 bytes} [Tue Oct 12 18:04:32 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:04:32.291213 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6572226d-edcf-4342-b987-097a36646527 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:32.304141 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6572226d-edcf-4342-b987-097a36646527 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:32.312764 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304e1da7-a1bd-4697-ba99-46d11736a7ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:32.313447 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e1da7-a1bd-4697-ba99-46d11736a7ef admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:32.313724 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e1da7-a1bd-4697-ba99-46d11736a7ef admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:32.313997 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e1da7-a1bd-4697-ba99-46d11736a7ef admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:32.314765 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304e1da7-a1bd-4697-ba99-46d11736a7ef admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:32.315080 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304e1da7-a1bd-4697-ba99-46d11736a7ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:32.316931 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304e1da7-a1bd-4697-ba99-46d11736a7ef admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:32.332051 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 78/156] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Oct 12 18:04:32 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:32.338415 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ef9303-ad1e-4c9d-8994-5604861f08cd admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:32.348922 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ef9303-ad1e-4c9d-8994-5604861f08cd admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:32.360147 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c27597-002d-44c6-8ba8-36404786dc40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:32.361038 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c27597-002d-44c6-8ba8-36404786dc40 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:32.361325 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c27597-002d-44c6-8ba8-36404786dc40 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:32.361604 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c27597-002d-44c6-8ba8-36404786dc40 admin admin] PATH_INFO: `/v3/users/f7cf3b0b3886414d8205a6258403e8e2` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:32.365146 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c27597-002d-44c6-8ba8-36404786dc40 admin admin] RBAC: Authorizing `identity:get_user(user_id=f7cf3b0b3886414d8205a6258403e8e2)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:32.367402 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c27597-002d-44c6-8ba8-36404786dc40 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:32.369374 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 79/157] 10.222.0.18 () {56 vars in 1198 bytes} [Tue Oct 12 18:04:32 2021] GET /identity/v3/users/f7cf3b0b3886414d8205a6258403e8e2 => generated 275 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:32.375202 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304e1da7-a1bd-4697-ba99-46d11736a7ef admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:32.387883 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304e1da7-a1bd-4697-ba99-46d11736a7ef admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:32.396337 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9bef3b-fd40-4c64-908d-598c26afb9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:32.397006 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9bef3b-fd40-4c64-908d-598c26afb9d1 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:32.397303 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9bef3b-fd40-4c64-908d-598c26afb9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:32.397612 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9bef3b-fd40-4c64-908d-598c26afb9d1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:32.412079 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9bef3b-fd40-4c64-908d-598c26afb9d1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:32.414421 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9bef3b-fd40-4c64-908d-598c26afb9d1 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:32.429748 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 79/158] 10.222.0.18 () {58 vars in 1324 bytes} [Tue Oct 12 18:04:32 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:04:32.436038 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c27597-002d-44c6-8ba8-36404786dc40 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:32.450105 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c27597-002d-44c6-8ba8-36404786dc40 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:32.450922 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e24f512-8987-4808-85ad-f40167275c4e None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:32.451341 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e24f512-8987-4808-85ad-f40167275c4e None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:32.451518 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e24f512-8987-4808-85ad-f40167275c4e None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:32.453386 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 80/159] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:04:32 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 18:04:32.459113 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e628df2-6725-4ad4-977c-78f4156136b8 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:32.459412 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e628df2-6725-4ad4-977c-78f4156136b8 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:32.459682 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e628df2-6725-4ad4-977c-78f4156136b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:32.461525 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686f5802-df35-4e7d-aff3-f5493ed75799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:32.462381 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f5802-df35-4e7d-aff3-f5493ed75799 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:32.462659 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f5802-df35-4e7d-aff3-f5493ed75799 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:32.462931 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f5802-df35-4e7d-aff3-f5493ed75799 admin admin] PATH_INFO: `/v3/projects/1065667c5e62410e8db95ee2e1b98135` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:32.467271 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686f5802-df35-4e7d-aff3-f5493ed75799 admin admin] RBAC: Authorizing `identity:get_project(project_id=1065667c5e62410e8db95ee2e1b98135)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:32.469379 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686f5802-df35-4e7d-aff3-f5493ed75799 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:32.471213 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 80/160] 10.222.0.18 () {56 vars in 1207 bytes} [Tue Oct 12 18:04:32 2021] GET /identity/v3/projects/1065667c5e62410e8db95ee2e1b98135 => generated 298 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:32.480171 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686f5802-df35-4e7d-aff3-f5493ed75799 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:32.496351 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-1e628df2-6725-4ad4-977c-78f4156136b8 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:04:32.497540 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-1e628df2-6725-4ad4-977c-78f4156136b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:04:32.501300 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686f5802-df35-4e7d-aff3-f5493ed75799 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:32.509586 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a849c03-948c-4c2f-90c9-d579227c4f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:32.510229 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a849c03-948c-4c2f-90c9-d579227c4f3e admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:32.510509 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a849c03-948c-4c2f-90c9-d579227c4f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:32.510783 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a849c03-948c-4c2f-90c9-d579227c4f3e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:32.511612 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a849c03-948c-4c2f-90c9-d579227c4f3e admin admin] RBAC: Adding query filter params (role.id=17c81d2cd8f34ad49f4c495ecb2d982e, scope.project.id=1065667c5e62410e8db95ee2e1b98135, user.id=f7cf3b0b3886414d8205a6258403e8e2) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:32.511920 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a849c03-948c-4c2f-90c9-d579227c4f3e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:32.513789 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a849c03-948c-4c2f-90c9-d579227c4f3e admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:32.517791 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 81/161] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:04:32 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:04:32.522189 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 81/162] 10.222.0.18 () {56 vars in 1395 bytes} [Tue Oct 12 18:04:32 2021] GET /identity/v3/role_assignments?user.id=f7cf3b0b3886414d8205a6258403e8e2&scope.project.id=1065667c5e62410e8db95ee2e1b98135&role.id=17c81d2cd8f34ad49f4c495ecb2d982e => generated 608 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:04:32.555529 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e628df2-6725-4ad4-977c-78f4156136b8 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:32.564615 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e628df2-6725-4ad4-977c-78f4156136b8 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:32.572984 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed51585-4264-4541-9e93-cd915e325a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:32.573789 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed51585-4264-4541-9e93-cd915e325a4a admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:32.574066 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed51585-4264-4541-9e93-cd915e325a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:32.574339 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed51585-4264-4541-9e93-cd915e325a4a admin admin] PATH_INFO: `/v3/roles/member` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:32.593506 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed51585-4264-4541-9e93-cd915e325a4a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 18:04:32.601080 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-3ed51585-4264-4541-9e93-cd915e325a4a admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 18:04:32.602313 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 82/163] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Oct 12 18:04:32 2021] GET /identity/v3/roles/member => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:04:32.608989 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a849c03-948c-4c2f-90c9-d579227c4f3e admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:32.633819 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a849c03-948c-4c2f-90c9-d579227c4f3e admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:32.643257 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36468d5e-405b-43a1-8b5d-e7dd2705a91d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:32.643866 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36468d5e-405b-43a1-8b5d-e7dd2705a91d admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:32.644147 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36468d5e-405b-43a1-8b5d-e7dd2705a91d admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:32.644464 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36468d5e-405b-43a1-8b5d-e7dd2705a91d admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:32.645229 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36468d5e-405b-43a1-8b5d-e7dd2705a91d admin admin] RBAC: Adding query filter params (name=member) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:32.645528 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36468d5e-405b-43a1-8b5d-e7dd2705a91d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:32.647116 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36468d5e-405b-43a1-8b5d-e7dd2705a91d admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:32.660263 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 82/164] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Oct 12 18:04:32 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:04:32.667248 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed51585-4264-4541-9e93-cd915e325a4a admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:32.682074 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed51585-4264-4541-9e93-cd915e325a4a admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:32.686543 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f1b9bb-56a9-4102-85ca-24a78b032892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:32.687406 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1b9bb-56a9-4102-85ca-24a78b032892 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:32.687682 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1b9bb-56a9-4102-85ca-24a78b032892 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:32.687944 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1b9bb-56a9-4102-85ca-24a78b032892 admin admin] PATH_INFO: `/v3/users/b8f935bd2a784b8d8c0b396f1556b5f5` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:32.706817 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f1b9bb-56a9-4102-85ca-24a78b032892 admin admin] RBAC: Authorizing `identity:get_user(user_id=b8f935bd2a784b8d8c0b396f1556b5f5)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:32.709049 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f1b9bb-56a9-4102-85ca-24a78b032892 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:32.711591 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 83/165] 10.222.0.18 () {56 vars in 1198 bytes} [Tue Oct 12 18:04:32 2021] GET /identity/v3/users/b8f935bd2a784b8d8c0b396f1556b5f5 => generated 283 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:32.717996 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36468d5e-405b-43a1-8b5d-e7dd2705a91d admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:32.733822 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36468d5e-405b-43a1-8b5d-e7dd2705a91d admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:32.738398 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acae096b-1934-4ad7-a88a-1f50474a6c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:32.739054 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acae096b-1934-4ad7-a88a-1f50474a6c13 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:32.739336 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acae096b-1934-4ad7-a88a-1f50474a6c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:32.739609 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acae096b-1934-4ad7-a88a-1f50474a6c13 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:32.748983 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acae096b-1934-4ad7-a88a-1f50474a6c13 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:32.750898 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acae096b-1934-4ad7-a88a-1f50474a6c13 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:32.765062 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 83/166] 10.222.0.18 () {58 vars in 1324 bytes} [Tue Oct 12 18:04:32 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:04:32.771721 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f1b9bb-56a9-4102-85ca-24a78b032892 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:32.784606 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f1b9bb-56a9-4102-85ca-24a78b032892 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:32.789822 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3e77be-6789-43a4-ab4e-58511f67e1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:32.790750 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e77be-6789-43a4-ab4e-58511f67e1be admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:32.791024 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e77be-6789-43a4-ab4e-58511f67e1be admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:32.791350 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e77be-6789-43a4-ab4e-58511f67e1be admin admin] PATH_INFO: `/v3/projects/d8f9072509b7489eba91457dfb47e439` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:32.792691 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3e77be-6789-43a4-ab4e-58511f67e1be admin admin] RBAC: Authorizing `identity:get_project(project_id=d8f9072509b7489eba91457dfb47e439)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:32.794980 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3e77be-6789-43a4-ab4e-58511f67e1be admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:32.796879 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 84/167] 10.222.0.18 () {56 vars in 1207 bytes} [Tue Oct 12 18:04:32 2021] GET /identity/v3/projects/d8f9072509b7489eba91457dfb47e439 => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:32.803495 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acae096b-1934-4ad7-a88a-1f50474a6c13 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:32.814569 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acae096b-1934-4ad7-a88a-1f50474a6c13 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:32.821623 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57800f26-f338-4a5c-8616-c0eed9c91ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:32.822335 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57800f26-f338-4a5c-8616-c0eed9c91ecc admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:32.822661 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57800f26-f338-4a5c-8616-c0eed9c91ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:32.822933 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57800f26-f338-4a5c-8616-c0eed9c91ecc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:32.823843 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57800f26-f338-4a5c-8616-c0eed9c91ecc admin admin] RBAC: Adding query filter params (role.id=33b8a5a8d1d643f2a98f598e6ab0a1cf, scope.project.id=d8f9072509b7489eba91457dfb47e439, user.id=b8f935bd2a784b8d8c0b396f1556b5f5) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:32.824154 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57800f26-f338-4a5c-8616-c0eed9c91ecc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:32.826183 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57800f26-f338-4a5c-8616-c0eed9c91ecc admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:32.837730 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 84/168] 10.222.0.18 () {56 vars in 1395 bytes} [Tue Oct 12 18:04:32 2021] GET /identity/v3/role_assignments?user.id=b8f935bd2a784b8d8c0b396f1556b5f5&scope.project.id=d8f9072509b7489eba91457dfb47e439&role.id=33b8a5a8d1d643f2a98f598e6ab0a1cf => generated 259 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:33.254361 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2085a9d3-7ac5-40c8-b277-2a72aed7a0dc None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:33.254763 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2085a9d3-7ac5-40c8-b277-2a72aed7a0dc None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:33.255022 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2085a9d3-7ac5-40c8-b277-2a72aed7a0dc None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:33.257352 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 85/169] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:04:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:04:33.263620 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc0df5-2f95-4d0b-a2cc-6734ca95fdd5 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:33.264169 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc0df5-2f95-4d0b-a2cc-6734ca95fdd5 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:33.264169 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc0df5-2f95-4d0b-a2cc-6734ca95fdd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:33.268918 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75edc533-afff-4810-a906-22fc5a06815e None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:33.268918 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75edc533-afff-4810-a906-22fc5a06815e None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:33.268918 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75edc533-afff-4810-a906-22fc5a06815e None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:33.268918 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 86/170] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:04:33 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 18:04:33.277777 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dea765-9aa9-482b-8408-497cffb52e10 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:33.277777 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dea765-9aa9-482b-8408-497cffb52e10 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:33.277777 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dea765-9aa9-482b-8408-497cffb52e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:33.286194 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-80bc0df5-2f95-4d0b-a2cc-6734ca95fdd5 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:04:33.287664 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-80bc0df5-2f95-4d0b-a2cc-6734ca95fdd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:04:33.296962 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 85/171] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:04:33 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:04:33.298282 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-b2dea765-9aa9-482b-8408-497cffb52e10 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:04:33.299733 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-b2dea765-9aa9-482b-8408-497cffb52e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:04:33.308443 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 87/172] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:04:33 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:04:33.323597 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bc0df5-2f95-4d0b-a2cc-6734ca95fdd5 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:33.333078 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bc0df5-2f95-4d0b-a2cc-6734ca95fdd5 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:33.333863 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dea765-9aa9-482b-8408-497cffb52e10 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:33.338186 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e72533-bcfd-4234-bdec-029a5879bab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:33.338979 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e72533-bcfd-4234-bdec-029a5879bab3 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:33.339263 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e72533-bcfd-4234-bdec-029a5879bab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:33.339539 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e72533-bcfd-4234-bdec-029a5879bab3 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:33.344498 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dea765-9aa9-482b-8408-497cffb52e10 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:33.349316 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945169fe-b9f8-404d-8b3c-8aeec93e48e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:33.350347 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945169fe-b9f8-404d-8b3c-8aeec93e48e1 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:33.351340 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945169fe-b9f8-404d-8b3c-8aeec93e48e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:33.351755 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e72533-bcfd-4234-bdec-029a5879bab3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 18:04:33.352031 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945169fe-b9f8-404d-8b3c-8aeec93e48e1 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:33.358699 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-73e72533-bcfd-4234-bdec-029a5879bab3 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 18:04:33.359898 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 86/173] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Oct 12 18:04:33 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:04:33.363051 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945169fe-b9f8-404d-8b3c-8aeec93e48e1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 18:04:33.366187 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e72533-bcfd-4234-bdec-029a5879bab3 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:33.371457 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-945169fe-b9f8-404d-8b3c-8aeec93e48e1 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 18:04:33.372909 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 88/174] 10.222.0.18 () {56 vars in 1135 bytes} [Tue Oct 12 18:04:33 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 18:04:33.376131 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e72533-bcfd-4234-bdec-029a5879bab3 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:33.382582 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945169fe-b9f8-404d-8b3c-8aeec93e48e1 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:33.383409 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5e4112-b5e8-48cb-9856-2c0429b40011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:33.384117 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5e4112-b5e8-48cb-9856-2c0429b40011 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:33.384430 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5e4112-b5e8-48cb-9856-2c0429b40011 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:33.384716 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5e4112-b5e8-48cb-9856-2c0429b40011 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:33.385534 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5e4112-b5e8-48cb-9856-2c0429b40011 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:33.385897 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5e4112-b5e8-48cb-9856-2c0429b40011 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:33.387529 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5e4112-b5e8-48cb-9856-2c0429b40011 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:33.395533 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945169fe-b9f8-404d-8b3c-8aeec93e48e1 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:33.397949 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 87/175] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Oct 12 18:04:33 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:04:33.401987 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be536ec3-a9d1-41b1-ab50-5bb4c0c889f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:33.402994 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be536ec3-a9d1-41b1-ab50-5bb4c0c889f2 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:33.403441 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be536ec3-a9d1-41b1-ab50-5bb4c0c889f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:33.403855 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be536ec3-a9d1-41b1-ab50-5bb4c0c889f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:33.404223 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5e4112-b5e8-48cb-9856-2c0429b40011 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:33.405007 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be536ec3-a9d1-41b1-ab50-5bb4c0c889f2 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:33.405452 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be536ec3-a9d1-41b1-ab50-5bb4c0c889f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:33.407207 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be536ec3-a9d1-41b1-ab50-5bb4c0c889f2 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:33.414388 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5e4112-b5e8-48cb-9856-2c0429b40011 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:33.417892 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 89/176] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Oct 12 18:04:33 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:04:33.423529 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8af1f7-9ba2-4e28-9602-421bc3fc4527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:33.424150 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be536ec3-a9d1-41b1-ab50-5bb4c0c889f2 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:33.424620 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8af1f7-9ba2-4e28-9602-421bc3fc4527 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:33.425002 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8af1f7-9ba2-4e28-9602-421bc3fc4527 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:33.425382 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8af1f7-9ba2-4e28-9602-421bc3fc4527 admin admin] PATH_INFO: `/v3/users/31651079c8d04df8a5fb70d40851475c` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:33.426716 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8af1f7-9ba2-4e28-9602-421bc3fc4527 admin admin] RBAC: Authorizing `identity:get_user(user_id=31651079c8d04df8a5fb70d40851475c)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:33.429252 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8af1f7-9ba2-4e28-9602-421bc3fc4527 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:33.431071 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 88/177] 10.222.0.18 () {56 vars in 1198 bytes} [Tue Oct 12 18:04:33 2021] GET /identity/v3/users/31651079c8d04df8a5fb70d40851475c => generated 247 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:33.435818 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be536ec3-a9d1-41b1-ab50-5bb4c0c889f2 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:33.437072 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8af1f7-9ba2-4e28-9602-421bc3fc4527 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:33.441063 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11567244-5c53-4896-8d43-55950ec18234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:33.441925 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11567244-5c53-4896-8d43-55950ec18234 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:33.442179 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11567244-5c53-4896-8d43-55950ec18234 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:33.442446 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11567244-5c53-4896-8d43-55950ec18234 admin admin] PATH_INFO: `/v3/users/b8f935bd2a784b8d8c0b396f1556b5f5` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:33.443643 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11567244-5c53-4896-8d43-55950ec18234 admin admin] RBAC: Authorizing `identity:get_user(user_id=b8f935bd2a784b8d8c0b396f1556b5f5)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:33.446379 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11567244-5c53-4896-8d43-55950ec18234 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:33.447046 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8af1f7-9ba2-4e28-9602-421bc3fc4527 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:33.448080 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 90/178] 10.222.0.18 () {56 vars in 1198 bytes} [Tue Oct 12 18:04:33 2021] GET /identity/v3/users/b8f935bd2a784b8d8c0b396f1556b5f5 => generated 283 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:04:33.449098 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d569e-4820-4964-9fe7-02ae1f90744e None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:33.449378 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d569e-4820-4964-9fe7-02ae1f90744e None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:33.449649 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d569e-4820-4964-9fe7-02ae1f90744e None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:33.451355 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 91/179] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:04:33 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:04:33.451913 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fae3e2a-2463-46f6-8af1-ee78a80c3713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:33.453136 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae3e2a-2463-46f6-8af1-ee78a80c3713 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:33.453136 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae3e2a-2463-46f6-8af1-ee78a80c3713 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:33.453136 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae3e2a-2463-46f6-8af1-ee78a80c3713 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:33.456966 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4d569e-4820-4964-9fe7-02ae1f90744e None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:33.461095 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fae3e2a-2463-46f6-8af1-ee78a80c3713 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:33.462843 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fae3e2a-2463-46f6-8af1-ee78a80c3713 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:33.468627 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4d569e-4820-4964-9fe7-02ae1f90744e None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:33.472286 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 89/180] 10.222.0.18 () {58 vars in 1324 bytes} [Tue Oct 12 18:04:33 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 18:04:33.473208 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6739d75c-57f5-4038-8989-59cd9822923a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:33.473841 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6739d75c-57f5-4038-8989-59cd9822923a admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:33.474125 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6739d75c-57f5-4038-8989-59cd9822923a admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:33.474397 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6739d75c-57f5-4038-8989-59cd9822923a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:33.477704 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049603a-d517-4a23-8df3-c9ba6f9f2d4c None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:33.502898 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049603a-d517-4a23-8df3-c9ba6f9f2d4c None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:33.502898 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049603a-d517-4a23-8df3-c9ba6f9f2d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:33.503096 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6739d75c-57f5-4038-8989-59cd9822923a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:33.503096 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6739d75c-57f5-4038-8989-59cd9822923a admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:33.503244 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-9049603a-d517-4a23-8df3-c9ba6f9f2d4c None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:04:33.503244 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-9049603a-d517-4a23-8df3-c9ba6f9f2d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:04:33.503401 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 92/181] 10.222.0.18 () {58 vars in 1324 bytes} [Tue Oct 12 18:04:33 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 18:04:33.503401 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6739d75c-57f5-4038-8989-59cd9822923a admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:33.512582 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 90/182] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:04:33 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:04:33.512582 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9049603a-d517-4a23-8df3-c9ba6f9f2d4c None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:33.517397 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6739d75c-57f5-4038-8989-59cd9822923a admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:33.518696 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9049603a-d517-4a23-8df3-c9ba6f9f2d4c None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:33.522097 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a4e3bc-4246-4f92-bbec-cba763d6474d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:33.523451 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4e3bc-4246-4f92-bbec-cba763d6474d admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:33.523831 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4e3bc-4246-4f92-bbec-cba763d6474d admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:33.524110 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4e3bc-4246-4f92-bbec-cba763d6474d admin admin] PATH_INFO: `/v3/projects/d8f9072509b7489eba91457dfb47e439` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:33.524320 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc370e04-ca30-45f5-b98b-fa3250fb57ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:33.525330 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a4e3bc-4246-4f92-bbec-cba763d6474d admin admin] RBAC: Authorizing `identity:get_project(project_id=d8f9072509b7489eba91457dfb47e439)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:33.525437 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc370e04-ca30-45f5-b98b-fa3250fb57ef admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:33.525768 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc370e04-ca30-45f5-b98b-fa3250fb57ef admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:33.526198 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc370e04-ca30-45f5-b98b-fa3250fb57ef admin admin] PATH_INFO: `/v3/projects/d8f9072509b7489eba91457dfb47e439` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:33.527503 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a4e3bc-4246-4f92-bbec-cba763d6474d admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:33.527620 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc370e04-ca30-45f5-b98b-fa3250fb57ef admin admin] RBAC: Authorizing `identity:get_project(project_id=d8f9072509b7489eba91457dfb47e439)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:33.529891 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc370e04-ca30-45f5-b98b-fa3250fb57ef admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:33.531776 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 91/183] 10.222.0.18 () {56 vars in 1207 bytes} [Tue Oct 12 18:04:33 2021] GET /identity/v3/projects/d8f9072509b7489eba91457dfb47e439 => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:33.534669 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 93/184] 10.222.0.18 () {56 vars in 1207 bytes} [Tue Oct 12 18:04:33 2021] GET /identity/v3/projects/d8f9072509b7489eba91457dfb47e439 => generated 302 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:33.537316 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a4e3bc-4246-4f92-bbec-cba763d6474d admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:33.537511 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc370e04-ca30-45f5-b98b-fa3250fb57ef admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:33.547002 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a4e3bc-4246-4f92-bbec-cba763d6474d admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:33.547129 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc370e04-ca30-45f5-b98b-fa3250fb57ef admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:33.551438 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ace282-bd95-4c15-a4fe-8ed2f758423e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:33.551556 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1a3058-8021-4a86-8cd7-3de644043889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:33.552066 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ace282-bd95-4c15-a4fe-8ed2f758423e admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:33.552240 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1a3058-8021-4a86-8cd7-3de644043889 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:33.552332 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ace282-bd95-4c15-a4fe-8ed2f758423e admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:33.552525 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1a3058-8021-4a86-8cd7-3de644043889 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:33.552678 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ace282-bd95-4c15-a4fe-8ed2f758423e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:33.552823 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1a3058-8021-4a86-8cd7-3de644043889 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:33.553464 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ace282-bd95-4c15-a4fe-8ed2f758423e admin admin] RBAC: Adding query filter params (role.id=6c54f239944d46e3b027ccce97eb8b49, scope.project.id=d8f9072509b7489eba91457dfb47e439, user.id=31651079c8d04df8a5fb70d40851475c) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:33.554304 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ace282-bd95-4c15-a4fe-8ed2f758423e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:33.554484 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1a3058-8021-4a86-8cd7-3de644043889 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:33.556245 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ace282-bd95-4c15-a4fe-8ed2f758423e admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:33.556346 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1a3058-8021-4a86-8cd7-3de644043889 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:33.558065 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 92/185] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:04:33 2021] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:33.561270 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1a3058-8021-4a86-8cd7-3de644043889 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:33.561804 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 94/186] 10.222.0.18 () {56 vars in 1395 bytes} [Tue Oct 12 18:04:33 2021] GET /identity/v3/role_assignments?user.id=31651079c8d04df8a5fb70d40851475c&scope.project.id=d8f9072509b7489eba91457dfb47e439&role.id=6c54f239944d46e3b027ccce97eb8b49 => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:33.564175 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ace282-bd95-4c15-a4fe-8ed2f758423e admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:33.571639 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1a3058-8021-4a86-8cd7-3de644043889 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:33.576543 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08186d1c-a7d9-4c82-9449-4c55da9a1864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:33.577211 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08186d1c-a7d9-4c82-9449-4c55da9a1864 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:33.577489 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08186d1c-a7d9-4c82-9449-4c55da9a1864 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:33.577763 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08186d1c-a7d9-4c82-9449-4c55da9a1864 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:33.578886 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08186d1c-a7d9-4c82-9449-4c55da9a1864 admin admin] RBAC: Adding query filter params (role.id=17c81d2cd8f34ad49f4c495ecb2d982e, scope.project.id=d8f9072509b7489eba91457dfb47e439, user.id=b8f935bd2a784b8d8c0b396f1556b5f5) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:33.579823 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08186d1c-a7d9-4c82-9449-4c55da9a1864 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:33.582401 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08186d1c-a7d9-4c82-9449-4c55da9a1864 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:33.583807 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ace282-bd95-4c15-a4fe-8ed2f758423e admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:33.590444 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a62e81-73a8-4dd8-b8d7-a5516dcec3b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:33.591481 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a62e81-73a8-4dd8-b8d7-a5516dcec3b5 admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:33.592000 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a62e81-73a8-4dd8-b8d7-a5516dcec3b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:33.592501 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a62e81-73a8-4dd8-b8d7-a5516dcec3b5 admin admin] PATH_INFO: `/v3/groups` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:33.593498 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a62e81-73a8-4dd8-b8d7-a5516dcec3b5 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:33.594744 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING py.warnings [None req-43a62e81-73a8-4dd8-b8d7-a5516dcec3b5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:04:33.594744 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: warnings.warn(msg) Oct 12 18:04:33.594744 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: Oct 12 18:04:33.596354 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a62e81-73a8-4dd8-b8d7-a5516dcec3b5 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:33.602940 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 93/187] 10.222.0.18 () {56 vars in 1395 bytes} [Tue Oct 12 18:04:33 2021] GET /identity/v3/role_assignments?user.id=b8f935bd2a784b8d8c0b396f1556b5f5&scope.project.id=d8f9072509b7489eba91457dfb47e439&role.id=17c81d2cd8f34ad49f4c495ecb2d982e => generated 259 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:33.730397 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 95/188] 10.222.0.18 () {60 vars in 1155 bytes} [Tue Oct 12 18:04:33 2021] POST /identity/v3/groups => generated 229 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 18:04:35.185837 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d8da3-ce31-4561-acba-75d4719d771b None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:35.186383 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d8da3-ce31-4561-acba-75d4719d771b None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:35.186383 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d8da3-ce31-4561-acba-75d4719d771b None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:35.188268 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 94/189] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:04:35 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:04:35.194800 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e0ae4a-7505-42d2-a260-9bc5739056c6 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:35.195579 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e0ae4a-7505-42d2-a260-9bc5739056c6 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:35.196093 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e0ae4a-7505-42d2-a260-9bc5739056c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:35.215645 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-d9e0ae4a-7505-42d2-a260-9bc5739056c6 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:04:35.217122 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-d9e0ae4a-7505-42d2-a260-9bc5739056c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:04:35.225210 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 96/190] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:04:35 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:04:35.249013 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12d8da3-ce31-4561-acba-75d4719d771b None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:35.262115 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12d8da3-ce31-4561-acba-75d4719d771b None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:35.267025 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cf41b1-4def-4aca-a21e-033f7f8b1ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:35.268036 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf41b1-4def-4aca-a21e-033f7f8b1ee5 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:35.268579 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf41b1-4def-4aca-a21e-033f7f8b1ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:35.269071 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf41b1-4def-4aca-a21e-033f7f8b1ee5 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:35.279705 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cf41b1-4def-4aca-a21e-033f7f8b1ee5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 18:04:35.286997 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-25cf41b1-4def-4aca-a21e-033f7f8b1ee5 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 18:04:35.288954 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 95/191] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Oct 12 18:04:35 2021] GET /identity/v3/roles/member => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:04:35.298753 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e0ae4a-7505-42d2-a260-9bc5739056c6 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:35.308051 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e0ae4a-7505-42d2-a260-9bc5739056c6 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:35.312865 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a76c647-02bf-4e79-810e-f16315181d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:35.313748 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a76c647-02bf-4e79-810e-f16315181d74 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:35.314249 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a76c647-02bf-4e79-810e-f16315181d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:35.314724 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a76c647-02bf-4e79-810e-f16315181d74 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:35.315685 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a76c647-02bf-4e79-810e-f16315181d74 admin admin] RBAC: Adding query filter params (name=member) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:35.316207 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a76c647-02bf-4e79-810e-f16315181d74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:35.318052 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a76c647-02bf-4e79-810e-f16315181d74 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:35.327765 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 97/192] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Oct 12 18:04:35 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:35.334154 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cf41b1-4def-4aca-a21e-033f7f8b1ee5 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:35.344632 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cf41b1-4def-4aca-a21e-033f7f8b1ee5 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:35.349378 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200765a9-ce25-4d97-8a1d-584bdfe5b287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:35.350985 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200765a9-ce25-4d97-8a1d-584bdfe5b287 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:35.351470 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200765a9-ce25-4d97-8a1d-584bdfe5b287 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:35.351955 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200765a9-ce25-4d97-8a1d-584bdfe5b287 admin admin] PATH_INFO: `/v3/users/b8f935bd2a784b8d8c0b396f1556b5f5` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:35.353398 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200765a9-ce25-4d97-8a1d-584bdfe5b287 admin admin] RBAC: Authorizing `identity:get_user(user_id=b8f935bd2a784b8d8c0b396f1556b5f5)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:35.355777 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200765a9-ce25-4d97-8a1d-584bdfe5b287 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:35.357602 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 96/193] 10.222.0.18 () {56 vars in 1198 bytes} [Tue Oct 12 18:04:35 2021] GET /identity/v3/users/b8f935bd2a784b8d8c0b396f1556b5f5 => generated 283 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:35.363757 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a76c647-02bf-4e79-810e-f16315181d74 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:35.373689 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a76c647-02bf-4e79-810e-f16315181d74 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:35.378388 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a07392-0971-4655-a5f8-1218a786ec6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:35.379497 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a07392-0971-4655-a5f8-1218a786ec6b admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:35.379981 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a07392-0971-4655-a5f8-1218a786ec6b admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:35.380496 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a07392-0971-4655-a5f8-1218a786ec6b admin admin] PATH_INFO: `/v3/projects/d8f9072509b7489eba91457dfb47e439` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:35.382437 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a07392-0971-4655-a5f8-1218a786ec6b admin admin] RBAC: Authorizing `identity:get_project(project_id=d8f9072509b7489eba91457dfb47e439)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:35.384728 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a07392-0971-4655-a5f8-1218a786ec6b admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:35.386923 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 98/194] 10.222.0.18 () {56 vars in 1207 bytes} [Tue Oct 12 18:04:35 2021] GET /identity/v3/projects/d8f9072509b7489eba91457dfb47e439 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:35.393091 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200765a9-ce25-4d97-8a1d-584bdfe5b287 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:35.402841 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200765a9-ce25-4d97-8a1d-584bdfe5b287 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:35.407347 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1cf668-d83d-46ad-bf72-94685c99664e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:35.408269 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1cf668-d83d-46ad-bf72-94685c99664e admin admin] REQUEST_METHOD: `PUT` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:35.408584 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1cf668-d83d-46ad-bf72-94685c99664e admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:35.408857 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1cf668-d83d-46ad-bf72-94685c99664e admin admin] PATH_INFO: `/v3/projects/d8f9072509b7489eba91457dfb47e439/users/b8f935bd2a784b8d8c0b396f1556b5f5/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:35.410813 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1cf668-d83d-46ad-bf72-94685c99664e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8f9072509b7489eba91457dfb47e439, user_id=b8f935bd2a784b8d8c0b396f1556b5f5, role_id=33b8a5a8d1d643f2a98f598e6ab0a1cf)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:35.414002 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1cf668-d83d-46ad-bf72-94685c99664e admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:35.501285 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 97/195] 10.222.0.18 () {58 vars in 1460 bytes} [Tue Oct 12 18:04:35 2021] PUT /identity/v3/projects/d8f9072509b7489eba91457dfb47e439/users/b8f935bd2a784b8d8c0b396f1556b5f5/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:04:35.883581 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b534fe-3a19-4bde-8507-2b7b778ce66b None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:35.884255 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b534fe-3a19-4bde-8507-2b7b778ce66b None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:35.884774 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b534fe-3a19-4bde-8507-2b7b778ce66b None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:35.887004 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 99/196] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:04:35 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:04:35.893558 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ef071-6cb9-4683-8d04-63121d712776 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:35.894103 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ef071-6cb9-4683-8d04-63121d712776 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:35.894584 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ef071-6cb9-4683-8d04-63121d712776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:35.897045 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30079a0-2606-4677-954c-4d8e25037448 None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:35.897373 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30079a0-2606-4677-954c-4d8e25037448 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:35.897652 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30079a0-2606-4677-954c-4d8e25037448 None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:35.899483 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 100/197] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:04:35 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 18:04:35.906108 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b2cfc9-c7bf-4dbd-ab6a-b5562c47dfa0 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:35.906625 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b2cfc9-c7bf-4dbd-ab6a-b5562c47dfa0 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:35.907051 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b2cfc9-c7bf-4dbd-ab6a-b5562c47dfa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:35.915764 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-218ef071-6cb9-4683-8d04-63121d712776 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:04:35.917219 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-218ef071-6cb9-4683-8d04-63121d712776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:04:35.926847 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-20b2cfc9-c7bf-4dbd-ab6a-b5562c47dfa0 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:04:35.928321 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-20b2cfc9-c7bf-4dbd-ab6a-b5562c47dfa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:04:35.986966 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 98/198] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:04:35 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:04:35.996674 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 101/199] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:04:35 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:04:36.011247 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218ef071-6cb9-4683-8d04-63121d712776 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:36.013443 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b2cfc9-c7bf-4dbd-ab6a-b5562c47dfa0 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:36.021525 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218ef071-6cb9-4683-8d04-63121d712776 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:36.023798 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b2cfc9-c7bf-4dbd-ab6a-b5562c47dfa0 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:36.026989 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278043d6-b4a8-4457-846e-4a57ef74eb23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:36.028057 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278043d6-b4a8-4457-846e-4a57ef74eb23 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:36.028515 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278043d6-b4a8-4457-846e-4a57ef74eb23 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:36.028725 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48111cc8-ee04-4a07-8a0c-2f205854b9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:36.029120 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278043d6-b4a8-4457-846e-4a57ef74eb23 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:36.029721 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48111cc8-ee04-4a07-8a0c-2f205854b9f9 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:36.030099 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48111cc8-ee04-4a07-8a0c-2f205854b9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:36.030479 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48111cc8-ee04-4a07-8a0c-2f205854b9f9 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:36.045010 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278043d6-b4a8-4457-846e-4a57ef74eb23 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 18:04:36.049013 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48111cc8-ee04-4a07-8a0c-2f205854b9f9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 18:04:36.052289 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-278043d6-b4a8-4457-846e-4a57ef74eb23 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 18:04:36.054217 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 99/200] 10.222.0.18 () {56 vars in 1135 bytes} [Tue Oct 12 18:04:36 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 18:04:36.055550 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c59e8-4f66-44b7-a2fb-a5db79d3c45b None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:36.055835 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c59e8-4f66-44b7-a2fb-a5db79d3c45b None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:36.056120 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c59e8-4f66-44b7-a2fb-a5db79d3c45b None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:36.057639 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-48111cc8-ee04-4a07-8a0c-2f205854b9f9 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 18:04:36.058062 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 100/201] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:04:36 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:04:36.059194 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 102/202] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Oct 12 18:04:36 2021] GET /identity/v3/roles/admin => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:04:36.061681 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4c59e8-4f66-44b7-a2fb-a5db79d3c45b None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:36.065759 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51320968-0e65-417b-9f15-d3ee919b049f None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:36.066041 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51320968-0e65-417b-9f15-d3ee919b049f None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:36.066315 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51320968-0e65-417b-9f15-d3ee919b049f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:36.077551 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4c59e8-4f66-44b7-a2fb-a5db79d3c45b None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:36.081896 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e924ad47-016e-4480-b96e-009b65cb88b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:36.082532 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924ad47-016e-4480-b96e-009b65cb88b3 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:36.086607 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924ad47-016e-4480-b96e-009b65cb88b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:36.086607 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924ad47-016e-4480-b96e-009b65cb88b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:36.086607 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e924ad47-016e-4480-b96e-009b65cb88b3 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:36.086607 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e924ad47-016e-4480-b96e-009b65cb88b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:36.086867 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-51320968-0e65-417b-9f15-d3ee919b049f None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:04:36.086945 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e924ad47-016e-4480-b96e-009b65cb88b3 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:36.087011 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-51320968-0e65-417b-9f15-d3ee919b049f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:04:36.096764 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 103/203] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:04:36 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:04:36.096889 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 101/204] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Oct 12 18:04:36 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:04:36.096965 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51320968-0e65-417b-9f15-d3ee919b049f None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:36.102579 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e924ad47-016e-4480-b96e-009b65cb88b3 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:36.109670 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51320968-0e65-417b-9f15-d3ee919b049f None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:36.111717 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e924ad47-016e-4480-b96e-009b65cb88b3 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:36.114466 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7818f7d0-5aa0-4ff3-98f6-002ea1522d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:36.115109 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7818f7d0-5aa0-4ff3-98f6-002ea1522d61 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:36.115442 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7818f7d0-5aa0-4ff3-98f6-002ea1522d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:36.115717 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7818f7d0-5aa0-4ff3-98f6-002ea1522d61 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:36.116786 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7818f7d0-5aa0-4ff3-98f6-002ea1522d61 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:36.117060 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294cd6db-ae68-4b44-a82c-bbf612b22da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:36.117397 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7818f7d0-5aa0-4ff3-98f6-002ea1522d61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:36.118225 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294cd6db-ae68-4b44-a82c-bbf612b22da3 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:36.118733 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294cd6db-ae68-4b44-a82c-bbf612b22da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:36.119149 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294cd6db-ae68-4b44-a82c-bbf612b22da3 admin admin] PATH_INFO: `/v3/users/b8f935bd2a784b8d8c0b396f1556b5f5` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:36.120128 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7818f7d0-5aa0-4ff3-98f6-002ea1522d61 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:36.121342 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294cd6db-ae68-4b44-a82c-bbf612b22da3 admin admin] RBAC: Authorizing `identity:get_user(user_id=b8f935bd2a784b8d8c0b396f1556b5f5)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:36.126581 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294cd6db-ae68-4b44-a82c-bbf612b22da3 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:36.127063 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 102/205] 10.222.0.18 () {56 vars in 1198 bytes} [Tue Oct 12 18:04:36 2021] GET /identity/v3/users/b8f935bd2a784b8d8c0b396f1556b5f5 => generated 283 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:04:36.127874 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294cd6db-ae68-4b44-a82c-bbf612b22da3 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:36.137356 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 104/206] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Oct 12 18:04:36 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:36.139303 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294cd6db-ae68-4b44-a82c-bbf612b22da3 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:36.144070 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7818f7d0-5aa0-4ff3-98f6-002ea1522d61 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:36.144658 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ecc0bf-3ef1-4eae-bba2-0865e0cb7dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:36.145454 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ecc0bf-3ef1-4eae-bba2-0865e0cb7dd6 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:36.145737 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ecc0bf-3ef1-4eae-bba2-0865e0cb7dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:36.146011 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ecc0bf-3ef1-4eae-bba2-0865e0cb7dd6 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:36.147245 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ecc0bf-3ef1-4eae-bba2-0865e0cb7dd6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:36.149480 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ecc0bf-3ef1-4eae-bba2-0865e0cb7dd6 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:36.151163 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 103/207] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:04:36 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:36.151912 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ecc0bf-3ef1-4eae-bba2-0865e0cb7dd6 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:36.156173 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7818f7d0-5aa0-4ff3-98f6-002ea1522d61 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:36.160600 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691b5e9a-984d-485e-b27d-8a4e64e75844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:36.161448 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b5e9a-984d-485e-b27d-8a4e64e75844 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:36.161732 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b5e9a-984d-485e-b27d-8a4e64e75844 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:36.162007 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b5e9a-984d-485e-b27d-8a4e64e75844 admin admin] PATH_INFO: `/v3/projects/d8f9072509b7489eba91457dfb47e439` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:36.163235 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691b5e9a-984d-485e-b27d-8a4e64e75844 admin admin] RBAC: Authorizing `identity:get_project(project_id=d8f9072509b7489eba91457dfb47e439)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:36.165340 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691b5e9a-984d-485e-b27d-8a4e64e75844 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:36.165695 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ecc0bf-3ef1-4eae-bba2-0865e0cb7dd6 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:36.167033 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 105/208] 10.222.0.18 () {56 vars in 1207 bytes} [Tue Oct 12 18:04:36 2021] GET /identity/v3/projects/d8f9072509b7489eba91457dfb47e439 => generated 302 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:36.167734 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691b5e9a-984d-485e-b27d-8a4e64e75844 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:36.175296 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaac951-755b-4fea-a431-207773bc9e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:36.176151 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaac951-755b-4fea-a431-207773bc9e7a admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:36.176463 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaac951-755b-4fea-a431-207773bc9e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:36.176808 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaac951-755b-4fea-a431-207773bc9e7a admin admin] PATH_INFO: `/v3/users/31651079c8d04df8a5fb70d40851475c` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:36.177050 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691b5e9a-984d-485e-b27d-8a4e64e75844 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:36.178014 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaac951-755b-4fea-a431-207773bc9e7a admin admin] RBAC: Authorizing `identity:get_user(user_id=31651079c8d04df8a5fb70d40851475c)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:36.179841 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaac951-755b-4fea-a431-207773bc9e7a admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:36.181361 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1e0d8d-dc50-4e86-912c-cb4fc008f525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:36.181483 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 104/209] 10.222.0.18 () {56 vars in 1198 bytes} [Tue Oct 12 18:04:36 2021] GET /identity/v3/users/31651079c8d04df8a5fb70d40851475c => generated 247 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:36.181970 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e0d8d-dc50-4e86-912c-cb4fc008f525 admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:36.182251 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e0d8d-dc50-4e86-912c-cb4fc008f525 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:36.182526 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e0d8d-dc50-4e86-912c-cb4fc008f525 admin admin] PATH_INFO: `/v3/groups` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:36.183201 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1e0d8d-dc50-4e86-912c-cb4fc008f525 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:36.185122 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1e0d8d-dc50-4e86-912c-cb4fc008f525 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:36.187030 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaac951-755b-4fea-a431-207773bc9e7a admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:36.197030 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaac951-755b-4fea-a431-207773bc9e7a admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:36.201338 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad10f5d-f257-418d-af5f-04eaa52c4ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:36.202233 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad10f5d-f257-418d-af5f-04eaa52c4ebc admin admin] REQUEST_METHOD: `PUT` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:36.202540 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad10f5d-f257-418d-af5f-04eaa52c4ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:36.202823 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad10f5d-f257-418d-af5f-04eaa52c4ebc admin admin] PATH_INFO: `/v3/projects/d8f9072509b7489eba91457dfb47e439/users/b8f935bd2a784b8d8c0b396f1556b5f5/roles/17c81d2cd8f34ad49f4c495ecb2d982e` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:36.206158 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad10f5d-f257-418d-af5f-04eaa52c4ebc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8f9072509b7489eba91457dfb47e439, user_id=b8f935bd2a784b8d8c0b396f1556b5f5, role_id=17c81d2cd8f34ad49f4c495ecb2d982e)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:36.207607 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad10f5d-f257-418d-af5f-04eaa52c4ebc admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:36.351422 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 106/210] 10.222.0.18 () {60 vars in 1155 bytes} [Tue Oct 12 18:04:36 2021] POST /identity/v3/groups => generated 226 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:04:36.359304 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1e0d8d-dc50-4e86-912c-cb4fc008f525 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:36.362312 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1e0d8d-dc50-4e86-912c-cb4fc008f525 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:36.367580 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977dd39c-eb89-4abd-a309-5365802e0d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:36.368490 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977dd39c-eb89-4abd-a309-5365802e0d9a admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:36.368778 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977dd39c-eb89-4abd-a309-5365802e0d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:36.369056 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977dd39c-eb89-4abd-a309-5365802e0d9a admin admin] PATH_INFO: `/v3/projects/d8f9072509b7489eba91457dfb47e439` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:36.370322 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977dd39c-eb89-4abd-a309-5365802e0d9a admin admin] RBAC: Authorizing `identity:get_project(project_id=d8f9072509b7489eba91457dfb47e439)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:36.372507 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977dd39c-eb89-4abd-a309-5365802e0d9a admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:36.374330 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 107/211] 10.222.0.18 () {56 vars in 1207 bytes} [Tue Oct 12 18:04:36 2021] GET /identity/v3/projects/d8f9072509b7489eba91457dfb47e439 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:36.381017 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977dd39c-eb89-4abd-a309-5365802e0d9a admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:36.398655 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977dd39c-eb89-4abd-a309-5365802e0d9a admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:36.398851 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 105/212] 10.222.0.18 () {58 vars in 1460 bytes} [Tue Oct 12 18:04:36 2021] PUT /identity/v3/projects/d8f9072509b7489eba91457dfb47e439/users/b8f935bd2a784b8d8c0b396f1556b5f5/roles/17c81d2cd8f34ad49f4c495ecb2d982e => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:04:36.462418 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c535f8-153c-407a-9c79-5087670ff895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:36.463335 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c535f8-153c-407a-9c79-5087670ff895 admin admin] REQUEST_METHOD: `PUT` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:36.463613 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c535f8-153c-407a-9c79-5087670ff895 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:36.463882 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c535f8-153c-407a-9c79-5087670ff895 admin admin] PATH_INFO: `/v3/projects/d8f9072509b7489eba91457dfb47e439/users/31651079c8d04df8a5fb70d40851475c/roles/6c54f239944d46e3b027ccce97eb8b49` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:36.466009 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c535f8-153c-407a-9c79-5087670ff895 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8f9072509b7489eba91457dfb47e439, user_id=31651079c8d04df8a5fb70d40851475c, role_id=6c54f239944d46e3b027ccce97eb8b49)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:36.468908 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c535f8-153c-407a-9c79-5087670ff895 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:36.533946 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 108/213] 10.222.0.18 () {58 vars in 1460 bytes} [Tue Oct 12 18:04:36 2021] PUT /identity/v3/projects/d8f9072509b7489eba91457dfb47e439/users/31651079c8d04df8a5fb70d40851475c/roles/6c54f239944d46e3b027ccce97eb8b49 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 18:04:37.869764 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed83e0ff-08ac-4579-b21d-2e2db6c5d1b2 None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:37.870318 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed83e0ff-08ac-4579-b21d-2e2db6c5d1b2 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:37.870318 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed83e0ff-08ac-4579-b21d-2e2db6c5d1b2 None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:37.872239 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 106/214] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:04:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:04:37.879109 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50aaf2-1484-40fd-8b4d-3fccbdba0d3d None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:37.879560 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50aaf2-1484-40fd-8b4d-3fccbdba0d3d None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:37.879636 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50aaf2-1484-40fd-8b4d-3fccbdba0d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:37.899939 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-3d50aaf2-1484-40fd-8b4d-3fccbdba0d3d None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:04:37.901189 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-3d50aaf2-1484-40fd-8b4d-3fccbdba0d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:04:37.968510 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 109/215] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:04:37 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:04:38.001036 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed83e0ff-08ac-4579-b21d-2e2db6c5d1b2 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:38.013425 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed83e0ff-08ac-4579-b21d-2e2db6c5d1b2 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:38.020361 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68babe99-21bb-4695-b0d5-551f96d36704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:38.021179 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68babe99-21bb-4695-b0d5-551f96d36704 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:38.021456 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68babe99-21bb-4695-b0d5-551f96d36704 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:38.021723 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68babe99-21bb-4695-b0d5-551f96d36704 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:38.034341 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68babe99-21bb-4695-b0d5-551f96d36704 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 18:04:38.041982 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-68babe99-21bb-4695-b0d5-551f96d36704 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 18:04:38.043410 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 107/216] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Oct 12 18:04:37 2021] GET /identity/v3/roles/member => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:04:38.049501 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d50aaf2-1484-40fd-8b4d-3fccbdba0d3d None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:38.059022 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d50aaf2-1484-40fd-8b4d-3fccbdba0d3d None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:38.068567 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182352a5-6a7a-4fbe-8e17-5fc43262f26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:38.069272 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182352a5-6a7a-4fbe-8e17-5fc43262f26e admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:38.069550 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182352a5-6a7a-4fbe-8e17-5fc43262f26e admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:38.069820 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182352a5-6a7a-4fbe-8e17-5fc43262f26e admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:38.070581 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182352a5-6a7a-4fbe-8e17-5fc43262f26e admin admin] RBAC: Adding query filter params (name=member) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:38.070881 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182352a5-6a7a-4fbe-8e17-5fc43262f26e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:38.072499 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182352a5-6a7a-4fbe-8e17-5fc43262f26e admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:38.084058 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 110/217] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Oct 12 18:04:38 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:38.092641 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68babe99-21bb-4695-b0d5-551f96d36704 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:38.105368 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68babe99-21bb-4695-b0d5-551f96d36704 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:38.110638 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37021c6-4b68-417f-a458-00d807ffbf24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:38.111579 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37021c6-4b68-417f-a458-00d807ffbf24 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:38.112071 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37021c6-4b68-417f-a458-00d807ffbf24 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:38.112588 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37021c6-4b68-417f-a458-00d807ffbf24 admin admin] PATH_INFO: `/v3/users/b8f935bd2a784b8d8c0b396f1556b5f5` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:38.117360 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37021c6-4b68-417f-a458-00d807ffbf24 admin admin] RBAC: Authorizing `identity:get_user(user_id=b8f935bd2a784b8d8c0b396f1556b5f5)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:38.119535 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37021c6-4b68-417f-a458-00d807ffbf24 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:38.121634 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 108/218] 10.222.0.18 () {56 vars in 1198 bytes} [Tue Oct 12 18:04:38 2021] GET /identity/v3/users/b8f935bd2a784b8d8c0b396f1556b5f5 => generated 283 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:38.127736 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182352a5-6a7a-4fbe-8e17-5fc43262f26e admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:38.138966 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182352a5-6a7a-4fbe-8e17-5fc43262f26e admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:38.143813 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc18eec9-f207-41cb-9f75-7734510b48b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:38.144488 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc18eec9-f207-41cb-9f75-7734510b48b1 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:38.144772 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc18eec9-f207-41cb-9f75-7734510b48b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:38.145042 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc18eec9-f207-41cb-9f75-7734510b48b1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:38.162921 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc18eec9-f207-41cb-9f75-7734510b48b1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:38.166369 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc18eec9-f207-41cb-9f75-7734510b48b1 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:38.183236 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 111/219] 10.222.0.18 () {58 vars in 1324 bytes} [Tue Oct 12 18:04:38 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:04:38.189354 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37021c6-4b68-417f-a458-00d807ffbf24 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:38.199618 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37021c6-4b68-417f-a458-00d807ffbf24 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:38.208533 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c988a67-0b5a-47af-83b4-87941133b0c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:38.209394 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c988a67-0b5a-47af-83b4-87941133b0c7 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:38.209719 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c988a67-0b5a-47af-83b4-87941133b0c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:38.209988 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c988a67-0b5a-47af-83b4-87941133b0c7 admin admin] PATH_INFO: `/v3/projects/d8f9072509b7489eba91457dfb47e439` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:38.211206 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c988a67-0b5a-47af-83b4-87941133b0c7 admin admin] RBAC: Authorizing `identity:get_project(project_id=d8f9072509b7489eba91457dfb47e439)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:38.213278 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c988a67-0b5a-47af-83b4-87941133b0c7 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:38.214949 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 109/220] 10.222.0.18 () {56 vars in 1207 bytes} [Tue Oct 12 18:04:38 2021] GET /identity/v3/projects/d8f9072509b7489eba91457dfb47e439 => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:38.221350 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc18eec9-f207-41cb-9f75-7734510b48b1 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:38.230333 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc18eec9-f207-41cb-9f75-7734510b48b1 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:38.240511 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765371e9-ae62-401d-b93f-c7d09eef0051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:38.241733 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765371e9-ae62-401d-b93f-c7d09eef0051 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:38.242010 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765371e9-ae62-401d-b93f-c7d09eef0051 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:38.242279 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765371e9-ae62-401d-b93f-c7d09eef0051 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:38.243129 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765371e9-ae62-401d-b93f-c7d09eef0051 admin admin] RBAC: Adding query filter params (role.id=33b8a5a8d1d643f2a98f598e6ab0a1cf, scope.project.id=d8f9072509b7489eba91457dfb47e439, user.id=b8f935bd2a784b8d8c0b396f1556b5f5) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:38.243498 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765371e9-ae62-401d-b93f-c7d09eef0051 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:38.245375 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765371e9-ae62-401d-b93f-c7d09eef0051 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:38.253254 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 112/221] 10.222.0.18 () {56 vars in 1395 bytes} [Tue Oct 12 18:04:38 2021] GET /identity/v3/role_assignments?user.id=b8f935bd2a784b8d8c0b396f1556b5f5&scope.project.id=d8f9072509b7489eba91457dfb47e439&role.id=33b8a5a8d1d643f2a98f598e6ab0a1cf => generated 608 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:39.399037 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c595f41-c36f-44e6-8448-0a178e5f1186 None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:39.399542 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c595f41-c36f-44e6-8448-0a178e5f1186 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:39.399616 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c595f41-c36f-44e6-8448-0a178e5f1186 None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:39.401649 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 110/222] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:04:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:04:39.407533 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a26d89d-c97e-4a1d-a659-6ed0d8b7e6e5 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:39.408077 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a26d89d-c97e-4a1d-a659-6ed0d8b7e6e5 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:39.408077 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a26d89d-c97e-4a1d-a659-6ed0d8b7e6e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:39.561645 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-3a26d89d-c97e-4a1d-a659-6ed0d8b7e6e5 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:04:39.562853 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-3a26d89d-c97e-4a1d-a659-6ed0d8b7e6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:04:39.575047 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 113/223] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:04:39 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:04:39.619794 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c595f41-c36f-44e6-8448-0a178e5f1186 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:39.632840 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c595f41-c36f-44e6-8448-0a178e5f1186 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:39.640443 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73bc723-ac04-4a5c-a56d-1c3a9a61cc74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:39.641503 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73bc723-ac04-4a5c-a56d-1c3a9a61cc74 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:39.641779 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73bc723-ac04-4a5c-a56d-1c3a9a61cc74 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:39.642047 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73bc723-ac04-4a5c-a56d-1c3a9a61cc74 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:39.659057 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73bc723-ac04-4a5c-a56d-1c3a9a61cc74 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 18:04:39.666931 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-c73bc723-ac04-4a5c-a56d-1c3a9a61cc74 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 18:04:39.668458 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 111/224] 10.222.0.18 () {56 vars in 1135 bytes} [Tue Oct 12 18:04:39 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:04:39.674769 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a26d89d-c97e-4a1d-a659-6ed0d8b7e6e5 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:39.683798 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a26d89d-c97e-4a1d-a659-6ed0d8b7e6e5 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:39.693987 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534a56a1-77f9-4841-b376-ce1edd7677d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:39.694664 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534a56a1-77f9-4841-b376-ce1edd7677d0 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:39.694942 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534a56a1-77f9-4841-b376-ce1edd7677d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:39.695214 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534a56a1-77f9-4841-b376-ce1edd7677d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:39.695977 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534a56a1-77f9-4841-b376-ce1edd7677d0 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:39.696279 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534a56a1-77f9-4841-b376-ce1edd7677d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:39.697926 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534a56a1-77f9-4841-b376-ce1edd7677d0 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:39.712821 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 114/225] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Oct 12 18:04:39 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:39.718834 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73bc723-ac04-4a5c-a56d-1c3a9a61cc74 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:39.729267 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73bc723-ac04-4a5c-a56d-1c3a9a61cc74 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:39.733838 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdefc1c5-0d8b-4e41-b529-077d3dca27a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:39.734704 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdefc1c5-0d8b-4e41-b529-077d3dca27a4 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:39.735068 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdefc1c5-0d8b-4e41-b529-077d3dca27a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:39.736704 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f585bbb8-b049-4ff2-ae13-5bd386e8630e None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:39.736987 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f585bbb8-b049-4ff2-ae13-5bd386e8630e None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:39.737252 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f585bbb8-b049-4ff2-ae13-5bd386e8630e None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:39.738146 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdefc1c5-0d8b-4e41-b529-077d3dca27a4 admin admin] PATH_INFO: `/v3/users/b8f935bd2a784b8d8c0b396f1556b5f5` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:39.739013 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 115/226] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:04:39 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 18:04:39.739575 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdefc1c5-0d8b-4e41-b529-077d3dca27a4 admin admin] RBAC: Authorizing `identity:get_user(user_id=b8f935bd2a784b8d8c0b396f1556b5f5)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:39.741912 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdefc1c5-0d8b-4e41-b529-077d3dca27a4 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:39.743554 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 112/227] 10.222.0.18 () {56 vars in 1198 bytes} [Tue Oct 12 18:04:39 2021] GET /identity/v3/users/b8f935bd2a784b8d8c0b396f1556b5f5 => generated 283 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:39.746325 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d189d2-90e3-48db-bb92-2188b279181a None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:39.746608 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d189d2-90e3-48db-bb92-2188b279181a None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:39.746886 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d189d2-90e3-48db-bb92-2188b279181a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:39.749852 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdefc1c5-0d8b-4e41-b529-077d3dca27a4 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:39.764544 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdefc1c5-0d8b-4e41-b529-077d3dca27a4 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:39.774391 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3101b8-0b81-48ba-bcfd-ca858bf32630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:39.775055 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3101b8-0b81-48ba-bcfd-ca858bf32630 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:39.775389 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3101b8-0b81-48ba-bcfd-ca858bf32630 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:39.775664 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3101b8-0b81-48ba-bcfd-ca858bf32630 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:39.781340 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-87d189d2-90e3-48db-bb92-2188b279181a None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:04:39.782544 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-87d189d2-90e3-48db-bb92-2188b279181a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:04:39.792696 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3101b8-0b81-48ba-bcfd-ca858bf32630 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:39.794529 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3101b8-0b81-48ba-bcfd-ca858bf32630 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:39.799039 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 116/228] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:04:39 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:04:39.809256 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 113/229] 10.222.0.18 () {58 vars in 1324 bytes} [Tue Oct 12 18:04:39 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:04:39.815701 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d189d2-90e3-48db-bb92-2188b279181a None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:39.829810 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d189d2-90e3-48db-bb92-2188b279181a None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:39.845117 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce2a33-dac2-4b8b-b0e4-fa24bd67d1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:39.845997 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce2a33-dac2-4b8b-b0e4-fa24bd67d1f6 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:39.846278 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce2a33-dac2-4b8b-b0e4-fa24bd67d1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:39.846552 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce2a33-dac2-4b8b-b0e4-fa24bd67d1f6 admin admin] PATH_INFO: `/v3/projects/d8f9072509b7489eba91457dfb47e439` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:39.847799 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ce2a33-dac2-4b8b-b0e4-fa24bd67d1f6 admin admin] RBAC: Authorizing `identity:get_project(project_id=d8f9072509b7489eba91457dfb47e439)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:39.849898 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ce2a33-dac2-4b8b-b0e4-fa24bd67d1f6 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:39.851940 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 117/230] 10.222.0.18 () {56 vars in 1207 bytes} [Tue Oct 12 18:04:39 2021] GET /identity/v3/projects/d8f9072509b7489eba91457dfb47e439 => generated 302 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:39.858348 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3101b8-0b81-48ba-bcfd-ca858bf32630 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:39.861928 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce2a33-dac2-4b8b-b0e4-fa24bd67d1f6 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:39.871147 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3101b8-0b81-48ba-bcfd-ca858bf32630 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:39.877473 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce2a33-dac2-4b8b-b0e4-fa24bd67d1f6 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:39.878393 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6730a18-2175-45ce-9776-2dd3bca6e789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:39.879139 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6730a18-2175-45ce-9776-2dd3bca6e789 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:39.879428 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6730a18-2175-45ce-9776-2dd3bca6e789 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:39.879679 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6730a18-2175-45ce-9776-2dd3bca6e789 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:39.880700 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6730a18-2175-45ce-9776-2dd3bca6e789 admin admin] RBAC: Adding query filter params (role.id=17c81d2cd8f34ad49f4c495ecb2d982e, scope.project.id=d8f9072509b7489eba91457dfb47e439, user.id=b8f935bd2a784b8d8c0b396f1556b5f5) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:39.881016 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6730a18-2175-45ce-9776-2dd3bca6e789 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:39.883729 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6730a18-2175-45ce-9776-2dd3bca6e789 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:39.889589 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5294c635-65fe-40be-9b84-578c52e44b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:39.890381 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5294c635-65fe-40be-9b84-578c52e44b5e admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:39.890658 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5294c635-65fe-40be-9b84-578c52e44b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:39.891186 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5294c635-65fe-40be-9b84-578c52e44b5e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:39.894385 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 114/231] 10.222.0.18 () {56 vars in 1395 bytes} [Tue Oct 12 18:04:39 2021] GET /identity/v3/role_assignments?user.id=b8f935bd2a784b8d8c0b396f1556b5f5&scope.project.id=d8f9072509b7489eba91457dfb47e439&role.id=17c81d2cd8f34ad49f4c495ecb2d982e => generated 608 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:39.917722 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5294c635-65fe-40be-9b84-578c52e44b5e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 18:04:39.924798 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-5294c635-65fe-40be-9b84-578c52e44b5e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 18:04:39.926364 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 118/232] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Oct 12 18:04:39 2021] GET /identity/v3/roles/admin => generated 83 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:04:39.932846 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6730a18-2175-45ce-9776-2dd3bca6e789 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:39.947964 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6730a18-2175-45ce-9776-2dd3bca6e789 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:39.957718 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc822c4-c3fd-4357-8864-3951c31a42c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:39.958453 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc822c4-c3fd-4357-8864-3951c31a42c4 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:39.958777 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc822c4-c3fd-4357-8864-3951c31a42c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:39.959052 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc822c4-c3fd-4357-8864-3951c31a42c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:39.959925 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc822c4-c3fd-4357-8864-3951c31a42c4 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:39.960238 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc822c4-c3fd-4357-8864-3951c31a42c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:39.961950 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc822c4-c3fd-4357-8864-3951c31a42c4 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:39.974797 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 115/233] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Oct 12 18:04:39 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:39.981728 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5294c635-65fe-40be-9b84-578c52e44b5e admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:39.998506 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5294c635-65fe-40be-9b84-578c52e44b5e admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:40.009279 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a0f0a-1140-4928-8ea0-08f19601da1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:40.010159 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a0f0a-1140-4928-8ea0-08f19601da1a admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:40.010444 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a0f0a-1140-4928-8ea0-08f19601da1a admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:40.010719 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a0f0a-1140-4928-8ea0-08f19601da1a admin admin] PATH_INFO: `/v3/users/31651079c8d04df8a5fb70d40851475c` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:40.017285 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5a0f0a-1140-4928-8ea0-08f19601da1a admin admin] RBAC: Authorizing `identity:get_user(user_id=31651079c8d04df8a5fb70d40851475c)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:40.019369 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5a0f0a-1140-4928-8ea0-08f19601da1a admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:40.021413 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 119/234] 10.222.0.18 () {56 vars in 1198 bytes} [Tue Oct 12 18:04:39 2021] GET /identity/v3/users/31651079c8d04df8a5fb70d40851475c => generated 247 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:40.028058 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc822c4-c3fd-4357-8864-3951c31a42c4 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:40.039739 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc822c4-c3fd-4357-8864-3951c31a42c4 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:40.048709 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7158c3-e4b2-4fb6-9899-69991bfb2df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:40.049430 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7158c3-e4b2-4fb6-9899-69991bfb2df1 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:40.049711 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7158c3-e4b2-4fb6-9899-69991bfb2df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:40.050029 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7158c3-e4b2-4fb6-9899-69991bfb2df1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:40.066671 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7158c3-e4b2-4fb6-9899-69991bfb2df1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:40.068535 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7158c3-e4b2-4fb6-9899-69991bfb2df1 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:40.082131 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 116/235] 10.222.0.18 () {58 vars in 1324 bytes} [Tue Oct 12 18:04:40 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:04:40.088559 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a0f0a-1140-4928-8ea0-08f19601da1a admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:40.102605 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a0f0a-1140-4928-8ea0-08f19601da1a admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:40.113616 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225ed7a0-89b7-4e58-b5ff-104090972ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:40.114495 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225ed7a0-89b7-4e58-b5ff-104090972ca6 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:40.114773 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225ed7a0-89b7-4e58-b5ff-104090972ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:40.115044 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225ed7a0-89b7-4e58-b5ff-104090972ca6 admin admin] PATH_INFO: `/v3/projects/d8f9072509b7489eba91457dfb47e439` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:40.121316 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225ed7a0-89b7-4e58-b5ff-104090972ca6 admin admin] RBAC: Authorizing `identity:get_project(project_id=d8f9072509b7489eba91457dfb47e439)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:40.123419 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225ed7a0-89b7-4e58-b5ff-104090972ca6 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:40.125242 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 120/236] 10.222.0.18 () {56 vars in 1207 bytes} [Tue Oct 12 18:04:40 2021] GET /identity/v3/projects/d8f9072509b7489eba91457dfb47e439 => generated 302 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:40.131840 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7158c3-e4b2-4fb6-9899-69991bfb2df1 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:40.143616 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7158c3-e4b2-4fb6-9899-69991bfb2df1 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:40.150989 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbd8d3e-6e58-4198-9982-410ef87336b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:40.151654 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbd8d3e-6e58-4198-9982-410ef87336b6 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:40.151931 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbd8d3e-6e58-4198-9982-410ef87336b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:40.152207 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbd8d3e-6e58-4198-9982-410ef87336b6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:40.153145 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbd8d3e-6e58-4198-9982-410ef87336b6 admin admin] RBAC: Adding query filter params (role.id=6c54f239944d46e3b027ccce97eb8b49, scope.project.id=d8f9072509b7489eba91457dfb47e439, user.id=31651079c8d04df8a5fb70d40851475c) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:40.153455 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbd8d3e-6e58-4198-9982-410ef87336b6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:40.155359 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbd8d3e-6e58-4198-9982-410ef87336b6 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:40.166896 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 117/237] 10.222.0.18 () {56 vars in 1395 bytes} [Tue Oct 12 18:04:40 2021] GET /identity/v3/role_assignments?user.id=31651079c8d04df8a5fb70d40851475c&scope.project.id=d8f9072509b7489eba91457dfb47e439&role.id=6c54f239944d46e3b027ccce97eb8b49 => generated 608 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:40.556258 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd2dd5a-d246-44ce-bf3f-a5c93b513d06 None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:40.556258 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd2dd5a-d246-44ce-bf3f-a5c93b513d06 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:40.556258 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd2dd5a-d246-44ce-bf3f-a5c93b513d06 None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:40.556258 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 121/238] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:04:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:04:40.564667 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d0dc3f-6fa4-41a3-847c-fc093d0b3ab2 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:40.565206 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d0dc3f-6fa4-41a3-847c-fc093d0b3ab2 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:40.565206 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d0dc3f-6fa4-41a3-847c-fc093d0b3ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:40.588617 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-42d0dc3f-6fa4-41a3-847c-fc093d0b3ab2 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:04:40.589810 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-42d0dc3f-6fa4-41a3-847c-fc093d0b3ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:04:40.598837 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 118/239] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:04:40 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:04:40.644545 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd2dd5a-d246-44ce-bf3f-a5c93b513d06 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:40.662114 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd2dd5a-d246-44ce-bf3f-a5c93b513d06 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:40.669514 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256564c3-5bed-4fe2-9b51-ca6a41f8b2dc None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:40.669798 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256564c3-5bed-4fe2-9b51-ca6a41f8b2dc None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:40.670081 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256564c3-5bed-4fe2-9b51-ca6a41f8b2dc None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:40.670587 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cf4a3a-bd40-47f0-822c-195558baaccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:40.671606 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf4a3a-bd40-47f0-822c-195558baaccd admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:40.671851 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 119/240] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:04:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 18:04:40.672286 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf4a3a-bd40-47f0-822c-195558baaccd admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:40.672771 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf4a3a-bd40-47f0-822c-195558baaccd admin admin] PATH_INFO: `/v3/roles/member` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:40.677915 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348d623-b5b1-4d96-bad0-193a1e5d98a1 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:40.678232 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348d623-b5b1-4d96-bad0-193a1e5d98a1 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:40.678543 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348d623-b5b1-4d96-bad0-193a1e5d98a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:40.688601 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cf4a3a-bd40-47f0-822c-195558baaccd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 18:04:40.696865 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-62cf4a3a-bd40-47f0-822c-195558baaccd admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 18:04:40.698639 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 122/241] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Oct 12 18:04:40 2021] GET /identity/v3/roles/member => generated 84 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:04:40.705194 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cf4a3a-bd40-47f0-822c-195558baaccd admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:40.710220 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-3348d623-b5b1-4d96-bad0-193a1e5d98a1 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:04:40.711424 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-3348d623-b5b1-4d96-bad0-193a1e5d98a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:04:40.722660 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cf4a3a-bd40-47f0-822c-195558baaccd admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:40.724454 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 120/242] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:04:40 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Oct 12 18:04:40.731333 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66308c81-5960-48f1-b987-c138d5f37947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:40.731998 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66308c81-5960-48f1-b987-c138d5f37947 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:40.732278 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66308c81-5960-48f1-b987-c138d5f37947 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:40.732575 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66308c81-5960-48f1-b987-c138d5f37947 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:40.733337 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66308c81-5960-48f1-b987-c138d5f37947 admin admin] RBAC: Adding query filter params (name=member) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:40.733744 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66308c81-5960-48f1-b987-c138d5f37947 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:40.735250 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66308c81-5960-48f1-b987-c138d5f37947 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:40.746683 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 123/243] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Oct 12 18:04:40 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:40.753144 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3348d623-b5b1-4d96-bad0-193a1e5d98a1 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:40.761509 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66308c81-5960-48f1-b987-c138d5f37947 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:40.766458 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3348d623-b5b1-4d96-bad0-193a1e5d98a1 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:40.774408 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66308c81-5960-48f1-b987-c138d5f37947 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:40.779190 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8184d269-b871-4907-bc73-13aaf4dae916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:40.780135 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8184d269-b871-4907-bc73-13aaf4dae916 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:40.780436 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8184d269-b871-4907-bc73-13aaf4dae916 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:40.780720 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8184d269-b871-4907-bc73-13aaf4dae916 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:40.784144 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afec6f6-a538-465a-91dd-df2ac9cf3ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:40.786069 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afec6f6-a538-465a-91dd-df2ac9cf3ae0 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:40.786353 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afec6f6-a538-465a-91dd-df2ac9cf3ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:40.786631 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afec6f6-a538-465a-91dd-df2ac9cf3ae0 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:40.799360 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8184d269-b871-4907-bc73-13aaf4dae916 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:40.802161 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8184d269-b871-4907-bc73-13aaf4dae916 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:40.812949 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afec6f6-a538-465a-91dd-df2ac9cf3ae0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 18:04:40.824325 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 121/244] 10.222.0.18 () {58 vars in 1324 bytes} [Tue Oct 12 18:04:40 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:04:40.825469 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-0afec6f6-a538-465a-91dd-df2ac9cf3ae0 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 18:04:40.826912 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 124/245] 10.222.0.18 () {56 vars in 1135 bytes} [Tue Oct 12 18:04:40 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:04:40.830707 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8184d269-b871-4907-bc73-13aaf4dae916 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:40.840070 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8184d269-b871-4907-bc73-13aaf4dae916 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:40.844849 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d550e40-6fc8-4899-a00a-0785ae4d4e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:40.845759 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d550e40-6fc8-4899-a00a-0785ae4d4e3e admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:40.846094 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d550e40-6fc8-4899-a00a-0785ae4d4e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:40.846375 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d550e40-6fc8-4899-a00a-0785ae4d4e3e admin admin] PATH_INFO: `/v3/projects/1065667c5e62410e8db95ee2e1b98135` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:40.849264 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d550e40-6fc8-4899-a00a-0785ae4d4e3e admin admin] RBAC: Authorizing `identity:get_project(project_id=1065667c5e62410e8db95ee2e1b98135)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:40.852020 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d550e40-6fc8-4899-a00a-0785ae4d4e3e admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:40.853975 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 122/246] 10.222.0.18 () {56 vars in 1207 bytes} [Tue Oct 12 18:04:40 2021] GET /identity/v3/projects/1065667c5e62410e8db95ee2e1b98135 => generated 298 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:40.855827 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afec6f6-a538-465a-91dd-df2ac9cf3ae0 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:40.862933 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d550e40-6fc8-4899-a00a-0785ae4d4e3e admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:40.868246 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afec6f6-a538-465a-91dd-df2ac9cf3ae0 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:40.878713 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcc8396-bc80-456d-befc-5ef67ad4dec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:40.879450 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc8396-bc80-456d-befc-5ef67ad4dec8 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:40.879738 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc8396-bc80-456d-befc-5ef67ad4dec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:40.882168 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc8396-bc80-456d-befc-5ef67ad4dec8 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:40.882955 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcc8396-bc80-456d-befc-5ef67ad4dec8 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:40.883267 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcc8396-bc80-456d-befc-5ef67ad4dec8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:40.886399 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcc8396-bc80-456d-befc-5ef67ad4dec8 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:40.887611 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d550e40-6fc8-4899-a00a-0785ae4d4e3e admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:40.896949 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d0fe73-b8cd-4625-8b21-68a35fe1e84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:40.899042 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0fe73-b8cd-4625-8b21-68a35fe1e84c admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:40.899222 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0fe73-b8cd-4625-8b21-68a35fe1e84c admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:40.899374 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0fe73-b8cd-4625-8b21-68a35fe1e84c admin admin] PATH_INFO: `/v3/groups/7a4460e68178437ebc8e1571efa638e3` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:40.905593 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 125/247] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Oct 12 18:04:40 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:40.913737 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d0fe73-b8cd-4625-8b21-68a35fe1e84c admin admin] RBAC: Authorizing `identity:get_group(group_id=7a4460e68178437ebc8e1571efa638e3)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:40.914770 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING py.warnings [None req-e8d0fe73-b8cd-4625-8b21-68a35fe1e84c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:04:40.914770 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: warnings.warn(msg) Oct 12 18:04:40.914770 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: Oct 12 18:04:40.916116 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d0fe73-b8cd-4625-8b21-68a35fe1e84c admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:40.917906 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 123/248] 10.222.0.18 () {56 vars in 1201 bytes} [Tue Oct 12 18:04:40 2021] GET /identity/v3/groups/7a4460e68178437ebc8e1571efa638e3 => generated 226 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:40.920124 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcc8396-bc80-456d-befc-5ef67ad4dec8 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:40.926006 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d0fe73-b8cd-4625-8b21-68a35fe1e84c admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:40.933327 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcc8396-bc80-456d-befc-5ef67ad4dec8 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:40.944830 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf27867-b68b-43ff-803f-4dbbe5ca5313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:40.945489 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf27867-b68b-43ff-803f-4dbbe5ca5313 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:40.945772 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf27867-b68b-43ff-803f-4dbbe5ca5313 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:40.947320 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf27867-b68b-43ff-803f-4dbbe5ca5313 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:40.949268 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d0fe73-b8cd-4625-8b21-68a35fe1e84c admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:40.961704 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7953bff0-bc48-4d06-9b69-164f872dde31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:40.962407 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953bff0-bc48-4d06-9b69-164f872dde31 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:40.962692 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953bff0-bc48-4d06-9b69-164f872dde31 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:40.962968 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953bff0-bc48-4d06-9b69-164f872dde31 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:40.963603 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf27867-b68b-43ff-803f-4dbbe5ca5313 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:40.964617 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7953bff0-bc48-4d06-9b69-164f872dde31 admin admin] RBAC: Adding query filter params (group.id=7a4460e68178437ebc8e1571efa638e3, role.id=33b8a5a8d1d643f2a98f598e6ab0a1cf, scope.project.id=1065667c5e62410e8db95ee2e1b98135) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:40.964931 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7953bff0-bc48-4d06-9b69-164f872dde31 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:40.967073 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf27867-b68b-43ff-803f-4dbbe5ca5313 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:40.968360 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7953bff0-bc48-4d06-9b69-164f872dde31 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:40.982140 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 124/249] 10.222.0.18 () {56 vars in 1397 bytes} [Tue Oct 12 18:04:40 2021] GET /identity/v3/role_assignments?group.id=7a4460e68178437ebc8e1571efa638e3&scope.project.id=1065667c5e62410e8db95ee2e1b98135&role.id=33b8a5a8d1d643f2a98f598e6ab0a1cf => generated 260 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:40.987320 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 126/250] 10.222.0.18 () {58 vars in 1324 bytes} [Tue Oct 12 18:04:40 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:04:40.994970 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7953bff0-bc48-4d06-9b69-164f872dde31 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:41.005823 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7953bff0-bc48-4d06-9b69-164f872dde31 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:41.017377 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5543cc9-f32b-4289-9a34-116904a03257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:41.018276 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5543cc9-f32b-4289-9a34-116904a03257 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:41.018616 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5543cc9-f32b-4289-9a34-116904a03257 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:41.018897 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5543cc9-f32b-4289-9a34-116904a03257 admin admin] PATH_INFO: `/v3/projects/1065667c5e62410e8db95ee2e1b98135` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:41.025423 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5543cc9-f32b-4289-9a34-116904a03257 admin admin] RBAC: Authorizing `identity:get_project(project_id=1065667c5e62410e8db95ee2e1b98135)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:41.027539 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5543cc9-f32b-4289-9a34-116904a03257 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:41.029424 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 125/251] 10.222.0.18 () {56 vars in 1207 bytes} [Tue Oct 12 18:04:40 2021] GET /identity/v3/projects/1065667c5e62410e8db95ee2e1b98135 => generated 298 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:41.035723 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf27867-b68b-43ff-803f-4dbbe5ca5313 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:41.048428 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf27867-b68b-43ff-803f-4dbbe5ca5313 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:41.057286 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dd1668-5199-4519-b67e-758938d086c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:41.058526 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dd1668-5199-4519-b67e-758938d086c8 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:41.059008 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dd1668-5199-4519-b67e-758938d086c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:41.059501 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dd1668-5199-4519-b67e-758938d086c8 admin admin] PATH_INFO: `/v3/groups/7a4460e68178437ebc8e1571efa638e3` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:41.061179 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dd1668-5199-4519-b67e-758938d086c8 admin admin] RBAC: Authorizing `identity:get_group(group_id=7a4460e68178437ebc8e1571efa638e3)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:41.062493 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING py.warnings [None req-61dd1668-5199-4519-b67e-758938d086c8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:04:41.062493 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: warnings.warn(msg) Oct 12 18:04:41.062493 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: Oct 12 18:04:41.064108 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dd1668-5199-4519-b67e-758938d086c8 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:41.066501 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 127/252] 10.222.0.18 () {56 vars in 1201 bytes} [Tue Oct 12 18:04:41 2021] GET /identity/v3/groups/7a4460e68178437ebc8e1571efa638e3 => generated 226 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:41.073006 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5543cc9-f32b-4289-9a34-116904a03257 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:41.083473 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5543cc9-f32b-4289-9a34-116904a03257 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:41.097143 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a75327-fb51-4426-b599-4da13d732c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:41.097823 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a75327-fb51-4426-b599-4da13d732c02 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:41.098106 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a75327-fb51-4426-b599-4da13d732c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:41.098384 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a75327-fb51-4426-b599-4da13d732c02 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:41.099244 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a75327-fb51-4426-b599-4da13d732c02 admin admin] RBAC: Adding query filter params (group.id=7a4460e68178437ebc8e1571efa638e3, role.id=17c81d2cd8f34ad49f4c495ecb2d982e, scope.project.id=1065667c5e62410e8db95ee2e1b98135) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:41.099553 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a75327-fb51-4426-b599-4da13d732c02 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:41.101541 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a75327-fb51-4426-b599-4da13d732c02 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:41.112573 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 126/253] 10.222.0.18 () {56 vars in 1397 bytes} [Tue Oct 12 18:04:41 2021] GET /identity/v3/role_assignments?group.id=7a4460e68178437ebc8e1571efa638e3&scope.project.id=1065667c5e62410e8db95ee2e1b98135&role.id=17c81d2cd8f34ad49f4c495ecb2d982e => generated 260 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:41.538206 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8750e3b5-65a9-4b06-8194-ffd07f6f8110 None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:41.538881 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8750e3b5-65a9-4b06-8194-ffd07f6f8110 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:41.539364 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8750e3b5-65a9-4b06-8194-ffd07f6f8110 None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:41.541652 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 128/254] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:04:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:04:41.547536 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1b622-1a11-459e-8419-62596434a3f0 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:41.547826 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1b622-1a11-459e-8419-62596434a3f0 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:41.548107 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1b622-1a11-459e-8419-62596434a3f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:41.570223 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-76f1b622-1a11-459e-8419-62596434a3f0 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:04:41.571407 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-76f1b622-1a11-459e-8419-62596434a3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:04:41.585712 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 127/255] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:04:41 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:04:41.638003 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8750e3b5-65a9-4b06-8194-ffd07f6f8110 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:41.657945 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8750e3b5-65a9-4b06-8194-ffd07f6f8110 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:41.662720 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585e3dae-cc86-4885-b248-7489b73725b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:41.663830 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e3dae-cc86-4885-b248-7489b73725b1 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:41.664305 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e3dae-cc86-4885-b248-7489b73725b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:41.664793 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e3dae-cc86-4885-b248-7489b73725b1 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:41.675661 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585e3dae-cc86-4885-b248-7489b73725b1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 18:04:41.683463 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-585e3dae-cc86-4885-b248-7489b73725b1 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 18:04:41.684919 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 129/256] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Oct 12 18:04:41 2021] GET /identity/v3/roles/member => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:04:41.691444 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f1b622-1a11-459e-8419-62596434a3f0 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:41.701354 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f1b622-1a11-459e-8419-62596434a3f0 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:41.712166 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcbed21-6554-4ef3-931b-d4f5460559c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:41.713127 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcbed21-6554-4ef3-931b-d4f5460559c1 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:41.713625 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcbed21-6554-4ef3-931b-d4f5460559c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:41.714353 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcbed21-6554-4ef3-931b-d4f5460559c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:41.715322 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcbed21-6554-4ef3-931b-d4f5460559c1 admin admin] RBAC: Adding query filter params (name=member) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:41.715819 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcbed21-6554-4ef3-931b-d4f5460559c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:41.717640 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcbed21-6554-4ef3-931b-d4f5460559c1 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:41.733305 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 128/257] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Oct 12 18:04:41 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:41.739768 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585e3dae-cc86-4885-b248-7489b73725b1 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:41.750984 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585e3dae-cc86-4885-b248-7489b73725b1 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:41.760348 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d076c6f7-3334-4700-a125-ac7e77bc44ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:41.761266 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d076c6f7-3334-4700-a125-ac7e77bc44ea admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:41.761779 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d076c6f7-3334-4700-a125-ac7e77bc44ea admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:41.762252 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d076c6f7-3334-4700-a125-ac7e77bc44ea admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:41.771067 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d076c6f7-3334-4700-a125-ac7e77bc44ea admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:41.773614 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d076c6f7-3334-4700-a125-ac7e77bc44ea admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:41.785331 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 130/258] 10.222.0.18 () {58 vars in 1324 bytes} [Tue Oct 12 18:04:41 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:04:41.791962 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcbed21-6554-4ef3-931b-d4f5460559c1 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:41.806822 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcbed21-6554-4ef3-931b-d4f5460559c1 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:41.816936 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac43af4-a038-438c-8cc9-50c473ab0d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:41.818088 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac43af4-a038-438c-8cc9-50c473ab0d60 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:41.818608 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac43af4-a038-438c-8cc9-50c473ab0d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:41.819076 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac43af4-a038-438c-8cc9-50c473ab0d60 admin admin] PATH_INFO: `/v3/projects/d8f9072509b7489eba91457dfb47e439` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:41.820532 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac43af4-a038-438c-8cc9-50c473ab0d60 admin admin] RBAC: Authorizing `identity:get_project(project_id=d8f9072509b7489eba91457dfb47e439)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:41.822810 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac43af4-a038-438c-8cc9-50c473ab0d60 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:41.825021 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 129/259] 10.222.0.18 () {56 vars in 1207 bytes} [Tue Oct 12 18:04:41 2021] GET /identity/v3/projects/d8f9072509b7489eba91457dfb47e439 => generated 302 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:41.830881 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d076c6f7-3334-4700-a125-ac7e77bc44ea admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:41.840983 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d076c6f7-3334-4700-a125-ac7e77bc44ea admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:41.842635 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48676d72-d277-4719-99c6-228219fc5aab None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:41.843701 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48676d72-d277-4719-99c6-228219fc5aab None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:41.844496 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48676d72-d277-4719-99c6-228219fc5aab None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:41.846763 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 130/260] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:04:41 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:04:41.853593 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23651823-8fc4-4ba0-9c69-07b884bc75c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:41.853747 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b789c2a8-9165-4d7d-8047-73d2a8281b3e None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:41.854152 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b789c2a8-9165-4d7d-8047-73d2a8281b3e None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:41.854523 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b789c2a8-9165-4d7d-8047-73d2a8281b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:41.855007 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23651823-8fc4-4ba0-9c69-07b884bc75c3 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:41.855447 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23651823-8fc4-4ba0-9c69-07b884bc75c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:41.855858 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23651823-8fc4-4ba0-9c69-07b884bc75c3 admin admin] PATH_INFO: `/v3/groups/7a4460e68178437ebc8e1571efa638e3` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:41.857317 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23651823-8fc4-4ba0-9c69-07b884bc75c3 admin admin] RBAC: Authorizing `identity:get_group(group_id=7a4460e68178437ebc8e1571efa638e3)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:41.859437 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23651823-8fc4-4ba0-9c69-07b884bc75c3 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:41.861566 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 131/261] 10.222.0.18 () {56 vars in 1201 bytes} [Tue Oct 12 18:04:41 2021] GET /identity/v3/groups/7a4460e68178437ebc8e1571efa638e3 => generated 226 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:41.874093 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23651823-8fc4-4ba0-9c69-07b884bc75c3 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:41.878196 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-b789c2a8-9165-4d7d-8047-73d2a8281b3e None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:04:41.879377 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-b789c2a8-9165-4d7d-8047-73d2a8281b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:04:41.885096 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23651823-8fc4-4ba0-9c69-07b884bc75c3 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:41.893551 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be10a2ce-86cd-4f7c-a9e8-4eab0360b997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:41.894467 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be10a2ce-86cd-4f7c-a9e8-4eab0360b997 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:41.895451 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be10a2ce-86cd-4f7c-a9e8-4eab0360b997 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:41.895928 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be10a2ce-86cd-4f7c-a9e8-4eab0360b997 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:41.897890 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 131/262] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:04:41 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:04:41.898966 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be10a2ce-86cd-4f7c-a9e8-4eab0360b997 admin admin] RBAC: Adding query filter params (group.id=7a4460e68178437ebc8e1571efa638e3, role.id=33b8a5a8d1d643f2a98f598e6ab0a1cf, scope.project.id=d8f9072509b7489eba91457dfb47e439) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:41.899484 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be10a2ce-86cd-4f7c-a9e8-4eab0360b997 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:41.901563 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be10a2ce-86cd-4f7c-a9e8-4eab0360b997 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:41.907702 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 132/263] 10.222.0.18 () {56 vars in 1397 bytes} [Tue Oct 12 18:04:41 2021] GET /identity/v3/role_assignments?group.id=7a4460e68178437ebc8e1571efa638e3&scope.project.id=d8f9072509b7489eba91457dfb47e439&role.id=33b8a5a8d1d643f2a98f598e6ab0a1cf => generated 260 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:04:41.953934 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b789c2a8-9165-4d7d-8047-73d2a8281b3e None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:41.964437 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b789c2a8-9165-4d7d-8047-73d2a8281b3e None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:41.972221 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba845740-d4ec-4c48-95c7-9250b17584e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:41.973438 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba845740-d4ec-4c48-95c7-9250b17584e0 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:41.973918 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba845740-d4ec-4c48-95c7-9250b17584e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:41.974386 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba845740-d4ec-4c48-95c7-9250b17584e0 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:41.990133 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba845740-d4ec-4c48-95c7-9250b17584e0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 18:04:41.998675 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-ba845740-d4ec-4c48-95c7-9250b17584e0 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 18:04:42.000662 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 132/264] 10.222.0.18 () {56 vars in 1135 bytes} [Tue Oct 12 18:04:41 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:04:42.007937 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be10a2ce-86cd-4f7c-a9e8-4eab0360b997 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:42.020046 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be10a2ce-86cd-4f7c-a9e8-4eab0360b997 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:42.029171 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259e79ef-2adc-48b6-aa42-8418c18e4488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:42.029881 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e79ef-2adc-48b6-aa42-8418c18e4488 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:42.030169 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e79ef-2adc-48b6-aa42-8418c18e4488 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:42.030450 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e79ef-2adc-48b6-aa42-8418c18e4488 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:42.031239 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259e79ef-2adc-48b6-aa42-8418c18e4488 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:42.031549 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259e79ef-2adc-48b6-aa42-8418c18e4488 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:42.033236 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259e79ef-2adc-48b6-aa42-8418c18e4488 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:42.048100 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 133/265] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Oct 12 18:04:42 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:04:42.055412 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba845740-d4ec-4c48-95c7-9250b17584e0 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:42.066519 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba845740-d4ec-4c48-95c7-9250b17584e0 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:42.075134 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85367ca3-3997-4169-a89d-9389acb508f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:42.076136 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85367ca3-3997-4169-a89d-9389acb508f9 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:42.076650 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85367ca3-3997-4169-a89d-9389acb508f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:42.077152 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85367ca3-3997-4169-a89d-9389acb508f9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:42.089353 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85367ca3-3997-4169-a89d-9389acb508f9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:42.091544 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85367ca3-3997-4169-a89d-9389acb508f9 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:42.103582 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 133/266] 10.222.0.18 () {58 vars in 1324 bytes} [Tue Oct 12 18:04:42 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:04:42.110409 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259e79ef-2adc-48b6-aa42-8418c18e4488 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:42.127433 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259e79ef-2adc-48b6-aa42-8418c18e4488 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:42.134740 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a7c47f-64d5-4be9-bcf0-8b336708eacc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:42.135645 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a7c47f-64d5-4be9-bcf0-8b336708eacc admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:42.135927 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a7c47f-64d5-4be9-bcf0-8b336708eacc admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:42.136204 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a7c47f-64d5-4be9-bcf0-8b336708eacc admin admin] PATH_INFO: `/v3/projects/d8f9072509b7489eba91457dfb47e439` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:42.137658 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a7c47f-64d5-4be9-bcf0-8b336708eacc admin admin] RBAC: Authorizing `identity:get_project(project_id=d8f9072509b7489eba91457dfb47e439)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:42.139846 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a7c47f-64d5-4be9-bcf0-8b336708eacc admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:42.142075 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 134/267] 10.222.0.18 () {56 vars in 1207 bytes} [Tue Oct 12 18:04:42 2021] GET /identity/v3/projects/d8f9072509b7489eba91457dfb47e439 => generated 302 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:42.149464 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85367ca3-3997-4169-a89d-9389acb508f9 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:42.160834 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85367ca3-3997-4169-a89d-9389acb508f9 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:42.173288 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532780f5-4a2d-45a6-8f2c-3086ead30b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:42.174584 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532780f5-4a2d-45a6-8f2c-3086ead30b96 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:42.175068 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532780f5-4a2d-45a6-8f2c-3086ead30b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:42.175540 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532780f5-4a2d-45a6-8f2c-3086ead30b96 admin admin] PATH_INFO: `/v3/groups/7a4460e68178437ebc8e1571efa638e3` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:42.177109 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532780f5-4a2d-45a6-8f2c-3086ead30b96 admin admin] RBAC: Authorizing `identity:get_group(group_id=7a4460e68178437ebc8e1571efa638e3)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:42.179364 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532780f5-4a2d-45a6-8f2c-3086ead30b96 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:42.181506 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 134/268] 10.222.0.18 () {56 vars in 1201 bytes} [Tue Oct 12 18:04:42 2021] GET /identity/v3/groups/7a4460e68178437ebc8e1571efa638e3 => generated 226 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:42.188233 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a7c47f-64d5-4be9-bcf0-8b336708eacc admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:42.199451 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a7c47f-64d5-4be9-bcf0-8b336708eacc admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:42.214397 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbf7830-8ecb-4d4a-a230-f22f8b0f9dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:42.215538 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf7830-8ecb-4d4a-a230-f22f8b0f9dfb admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:42.216049 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf7830-8ecb-4d4a-a230-f22f8b0f9dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:42.216600 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf7830-8ecb-4d4a-a230-f22f8b0f9dfb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:42.218161 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbf7830-8ecb-4d4a-a230-f22f8b0f9dfb admin admin] RBAC: Adding query filter params (group.id=7a4460e68178437ebc8e1571efa638e3, role.id=17c81d2cd8f34ad49f4c495ecb2d982e, scope.project.id=d8f9072509b7489eba91457dfb47e439) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:42.218485 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbf7830-8ecb-4d4a-a230-f22f8b0f9dfb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:42.220419 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbf7830-8ecb-4d4a-a230-f22f8b0f9dfb admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:42.226852 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 135/269] 10.222.0.18 () {56 vars in 1397 bytes} [Tue Oct 12 18:04:42 2021] GET /identity/v3/role_assignments?group.id=7a4460e68178437ebc8e1571efa638e3&scope.project.id=d8f9072509b7489eba91457dfb47e439&role.id=17c81d2cd8f34ad49f4c495ecb2d982e => generated 260 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:42.311036 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a1418-6003-434a-be66-5bff5575d8d6 None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:42.311400 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a1418-6003-434a-be66-5bff5575d8d6 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:42.311775 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a1418-6003-434a-be66-5bff5575d8d6 None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:42.313685 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 135/270] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:04:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:04:42.320588 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadcad45-27db-4fe4-b5fd-032608df5653 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:42.321104 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadcad45-27db-4fe4-b5fd-032608df5653 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:42.321527 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadcad45-27db-4fe4-b5fd-032608df5653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:42.341181 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-dadcad45-27db-4fe4-b5fd-032608df5653 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:04:42.342622 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-dadcad45-27db-4fe4-b5fd-032608df5653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:04:42.358229 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 136/271] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:04:42 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:04:42.403548 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84a1418-6003-434a-be66-5bff5575d8d6 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:42.421757 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84a1418-6003-434a-be66-5bff5575d8d6 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:42.431907 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf65e51-2eba-4d46-84a4-cb1054313c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:42.432754 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf65e51-2eba-4d46-84a4-cb1054313c67 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:42.433036 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf65e51-2eba-4d46-84a4-cb1054313c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:42.433312 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf65e51-2eba-4d46-84a4-cb1054313c67 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:42.446444 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf65e51-2eba-4d46-84a4-cb1054313c67 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 18:04:42.453599 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-cdf65e51-2eba-4d46-84a4-cb1054313c67 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 18:04:42.455187 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 136/272] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Oct 12 18:04:42 2021] GET /identity/v3/roles/admin => generated 83 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:04:42.461975 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadcad45-27db-4fe4-b5fd-032608df5653 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:42.476439 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadcad45-27db-4fe4-b5fd-032608df5653 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:42.480667 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0811c676-8a4a-48aa-ab97-a3c93fc4d0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:42.481360 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811c676-8a4a-48aa-ab97-a3c93fc4d0a1 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:42.481643 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811c676-8a4a-48aa-ab97-a3c93fc4d0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:42.481920 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811c676-8a4a-48aa-ab97-a3c93fc4d0a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:42.482697 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0811c676-8a4a-48aa-ab97-a3c93fc4d0a1 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:42.483004 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0811c676-8a4a-48aa-ab97-a3c93fc4d0a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:42.484671 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0811c676-8a4a-48aa-ab97-a3c93fc4d0a1 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:42.496976 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 137/273] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Oct 12 18:04:42 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:42.503334 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf65e51-2eba-4d46-84a4-cb1054313c67 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:42.518083 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf65e51-2eba-4d46-84a4-cb1054313c67 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:42.524961 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046020fb-2b2f-4abe-be6d-d9e32c32acf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:42.525627 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046020fb-2b2f-4abe-be6d-d9e32c32acf4 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:42.525907 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046020fb-2b2f-4abe-be6d-d9e32c32acf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:42.526183 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046020fb-2b2f-4abe-be6d-d9e32c32acf4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:42.536772 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046020fb-2b2f-4abe-be6d-d9e32c32acf4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:42.539528 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046020fb-2b2f-4abe-be6d-d9e32c32acf4 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:42.552735 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 137/274] 10.222.0.18 () {58 vars in 1324 bytes} [Tue Oct 12 18:04:42 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:04:42.558839 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0811c676-8a4a-48aa-ab97-a3c93fc4d0a1 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:42.577665 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0811c676-8a4a-48aa-ab97-a3c93fc4d0a1 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:42.584163 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3018b03-9005-4582-b82b-b49690bfe3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:42.585599 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3018b03-9005-4582-b82b-b49690bfe3b4 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:42.585886 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3018b03-9005-4582-b82b-b49690bfe3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:42.586158 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3018b03-9005-4582-b82b-b49690bfe3b4 admin admin] PATH_INFO: `/v3/projects/e340b2a295714eb294f0cebe48fde56d` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:42.588101 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3018b03-9005-4582-b82b-b49690bfe3b4 admin admin] RBAC: Authorizing `identity:get_project(project_id=e340b2a295714eb294f0cebe48fde56d)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:42.589939 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3018b03-9005-4582-b82b-b49690bfe3b4 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:42.591636 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 138/275] 10.222.0.18 () {56 vars in 1207 bytes} [Tue Oct 12 18:04:42 2021] GET /identity/v3/projects/e340b2a295714eb294f0cebe48fde56d => generated 344 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:42.598041 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046020fb-2b2f-4abe-be6d-d9e32c32acf4 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:42.607171 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046020fb-2b2f-4abe-be6d-d9e32c32acf4 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:42.618895 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb76d0f5-e95b-4fba-98b0-2b13f53291ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:42.619766 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76d0f5-e95b-4fba-98b0-2b13f53291ee admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:42.620047 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76d0f5-e95b-4fba-98b0-2b13f53291ee admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:42.620317 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76d0f5-e95b-4fba-98b0-2b13f53291ee admin admin] PATH_INFO: `/v3/groups/bc0dcc98220846e49e750ce0d992666a` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:42.633159 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb76d0f5-e95b-4fba-98b0-2b13f53291ee admin admin] RBAC: Authorizing `identity:get_group(group_id=bc0dcc98220846e49e750ce0d992666a)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:42.635197 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb76d0f5-e95b-4fba-98b0-2b13f53291ee admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:42.640542 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 138/276] 10.222.0.18 () {56 vars in 1201 bytes} [Tue Oct 12 18:04:42 2021] GET /identity/v3/groups/bc0dcc98220846e49e750ce0d992666a => generated 229 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:42.644173 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3018b03-9005-4582-b82b-b49690bfe3b4 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:42.655589 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3018b03-9005-4582-b82b-b49690bfe3b4 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:42.660364 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e80bb0-4e0a-49f9-a0f9-b46251e98b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:42.661077 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e80bb0-4e0a-49f9-a0f9-b46251e98b89 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:42.661361 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e80bb0-4e0a-49f9-a0f9-b46251e98b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:42.661690 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e80bb0-4e0a-49f9-a0f9-b46251e98b89 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:42.662597 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e80bb0-4e0a-49f9-a0f9-b46251e98b89 admin admin] RBAC: Adding query filter params (group.id=bc0dcc98220846e49e750ce0d992666a, role.id=6c54f239944d46e3b027ccce97eb8b49, scope.project.id=e340b2a295714eb294f0cebe48fde56d) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:42.663452 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e80bb0-4e0a-49f9-a0f9-b46251e98b89 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:42.665434 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e80bb0-4e0a-49f9-a0f9-b46251e98b89 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:42.671836 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 139/277] 10.222.0.18 () {56 vars in 1397 bytes} [Tue Oct 12 18:04:42 2021] GET /identity/v3/role_assignments?group.id=bc0dcc98220846e49e750ce0d992666a&scope.project.id=e340b2a295714eb294f0cebe48fde56d&role.id=6c54f239944d46e3b027ccce97eb8b49 => generated 260 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:43.853623 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75e8b5-f7ad-4fbb-b0a7-4bd8d163d97b None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:43.854628 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75e8b5-f7ad-4fbb-b0a7-4bd8d163d97b None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:43.855119 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75e8b5-f7ad-4fbb-b0a7-4bd8d163d97b None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:43.857362 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 139/278] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:04:43 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:04:43.863630 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d0679-c592-4221-9e5e-5ca4be55f4aa None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:43.864485 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d0679-c592-4221-9e5e-5ca4be55f4aa None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:43.864971 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d0679-c592-4221-9e5e-5ca4be55f4aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:43.887918 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-952d0679-c592-4221-9e5e-5ca4be55f4aa None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:04:43.889416 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-952d0679-c592-4221-9e5e-5ca4be55f4aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:04:43.902597 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 140/279] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:04:43 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:04:43.942318 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c75e8b5-f7ad-4fbb-b0a7-4bd8d163d97b None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:43.949053 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bade228-ab19-4d42-a199-32a55740b558 None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:43.949345 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bade228-ab19-4d42-a199-32a55740b558 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:43.949640 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bade228-ab19-4d42-a199-32a55740b558 None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:43.951398 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 141/280] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:04:43 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:04:43.957366 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb91a3-30a5-4fde-8187-d6ff31f60b55 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:43.957855 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb91a3-30a5-4fde-8187-d6ff31f60b55 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:43.958299 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb91a3-30a5-4fde-8187-d6ff31f60b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:43.959043 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c75e8b5-f7ad-4fbb-b0a7-4bd8d163d97b None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:43.969692 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6248e6bf-60ad-4efb-b657-fdfe3c7dcb45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:43.970227 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6248e6bf-60ad-4efb-b657-fdfe3c7dcb45 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:43.970501 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6248e6bf-60ad-4efb-b657-fdfe3c7dcb45 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:43.970770 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6248e6bf-60ad-4efb-b657-fdfe3c7dcb45 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:43.988430 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-d1cb91a3-30a5-4fde-8187-d6ff31f60b55 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:04:43.989696 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-d1cb91a3-30a5-4fde-8187-d6ff31f60b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:04:43.997838 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6248e6bf-60ad-4efb-b657-fdfe3c7dcb45 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 18:04:44.005418 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-6248e6bf-60ad-4efb-b657-fdfe3c7dcb45 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 18:04:44.006883 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 140/281] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Oct 12 18:04:43 2021] GET /identity/v3/roles/member => generated 84 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:04:44.012301 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 142/282] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:04:43 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:04:44.013263 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6248e6bf-60ad-4efb-b657-fdfe3c7dcb45 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:44.023867 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6248e6bf-60ad-4efb-b657-fdfe3c7dcb45 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:44.030695 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65742972-26c4-4448-8811-054ae8a6ddcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:44.031359 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65742972-26c4-4448-8811-054ae8a6ddcb admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:44.031637 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65742972-26c4-4448-8811-054ae8a6ddcb admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:44.031912 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65742972-26c4-4448-8811-054ae8a6ddcb admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:44.032709 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65742972-26c4-4448-8811-054ae8a6ddcb admin admin] RBAC: Adding query filter params (name=member) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:44.033014 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65742972-26c4-4448-8811-054ae8a6ddcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:44.034600 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65742972-26c4-4448-8811-054ae8a6ddcb admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:44.043611 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cb91a3-30a5-4fde-8187-d6ff31f60b55 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:44.051575 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 141/283] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Oct 12 18:04:44 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:44.054584 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cb91a3-30a5-4fde-8187-d6ff31f60b55 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:44.058685 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65742972-26c4-4448-8811-054ae8a6ddcb admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:44.071377 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1902151-71a1-4284-8aba-3be1c0c20b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:44.072313 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1902151-71a1-4284-8aba-3be1c0c20b72 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:44.072615 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1902151-71a1-4284-8aba-3be1c0c20b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:44.072886 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1902151-71a1-4284-8aba-3be1c0c20b72 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:44.088810 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65742972-26c4-4448-8811-054ae8a6ddcb admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:44.090315 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1902151-71a1-4284-8aba-3be1c0c20b72 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 18:04:44.101375 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695729a1-45ac-49d8-9d13-ead7930858aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:44.102257 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695729a1-45ac-49d8-9d13-ead7930858aa admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:44.102541 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695729a1-45ac-49d8-9d13-ead7930858aa admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:44.102886 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695729a1-45ac-49d8-9d13-ead7930858aa admin admin] PATH_INFO: `/v3/groups/7a4460e68178437ebc8e1571efa638e3` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:44.104736 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695729a1-45ac-49d8-9d13-ead7930858aa admin admin] RBAC: Authorizing `identity:get_group(group_id=7a4460e68178437ebc8e1571efa638e3)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:44.106583 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-e1902151-71a1-4284-8aba-3be1c0c20b72 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 18:04:44.108133 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 143/284] 10.222.0.18 () {56 vars in 1135 bytes} [Tue Oct 12 18:04:44 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 18:04:44.108848 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695729a1-45ac-49d8-9d13-ead7930858aa admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:44.110926 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 142/285] 10.222.0.18 () {56 vars in 1201 bytes} [Tue Oct 12 18:04:44 2021] GET /identity/v3/groups/7a4460e68178437ebc8e1571efa638e3 => generated 226 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:04:44.114789 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1902151-71a1-4284-8aba-3be1c0c20b72 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:44.120722 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695729a1-45ac-49d8-9d13-ead7930858aa admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:44.132220 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1902151-71a1-4284-8aba-3be1c0c20b72 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:44.136574 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695729a1-45ac-49d8-9d13-ead7930858aa admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:44.141480 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e8ef16-2fd3-4a87-a95a-c9be992c0550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:44.143217 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e8ef16-2fd3-4a87-a95a-c9be992c0550 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:44.143499 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e8ef16-2fd3-4a87-a95a-c9be992c0550 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:44.143777 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e8ef16-2fd3-4a87-a95a-c9be992c0550 admin admin] PATH_INFO: `/v3/projects/1065667c5e62410e8db95ee2e1b98135` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:44.145661 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eeff42-8459-415e-b464-5d30bf173cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:44.146527 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eeff42-8459-415e-b464-5d30bf173cec admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:44.147708 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eeff42-8459-415e-b464-5d30bf173cec admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:44.147987 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eeff42-8459-415e-b464-5d30bf173cec admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:44.148782 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eeff42-8459-415e-b464-5d30bf173cec admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:44.149302 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e8ef16-2fd3-4a87-a95a-c9be992c0550 admin admin] RBAC: Authorizing `identity:get_project(project_id=1065667c5e62410e8db95ee2e1b98135)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:44.150660 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eeff42-8459-415e-b464-5d30bf173cec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:44.153161 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e8ef16-2fd3-4a87-a95a-c9be992c0550 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:44.155436 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 143/286] 10.222.0.18 () {56 vars in 1207 bytes} [Tue Oct 12 18:04:44 2021] GET /identity/v3/projects/1065667c5e62410e8db95ee2e1b98135 => generated 298 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:44.155534 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eeff42-8459-415e-b464-5d30bf173cec admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:44.161585 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e8ef16-2fd3-4a87-a95a-c9be992c0550 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:44.173650 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 144/287] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Oct 12 18:04:44 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:04:44.177217 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e8ef16-2fd3-4a87-a95a-c9be992c0550 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:44.180124 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eeff42-8459-415e-b464-5d30bf173cec admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:44.190228 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65359497-e717-4d7d-bca5-860ea7fc0084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:44.192368 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65359497-e717-4d7d-bca5-860ea7fc0084 admin admin] REQUEST_METHOD: `PUT` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:44.192680 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65359497-e717-4d7d-bca5-860ea7fc0084 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:44.192954 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65359497-e717-4d7d-bca5-860ea7fc0084 admin admin] PATH_INFO: `/v3/projects/1065667c5e62410e8db95ee2e1b98135/groups/7a4460e68178437ebc8e1571efa638e3/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:44.196321 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eeff42-8459-415e-b464-5d30bf173cec admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:44.198237 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65359497-e717-4d7d-bca5-860ea7fc0084 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1065667c5e62410e8db95ee2e1b98135, group_id=7a4460e68178437ebc8e1571efa638e3, role_id=33b8a5a8d1d643f2a98f598e6ab0a1cf)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:44.202167 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65359497-e717-4d7d-bca5-860ea7fc0084 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:44.209878 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55fde41-6c06-4d48-ab95-a9314c7c40c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:44.210742 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55fde41-6c06-4d48-ab95-a9314c7c40c0 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:44.211121 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55fde41-6c06-4d48-ab95-a9314c7c40c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:44.211396 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55fde41-6c06-4d48-ab95-a9314c7c40c0 admin admin] PATH_INFO: `/v3/groups/7a4460e68178437ebc8e1571efa638e3` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:44.212773 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55fde41-6c06-4d48-ab95-a9314c7c40c0 admin admin] RBAC: Authorizing `identity:get_group(group_id=7a4460e68178437ebc8e1571efa638e3)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:44.214779 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55fde41-6c06-4d48-ab95-a9314c7c40c0 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:44.216817 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 145/288] 10.222.0.18 () {56 vars in 1201 bytes} [Tue Oct 12 18:04:44 2021] GET /identity/v3/groups/7a4460e68178437ebc8e1571efa638e3 => generated 226 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:44.222956 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55fde41-6c06-4d48-ab95-a9314c7c40c0 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:44.234575 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55fde41-6c06-4d48-ab95-a9314c7c40c0 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:44.239520 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba97692-f8d3-4900-92fd-d56367cbfe5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:44.240562 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba97692-f8d3-4900-92fd-d56367cbfe5d admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:44.241003 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba97692-f8d3-4900-92fd-d56367cbfe5d admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:44.241276 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba97692-f8d3-4900-92fd-d56367cbfe5d admin admin] PATH_INFO: `/v3/projects/1065667c5e62410e8db95ee2e1b98135` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:44.242591 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba97692-f8d3-4900-92fd-d56367cbfe5d admin admin] RBAC: Authorizing `identity:get_project(project_id=1065667c5e62410e8db95ee2e1b98135)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:44.245198 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba97692-f8d3-4900-92fd-d56367cbfe5d admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:44.247395 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 146/289] 10.222.0.18 () {56 vars in 1207 bytes} [Tue Oct 12 18:04:44 2021] GET /identity/v3/projects/1065667c5e62410e8db95ee2e1b98135 => generated 298 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:44.253382 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba97692-f8d3-4900-92fd-d56367cbfe5d admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:44.264075 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba97692-f8d3-4900-92fd-d56367cbfe5d admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:44.269329 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e20219-937b-4acb-a1ce-22c324342236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:44.273562 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e20219-937b-4acb-a1ce-22c324342236 admin admin] REQUEST_METHOD: `PUT` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:44.273562 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e20219-937b-4acb-a1ce-22c324342236 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:44.273562 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e20219-937b-4acb-a1ce-22c324342236 admin admin] PATH_INFO: `/v3/projects/1065667c5e62410e8db95ee2e1b98135/groups/7a4460e68178437ebc8e1571efa638e3/roles/17c81d2cd8f34ad49f4c495ecb2d982e` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:44.280442 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e20219-937b-4acb-a1ce-22c324342236 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1065667c5e62410e8db95ee2e1b98135, group_id=7a4460e68178437ebc8e1571efa638e3, role_id=17c81d2cd8f34ad49f4c495ecb2d982e)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:44.280442 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e20219-937b-4acb-a1ce-22c324342236 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:44.283359 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 144/290] 10.222.0.18 () {58 vars in 1463 bytes} [Tue Oct 12 18:04:44 2021] PUT /identity/v3/projects/1065667c5e62410e8db95ee2e1b98135/groups/7a4460e68178437ebc8e1571efa638e3/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 18:04:44.359105 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 147/291] 10.222.0.18 () {58 vars in 1463 bytes} [Tue Oct 12 18:04:44 2021] PUT /identity/v3/projects/1065667c5e62410e8db95ee2e1b98135/groups/7a4460e68178437ebc8e1571efa638e3/roles/17c81d2cd8f34ad49f4c495ecb2d982e => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:04:44.824370 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38215227-0868-428e-9be7-7fa576d64c54 None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:44.824752 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38215227-0868-428e-9be7-7fa576d64c54 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:44.824952 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38215227-0868-428e-9be7-7fa576d64c54 None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:44.826989 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 145/292] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:04:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:04:44.832821 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac37e503-0dc5-4fcb-8d6b-93121d094cb1 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:44.833113 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac37e503-0dc5-4fcb-8d6b-93121d094cb1 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:44.833395 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac37e503-0dc5-4fcb-8d6b-93121d094cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:44.853706 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-ac37e503-0dc5-4fcb-8d6b-93121d094cb1 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:04:44.855228 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-ac37e503-0dc5-4fcb-8d6b-93121d094cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:04:44.927953 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 148/293] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:04:44 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:04:44.956941 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38215227-0868-428e-9be7-7fa576d64c54 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:44.974051 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38215227-0868-428e-9be7-7fa576d64c54 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:44.983958 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d889300f-bd0f-4acb-ab05-ec2bd0e0a1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:44.984769 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d889300f-bd0f-4acb-ab05-ec2bd0e0a1ab admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:44.985048 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d889300f-bd0f-4acb-ab05-ec2bd0e0a1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:44.985318 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d889300f-bd0f-4acb-ab05-ec2bd0e0a1ab admin admin] PATH_INFO: `/v3/roles/member` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:45.000161 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d889300f-bd0f-4acb-ab05-ec2bd0e0a1ab admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 18:04:45.007237 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-d889300f-bd0f-4acb-ab05-ec2bd0e0a1ab admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 18:04:45.008789 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 146/294] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Oct 12 18:04:44 2021] GET /identity/v3/roles/member => generated 84 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:04:45.014736 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac37e503-0dc5-4fcb-8d6b-93121d094cb1 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:45.028426 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac37e503-0dc5-4fcb-8d6b-93121d094cb1 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:45.039742 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cfdff8-370b-49bf-877c-d5bc58ce35a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:45.040722 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cfdff8-370b-49bf-877c-d5bc58ce35a1 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:45.041218 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cfdff8-370b-49bf-877c-d5bc58ce35a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:45.041720 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cfdff8-370b-49bf-877c-d5bc58ce35a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:45.042697 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cfdff8-370b-49bf-877c-d5bc58ce35a1 admin admin] RBAC: Adding query filter params (name=member) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:45.043207 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cfdff8-370b-49bf-877c-d5bc58ce35a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:45.045042 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cfdff8-370b-49bf-877c-d5bc58ce35a1 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:45.059225 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 149/295] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Oct 12 18:04:45 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:45.060522 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d889300f-bd0f-4acb-ab05-ec2bd0e0a1ab admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:45.074479 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d889300f-bd0f-4acb-ab05-ec2bd0e0a1ab admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:45.083989 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04809f45-d686-4f26-a438-58bf795d2e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:45.084907 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04809f45-d686-4f26-a438-58bf795d2e26 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:45.085185 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04809f45-d686-4f26-a438-58bf795d2e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:45.097741 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04809f45-d686-4f26-a438-58bf795d2e26 admin admin] PATH_INFO: `/v3/groups/7a4460e68178437ebc8e1571efa638e3` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:45.097741 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04809f45-d686-4f26-a438-58bf795d2e26 admin admin] RBAC: Authorizing `identity:get_group(group_id=7a4460e68178437ebc8e1571efa638e3)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:45.097741 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04809f45-d686-4f26-a438-58bf795d2e26 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:45.097741 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 147/296] 10.222.0.18 () {56 vars in 1201 bytes} [Tue Oct 12 18:04:45 2021] GET /identity/v3/groups/7a4460e68178437ebc8e1571efa638e3 => generated 226 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:04:45.098389 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cfdff8-370b-49bf-877c-d5bc58ce35a1 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:45.109156 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cfdff8-370b-49bf-877c-d5bc58ce35a1 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:45.120685 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f48ad3c-fe0d-457a-8acc-ab4aaf78f9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:45.121898 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48ad3c-fe0d-457a-8acc-ab4aaf78f9cf admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:45.122346 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48ad3c-fe0d-457a-8acc-ab4aaf78f9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:45.122783 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48ad3c-fe0d-457a-8acc-ab4aaf78f9cf admin admin] PATH_INFO: `/v3/projects/d8f9072509b7489eba91457dfb47e439` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:45.125809 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f48ad3c-fe0d-457a-8acc-ab4aaf78f9cf admin admin] RBAC: Authorizing `identity:get_project(project_id=d8f9072509b7489eba91457dfb47e439)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:45.127121 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f48ad3c-fe0d-457a-8acc-ab4aaf78f9cf admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:45.128959 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 150/297] 10.222.0.18 () {56 vars in 1207 bytes} [Tue Oct 12 18:04:45 2021] GET /identity/v3/projects/d8f9072509b7489eba91457dfb47e439 => generated 302 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:45.136089 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04809f45-d686-4f26-a438-58bf795d2e26 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:45.150241 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04809f45-d686-4f26-a438-58bf795d2e26 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:45.160017 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26894cb8-21ff-4dd2-a44b-c8e4017e95d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:45.160959 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26894cb8-21ff-4dd2-a44b-c8e4017e95d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:45.161281 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26894cb8-21ff-4dd2-a44b-c8e4017e95d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:45.161551 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26894cb8-21ff-4dd2-a44b-c8e4017e95d2 admin admin] PATH_INFO: `/v3/projects/d8f9072509b7489eba91457dfb47e439/groups/7a4460e68178437ebc8e1571efa638e3/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:45.164043 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26894cb8-21ff-4dd2-a44b-c8e4017e95d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8f9072509b7489eba91457dfb47e439, group_id=7a4460e68178437ebc8e1571efa638e3, role_id=33b8a5a8d1d643f2a98f598e6ab0a1cf)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:45.166786 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26894cb8-21ff-4dd2-a44b-c8e4017e95d2 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:45.248526 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 148/298] 10.222.0.18 () {58 vars in 1463 bytes} [Tue Oct 12 18:04:45 2021] PUT /identity/v3/projects/d8f9072509b7489eba91457dfb47e439/groups/7a4460e68178437ebc8e1571efa638e3/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:04:45.471436 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab13179-00ef-4826-89df-c9e1e376bcaa None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:45.471723 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab13179-00ef-4826-89df-c9e1e376bcaa None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:45.472038 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab13179-00ef-4826-89df-c9e1e376bcaa None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:45.473981 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 151/299] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:04:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:04:45.480036 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c074ebb0-aecf-49d3-9822-db5b90a6f746 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:45.480334 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c074ebb0-aecf-49d3-9822-db5b90a6f746 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:45.480652 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c074ebb0-aecf-49d3-9822-db5b90a6f746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:45.504182 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-c074ebb0-aecf-49d3-9822-db5b90a6f746 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:04:45.505378 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-c074ebb0-aecf-49d3-9822-db5b90a6f746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:04:45.578772 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 149/300] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:04:45 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:04:45.608004 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab13179-00ef-4826-89df-c9e1e376bcaa None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:45.637731 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab13179-00ef-4826-89df-c9e1e376bcaa None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:45.642605 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b1572e-a541-4de1-96b2-a9ddc1d43082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:45.643445 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b1572e-a541-4de1-96b2-a9ddc1d43082 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:45.643727 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b1572e-a541-4de1-96b2-a9ddc1d43082 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:45.644002 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b1572e-a541-4de1-96b2-a9ddc1d43082 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:45.656371 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b1572e-a541-4de1-96b2-a9ddc1d43082 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 18:04:45.665999 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-b6b1572e-a541-4de1-96b2-a9ddc1d43082 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 18:04:45.667616 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 152/301] 10.222.0.18 () {56 vars in 1135 bytes} [Tue Oct 12 18:04:45 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:04:45.674632 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c074ebb0-aecf-49d3-9822-db5b90a6f746 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:45.684677 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c074ebb0-aecf-49d3-9822-db5b90a6f746 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:45.689214 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6b1a88-7b1b-4025-bfce-d40c40c4adc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:45.689932 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b1a88-7b1b-4025-bfce-d40c40c4adc4 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:45.690210 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b1a88-7b1b-4025-bfce-d40c40c4adc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:45.690483 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b1a88-7b1b-4025-bfce-d40c40c4adc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:45.691296 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6b1a88-7b1b-4025-bfce-d40c40c4adc4 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:45.691602 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6b1a88-7b1b-4025-bfce-d40c40c4adc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:45.693301 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6b1a88-7b1b-4025-bfce-d40c40c4adc4 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:45.702598 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 150/302] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Oct 12 18:04:45 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:45.708818 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b1572e-a541-4de1-96b2-a9ddc1d43082 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:45.720824 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b1572e-a541-4de1-96b2-a9ddc1d43082 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:45.726111 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfb3f1c-7c32-4108-ab9b-ab1c533853e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:45.727010 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb3f1c-7c32-4108-ab9b-ab1c533853e9 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:45.727292 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb3f1c-7c32-4108-ab9b-ab1c533853e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:45.727619 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb3f1c-7c32-4108-ab9b-ab1c533853e9 admin admin] PATH_INFO: `/v3/groups/7a4460e68178437ebc8e1571efa638e3` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:45.728903 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfb3f1c-7c32-4108-ab9b-ab1c533853e9 admin admin] RBAC: Authorizing `identity:get_group(group_id=7a4460e68178437ebc8e1571efa638e3)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:45.730878 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfb3f1c-7c32-4108-ab9b-ab1c533853e9 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:45.736522 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 153/303] 10.222.0.18 () {56 vars in 1201 bytes} [Tue Oct 12 18:04:45 2021] GET /identity/v3/groups/7a4460e68178437ebc8e1571efa638e3 => generated 226 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:45.739166 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6b1a88-7b1b-4025-bfce-d40c40c4adc4 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:45.749674 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6b1a88-7b1b-4025-bfce-d40c40c4adc4 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:45.754417 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1312978-1107-4bf1-aec1-cba596b13214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:45.755274 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1312978-1107-4bf1-aec1-cba596b13214 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:45.755599 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1312978-1107-4bf1-aec1-cba596b13214 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:45.755881 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1312978-1107-4bf1-aec1-cba596b13214 admin admin] PATH_INFO: `/v3/projects/d8f9072509b7489eba91457dfb47e439` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:45.757178 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1312978-1107-4bf1-aec1-cba596b13214 admin admin] RBAC: Authorizing `identity:get_project(project_id=d8f9072509b7489eba91457dfb47e439)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:45.759446 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1312978-1107-4bf1-aec1-cba596b13214 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:45.761428 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 151/304] 10.222.0.18 () {56 vars in 1207 bytes} [Tue Oct 12 18:04:45 2021] GET /identity/v3/projects/d8f9072509b7489eba91457dfb47e439 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:45.767940 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfb3f1c-7c32-4108-ab9b-ab1c533853e9 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:45.778900 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfb3f1c-7c32-4108-ab9b-ab1c533853e9 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:45.783530 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3634e84-0d32-48af-a39d-e6721dfad672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:45.784477 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3634e84-0d32-48af-a39d-e6721dfad672 admin admin] REQUEST_METHOD: `PUT` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:45.784815 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3634e84-0d32-48af-a39d-e6721dfad672 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:45.785090 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3634e84-0d32-48af-a39d-e6721dfad672 admin admin] PATH_INFO: `/v3/projects/d8f9072509b7489eba91457dfb47e439/groups/7a4460e68178437ebc8e1571efa638e3/roles/17c81d2cd8f34ad49f4c495ecb2d982e` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:45.787718 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3634e84-0d32-48af-a39d-e6721dfad672 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8f9072509b7489eba91457dfb47e439, group_id=7a4460e68178437ebc8e1571efa638e3, role_id=17c81d2cd8f34ad49f4c495ecb2d982e)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:45.790824 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3634e84-0d32-48af-a39d-e6721dfad672 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:45.792578 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e62217-f8c5-4cec-bc09-88b83837b914 None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:45.792956 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e62217-f8c5-4cec-bc09-88b83837b914 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:45.793235 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e62217-f8c5-4cec-bc09-88b83837b914 None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:45.794990 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 152/305] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:04:45 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 18:04:45.801761 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0914e9-f8da-4eea-b2d5-c6a1ae13c6e0 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:45.802048 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0914e9-f8da-4eea-b2d5-c6a1ae13c6e0 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:45.802324 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0914e9-f8da-4eea-b2d5-c6a1ae13c6e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:45.823241 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-5b0914e9-f8da-4eea-b2d5-c6a1ae13c6e0 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:04:45.824440 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-5b0914e9-f8da-4eea-b2d5-c6a1ae13c6e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:04:45.832915 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 153/306] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:04:45 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:04:45.858464 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0914e9-f8da-4eea-b2d5-c6a1ae13c6e0 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:45.869039 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0914e9-f8da-4eea-b2d5-c6a1ae13c6e0 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:45.874680 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73c0d09-111e-46d9-9554-ca3186f324f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:45.875529 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c0d09-111e-46d9-9554-ca3186f324f8 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:45.875816 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c0d09-111e-46d9-9554-ca3186f324f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:45.876145 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c0d09-111e-46d9-9554-ca3186f324f8 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:45.883864 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 154/307] 10.222.0.18 () {58 vars in 1463 bytes} [Tue Oct 12 18:04:45 2021] PUT /identity/v3/projects/d8f9072509b7489eba91457dfb47e439/groups/7a4460e68178437ebc8e1571efa638e3/roles/17c81d2cd8f34ad49f4c495ecb2d982e => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:04:45.892611 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73c0d09-111e-46d9-9554-ca3186f324f8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 18:04:45.900256 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-b73c0d09-111e-46d9-9554-ca3186f324f8 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 18:04:45.907139 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 154/308] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Oct 12 18:04:45 2021] GET /identity/v3/roles/admin => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 18:04:45.908051 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3634e84-0d32-48af-a39d-e6721dfad672 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:46.002087 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3634e84-0d32-48af-a39d-e6721dfad672 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:46.012049 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6277dc4e-d7c6-4004-aa53-97bb0b791c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:46.012774 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277dc4e-d7c6-4004-aa53-97bb0b791c69 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:46.013059 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277dc4e-d7c6-4004-aa53-97bb0b791c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:46.013337 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277dc4e-d7c6-4004-aa53-97bb0b791c69 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:46.014118 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6277dc4e-d7c6-4004-aa53-97bb0b791c69 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:46.014427 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6277dc4e-d7c6-4004-aa53-97bb0b791c69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:46.016322 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6277dc4e-d7c6-4004-aa53-97bb0b791c69 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:46.028688 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 155/309] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Oct 12 18:04:45 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:46.034944 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73c0d09-111e-46d9-9554-ca3186f324f8 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:46.050973 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73c0d09-111e-46d9-9554-ca3186f324f8 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:46.056962 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975e93dc-1d0c-4bbd-91c2-d5f2e8ccf41c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:46.057897 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e93dc-1d0c-4bbd-91c2-d5f2e8ccf41c admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:46.058179 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e93dc-1d0c-4bbd-91c2-d5f2e8ccf41c admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:46.058506 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e93dc-1d0c-4bbd-91c2-d5f2e8ccf41c admin admin] PATH_INFO: `/v3/groups/bc0dcc98220846e49e750ce0d992666a` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:46.065438 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975e93dc-1d0c-4bbd-91c2-d5f2e8ccf41c admin admin] RBAC: Authorizing `identity:get_group(group_id=bc0dcc98220846e49e750ce0d992666a)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:46.067409 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975e93dc-1d0c-4bbd-91c2-d5f2e8ccf41c admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:46.069222 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 155/310] 10.222.0.18 () {56 vars in 1201 bytes} [Tue Oct 12 18:04:46 2021] GET /identity/v3/groups/bc0dcc98220846e49e750ce0d992666a => generated 229 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:46.075610 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6277dc4e-d7c6-4004-aa53-97bb0b791c69 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:46.089886 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6277dc4e-d7c6-4004-aa53-97bb0b791c69 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:46.096953 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a363e6-74ef-4709-847c-c53047d7cf26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:46.098008 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a363e6-74ef-4709-847c-c53047d7cf26 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:46.098390 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a363e6-74ef-4709-847c-c53047d7cf26 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:46.098717 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a363e6-74ef-4709-847c-c53047d7cf26 admin admin] PATH_INFO: `/v3/projects/e340b2a295714eb294f0cebe48fde56d` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:46.101160 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a363e6-74ef-4709-847c-c53047d7cf26 admin admin] RBAC: Authorizing `identity:get_project(project_id=e340b2a295714eb294f0cebe48fde56d)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:46.103124 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a363e6-74ef-4709-847c-c53047d7cf26 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:46.106212 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 156/311] 10.222.0.18 () {56 vars in 1207 bytes} [Tue Oct 12 18:04:46 2021] GET /identity/v3/projects/e340b2a295714eb294f0cebe48fde56d => generated 344 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:46.111731 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975e93dc-1d0c-4bbd-91c2-d5f2e8ccf41c admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:46.126496 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975e93dc-1d0c-4bbd-91c2-d5f2e8ccf41c admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:46.135162 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4504db-7e88-4631-8640-1776b95f9164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:46.136066 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4504db-7e88-4631-8640-1776b95f9164 admin admin] REQUEST_METHOD: `PUT` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:46.136347 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4504db-7e88-4631-8640-1776b95f9164 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:46.136648 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4504db-7e88-4631-8640-1776b95f9164 admin admin] PATH_INFO: `/v3/projects/e340b2a295714eb294f0cebe48fde56d/groups/bc0dcc98220846e49e750ce0d992666a/roles/6c54f239944d46e3b027ccce97eb8b49` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:46.139907 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4504db-7e88-4631-8640-1776b95f9164 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e340b2a295714eb294f0cebe48fde56d, group_id=bc0dcc98220846e49e750ce0d992666a, role_id=6c54f239944d46e3b027ccce97eb8b49)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:46.142959 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4504db-7e88-4631-8640-1776b95f9164 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:46.236805 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 156/312] 10.222.0.18 () {58 vars in 1463 bytes} [Tue Oct 12 18:04:46 2021] PUT /identity/v3/projects/e340b2a295714eb294f0cebe48fde56d/groups/bc0dcc98220846e49e750ce0d992666a/roles/6c54f239944d46e3b027ccce97eb8b49 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:04:47.379150 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b3ed66-1c1d-4e76-a1c9-10c1a118cddd None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:47.379150 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b3ed66-1c1d-4e76-a1c9-10c1a118cddd None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:47.379150 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b3ed66-1c1d-4e76-a1c9-10c1a118cddd None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:47.379150 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 157/313] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:04:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:04:47.388308 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052534f2-08a8-498c-bd3c-07011350d6a2 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:47.388308 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052534f2-08a8-498c-bd3c-07011350d6a2 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:47.388308 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052534f2-08a8-498c-bd3c-07011350d6a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:47.408871 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-052534f2-08a8-498c-bd3c-07011350d6a2 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:04:47.410458 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-052534f2-08a8-498c-bd3c-07011350d6a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:04:47.472060 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 157/314] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:04:47 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:04:47.496990 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b3ed66-1c1d-4e76-a1c9-10c1a118cddd None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:47.509463 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b3ed66-1c1d-4e76-a1c9-10c1a118cddd None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:47.514016 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243802fb-f894-424f-8abd-511d3741c9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:47.515027 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243802fb-f894-424f-8abd-511d3741c9e9 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:47.515502 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243802fb-f894-424f-8abd-511d3741c9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:47.516250 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243802fb-f894-424f-8abd-511d3741c9e9 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:47.526541 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243802fb-f894-424f-8abd-511d3741c9e9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 18:04:47.533649 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-243802fb-f894-424f-8abd-511d3741c9e9 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 18:04:47.535311 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 158/315] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Oct 12 18:04:47 2021] GET /identity/v3/roles/member => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:04:47.542398 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052534f2-08a8-498c-bd3c-07011350d6a2 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:47.551818 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052534f2-08a8-498c-bd3c-07011350d6a2 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:47.557088 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c6901a-6c70-4ca7-907b-a26665158cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:47.558077 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c6901a-6c70-4ca7-907b-a26665158cce admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:47.558558 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c6901a-6c70-4ca7-907b-a26665158cce admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:47.559037 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c6901a-6c70-4ca7-907b-a26665158cce admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:47.559988 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c6901a-6c70-4ca7-907b-a26665158cce admin admin] RBAC: Adding query filter params (name=member) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:47.560518 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c6901a-6c70-4ca7-907b-a26665158cce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:47.562324 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c6901a-6c70-4ca7-907b-a26665158cce admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:47.571461 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 158/316] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Oct 12 18:04:47 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:47.578026 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243802fb-f894-424f-8abd-511d3741c9e9 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:47.588925 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243802fb-f894-424f-8abd-511d3741c9e9 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:47.593364 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c729e5-8324-4d9a-82f5-c8504add66d9 None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:47.593972 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c729e5-8324-4d9a-82f5-c8504add66d9 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:47.594441 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c729e5-8324-4d9a-82f5-c8504add66d9 None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:47.594750 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe5738c-0ce5-4304-8920-11b7dd6e0e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:47.595396 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5738c-0ce5-4304-8920-11b7dd6e0e59 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:47.595678 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5738c-0ce5-4304-8920-11b7dd6e0e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:47.595952 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5738c-0ce5-4304-8920-11b7dd6e0e59 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:47.597392 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 159/317] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:04:47 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 18:04:47.605307 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe5738c-0ce5-4304-8920-11b7dd6e0e59 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:47.606439 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b8c99-47b4-400f-b8dc-332489ca0e80 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:47.606933 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b8c99-47b4-400f-b8dc-332489ca0e80 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:47.607131 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe5738c-0ce5-4304-8920-11b7dd6e0e59 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:47.607643 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b8c99-47b4-400f-b8dc-332489ca0e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:47.623662 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 159/318] 10.222.0.18 () {58 vars in 1324 bytes} [Tue Oct 12 18:04:47 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:04:47.631956 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-da4b8c99-47b4-400f-b8dc-332489ca0e80 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:04:47.633436 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-da4b8c99-47b4-400f-b8dc-332489ca0e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:04:47.637594 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe5738c-0ce5-4304-8920-11b7dd6e0e59 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:47.643186 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 160/319] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:04:47 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:04:47.647797 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe5738c-0ce5-4304-8920-11b7dd6e0e59 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:47.652246 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4bc4dc-270b-4778-9c1a-fa8e4657ce7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:47.653123 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4bc4dc-270b-4778-9c1a-fa8e4657ce7e admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:47.653406 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4bc4dc-270b-4778-9c1a-fa8e4657ce7e admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:47.653678 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4bc4dc-270b-4778-9c1a-fa8e4657ce7e admin admin] PATH_INFO: `/v3/projects/1065667c5e62410e8db95ee2e1b98135` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:47.654872 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4bc4dc-270b-4778-9c1a-fa8e4657ce7e admin admin] RBAC: Authorizing `identity:get_project(project_id=1065667c5e62410e8db95ee2e1b98135)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:47.656990 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4bc4dc-270b-4778-9c1a-fa8e4657ce7e admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:47.658936 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 160/320] 10.222.0.18 () {56 vars in 1207 bytes} [Tue Oct 12 18:04:47 2021] GET /identity/v3/projects/1065667c5e62410e8db95ee2e1b98135 => generated 298 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:47.665604 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b8c99-47b4-400f-b8dc-332489ca0e80 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:47.675347 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b8c99-47b4-400f-b8dc-332489ca0e80 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:47.687591 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186661cd-0838-4833-afbc-e9f248351178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:47.688789 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186661cd-0838-4833-afbc-e9f248351178 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:47.689286 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186661cd-0838-4833-afbc-e9f248351178 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:47.689765 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186661cd-0838-4833-afbc-e9f248351178 admin admin] PATH_INFO: `/v3/groups/7a4460e68178437ebc8e1571efa638e3` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:47.691162 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186661cd-0838-4833-afbc-e9f248351178 admin admin] RBAC: Authorizing `identity:get_group(group_id=7a4460e68178437ebc8e1571efa638e3)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:47.693327 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186661cd-0838-4833-afbc-e9f248351178 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:47.695219 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 161/321] 10.222.0.18 () {56 vars in 1201 bytes} [Tue Oct 12 18:04:47 2021] GET /identity/v3/groups/7a4460e68178437ebc8e1571efa638e3 => generated 226 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:47.701753 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4bc4dc-270b-4778-9c1a-fa8e4657ce7e admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:47.704564 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186661cd-0838-4833-afbc-e9f248351178 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:47.715094 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186661cd-0838-4833-afbc-e9f248351178 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:47.717617 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4bc4dc-270b-4778-9c1a-fa8e4657ce7e admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:47.726283 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bec53d2-d021-40fd-ae5a-2b27a94da9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:47.727346 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec53d2-d021-40fd-ae5a-2b27a94da9fc admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:47.728277 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec53d2-d021-40fd-ae5a-2b27a94da9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:47.729558 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec53d2-d021-40fd-ae5a-2b27a94da9fc admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:47.731359 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3f0081-405c-45ef-b327-de4990181bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:47.733885 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f0081-405c-45ef-b327-de4990181bbf admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:47.734388 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f0081-405c-45ef-b327-de4990181bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:47.735582 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f0081-405c-45ef-b327-de4990181bbf admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:47.736650 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3f0081-405c-45ef-b327-de4990181bbf admin admin] RBAC: Adding query filter params (group.id=7a4460e68178437ebc8e1571efa638e3, role.id=33b8a5a8d1d643f2a98f598e6ab0a1cf, scope.project.id=1065667c5e62410e8db95ee2e1b98135) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:47.737177 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3f0081-405c-45ef-b327-de4990181bbf admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:47.739322 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3f0081-405c-45ef-b327-de4990181bbf admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:47.746606 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 161/322] 10.222.0.18 () {56 vars in 1397 bytes} [Tue Oct 12 18:04:47 2021] GET /identity/v3/role_assignments?group.id=7a4460e68178437ebc8e1571efa638e3&scope.project.id=1065667c5e62410e8db95ee2e1b98135&role.id=33b8a5a8d1d643f2a98f598e6ab0a1cf => generated 611 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:47.752513 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bec53d2-d021-40fd-ae5a-2b27a94da9fc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 18:04:47.764998 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-6bec53d2-d021-40fd-ae5a-2b27a94da9fc admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 18:04:47.766593 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 162/323] 10.222.0.18 () {56 vars in 1135 bytes} [Tue Oct 12 18:04:47 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 18:04:47.773882 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3f0081-405c-45ef-b327-de4990181bbf admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:47.790013 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3f0081-405c-45ef-b327-de4990181bbf admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:47.797340 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb51d653-f4ea-402c-af05-dc52acf54fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:47.798426 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb51d653-f4ea-402c-af05-dc52acf54fdf admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:47.798955 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb51d653-f4ea-402c-af05-dc52acf54fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:47.799504 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb51d653-f4ea-402c-af05-dc52acf54fdf admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:47.800585 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb51d653-f4ea-402c-af05-dc52acf54fdf admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:47.801121 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb51d653-f4ea-402c-af05-dc52acf54fdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:47.803593 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb51d653-f4ea-402c-af05-dc52acf54fdf admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:47.819049 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 162/324] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Oct 12 18:04:47 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:47.825480 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bec53d2-d021-40fd-ae5a-2b27a94da9fc admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:47.839854 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bec53d2-d021-40fd-ae5a-2b27a94da9fc admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:47.853103 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b901bef-c9a2-44fe-8ce3-f2eb225fd342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:47.853770 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b901bef-c9a2-44fe-8ce3-f2eb225fd342 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:47.854047 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b901bef-c9a2-44fe-8ce3-f2eb225fd342 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:47.854317 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b901bef-c9a2-44fe-8ce3-f2eb225fd342 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:47.869707 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b901bef-c9a2-44fe-8ce3-f2eb225fd342 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:47.871512 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b901bef-c9a2-44fe-8ce3-f2eb225fd342 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:47.887850 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 163/325] 10.222.0.18 () {58 vars in 1324 bytes} [Tue Oct 12 18:04:47 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:04:47.893373 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb51d653-f4ea-402c-af05-dc52acf54fdf admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:47.909767 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb51d653-f4ea-402c-af05-dc52acf54fdf admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:47.919476 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa81f591-a53b-4bd1-84bb-02f908c55118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:47.920714 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81f591-a53b-4bd1-84bb-02f908c55118 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:47.921261 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81f591-a53b-4bd1-84bb-02f908c55118 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:47.921763 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81f591-a53b-4bd1-84bb-02f908c55118 admin admin] PATH_INFO: `/v3/projects/1065667c5e62410e8db95ee2e1b98135` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:47.924532 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa81f591-a53b-4bd1-84bb-02f908c55118 admin admin] RBAC: Authorizing `identity:get_project(project_id=1065667c5e62410e8db95ee2e1b98135)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:47.926984 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa81f591-a53b-4bd1-84bb-02f908c55118 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:47.929839 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 163/326] 10.222.0.18 () {56 vars in 1207 bytes} [Tue Oct 12 18:04:47 2021] GET /identity/v3/projects/1065667c5e62410e8db95ee2e1b98135 => generated 298 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:47.935690 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b901bef-c9a2-44fe-8ce3-f2eb225fd342 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:47.945313 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b901bef-c9a2-44fe-8ce3-f2eb225fd342 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:47.956732 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92750baa-e647-48bb-9185-685359a87530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:47.957607 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92750baa-e647-48bb-9185-685359a87530 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:47.957890 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92750baa-e647-48bb-9185-685359a87530 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:47.958163 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92750baa-e647-48bb-9185-685359a87530 admin admin] PATH_INFO: `/v3/groups/7a4460e68178437ebc8e1571efa638e3` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:47.965344 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92750baa-e647-48bb-9185-685359a87530 admin admin] RBAC: Authorizing `identity:get_group(group_id=7a4460e68178437ebc8e1571efa638e3)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:47.967335 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92750baa-e647-48bb-9185-685359a87530 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:47.969148 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 164/327] 10.222.0.18 () {56 vars in 1201 bytes} [Tue Oct 12 18:04:47 2021] GET /identity/v3/groups/7a4460e68178437ebc8e1571efa638e3 => generated 226 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:47.976005 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa81f591-a53b-4bd1-84bb-02f908c55118 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:47.989827 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa81f591-a53b-4bd1-84bb-02f908c55118 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:47.998686 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0742c9d0-39ee-41c7-819b-22b093b42531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:47.999701 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0742c9d0-39ee-41c7-819b-22b093b42531 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:48.000228 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0742c9d0-39ee-41c7-819b-22b093b42531 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:48.000789 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0742c9d0-39ee-41c7-819b-22b093b42531 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:48.001840 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0742c9d0-39ee-41c7-819b-22b093b42531 admin admin] RBAC: Adding query filter params (group.id=7a4460e68178437ebc8e1571efa638e3, role.id=17c81d2cd8f34ad49f4c495ecb2d982e, scope.project.id=1065667c5e62410e8db95ee2e1b98135) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:48.002375 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0742c9d0-39ee-41c7-819b-22b093b42531 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:48.004545 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0742c9d0-39ee-41c7-819b-22b093b42531 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:48.017853 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 164/328] 10.222.0.18 () {56 vars in 1397 bytes} [Tue Oct 12 18:04:47 2021] GET /identity/v3/role_assignments?group.id=7a4460e68178437ebc8e1571efa638e3&scope.project.id=1065667c5e62410e8db95ee2e1b98135&role.id=17c81d2cd8f34ad49f4c495ecb2d982e => generated 611 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:48.249467 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c2e598-5d05-4575-9d43-7703b67f5357 None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:48.249806 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c2e598-5d05-4575-9d43-7703b67f5357 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:48.249984 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c2e598-5d05-4575-9d43-7703b67f5357 None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:48.251745 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 165/329] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:04:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:04:48.259658 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b7c3a2-1d8e-4bf5-989e-ebdf2aa4b364 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:48.259999 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b7c3a2-1d8e-4bf5-989e-ebdf2aa4b364 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:48.260285 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b7c3a2-1d8e-4bf5-989e-ebdf2aa4b364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:48.288707 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-18b7c3a2-1d8e-4bf5-989e-ebdf2aa4b364 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:04:48.289925 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-18b7c3a2-1d8e-4bf5-989e-ebdf2aa4b364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:04:48.298240 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 165/330] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:04:48 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:04:48.324232 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c2e598-5d05-4575-9d43-7703b67f5357 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:48.337307 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c2e598-5d05-4575-9d43-7703b67f5357 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:48.341722 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cb25e3-9355-4b78-aa3a-3c86d12143c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:48.342509 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb25e3-9355-4b78-aa3a-3c86d12143c3 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:48.342784 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb25e3-9355-4b78-aa3a-3c86d12143c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:48.343049 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb25e3-9355-4b78-aa3a-3c86d12143c3 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:48.356915 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cb25e3-9355-4b78-aa3a-3c86d12143c3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 18:04:48.366514 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-43cb25e3-9355-4b78-aa3a-3c86d12143c3 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 18:04:48.368041 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 166/331] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Oct 12 18:04:48 2021] GET /identity/v3/roles/member => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:04:48.375038 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b7c3a2-1d8e-4bf5-989e-ebdf2aa4b364 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:48.387277 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b7c3a2-1d8e-4bf5-989e-ebdf2aa4b364 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:48.393620 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082ddd24-ed67-4081-8713-be2335e26be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:48.394291 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ddd24-ed67-4081-8713-be2335e26be0 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:48.394567 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ddd24-ed67-4081-8713-be2335e26be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:48.394838 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ddd24-ed67-4081-8713-be2335e26be0 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:48.395598 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082ddd24-ed67-4081-8713-be2335e26be0 admin admin] RBAC: Adding query filter params (name=member) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:48.398162 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082ddd24-ed67-4081-8713-be2335e26be0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:48.399903 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082ddd24-ed67-4081-8713-be2335e26be0 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:48.410006 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 166/332] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Oct 12 18:04:48 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:04:48.416925 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cb25e3-9355-4b78-aa3a-3c86d12143c3 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:48.427355 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cb25e3-9355-4b78-aa3a-3c86d12143c3 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:48.432256 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c55d66e-a72d-4612-8098-df3709a03667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:48.433373 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c55d66e-a72d-4612-8098-df3709a03667 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:48.433854 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c55d66e-a72d-4612-8098-df3709a03667 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:48.434349 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c55d66e-a72d-4612-8098-df3709a03667 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:48.550299 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c55d66e-a72d-4612-8098-df3709a03667 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:48.552103 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c55d66e-a72d-4612-8098-df3709a03667 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:48.562311 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 167/333] 10.222.0.18 () {58 vars in 1324 bytes} [Tue Oct 12 18:04:48 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:04:48.568701 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082ddd24-ed67-4081-8713-be2335e26be0 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:48.579164 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082ddd24-ed67-4081-8713-be2335e26be0 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:48.586164 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76204ccd-9699-40ab-a0a2-5dcbdfd7e15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:48.587463 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76204ccd-9699-40ab-a0a2-5dcbdfd7e15e admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:48.587977 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76204ccd-9699-40ab-a0a2-5dcbdfd7e15e admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:48.588490 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76204ccd-9699-40ab-a0a2-5dcbdfd7e15e admin admin] PATH_INFO: `/v3/projects/d8f9072509b7489eba91457dfb47e439` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:48.590109 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76204ccd-9699-40ab-a0a2-5dcbdfd7e15e admin admin] RBAC: Authorizing `identity:get_project(project_id=d8f9072509b7489eba91457dfb47e439)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:48.592251 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76204ccd-9699-40ab-a0a2-5dcbdfd7e15e admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:48.594400 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 167/334] 10.222.0.18 () {56 vars in 1207 bytes} [Tue Oct 12 18:04:48 2021] GET /identity/v3/projects/d8f9072509b7489eba91457dfb47e439 => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:48.600872 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c55d66e-a72d-4612-8098-df3709a03667 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:48.610593 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c55d66e-a72d-4612-8098-df3709a03667 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:48.615861 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d06de2-f845-45d3-ac11-71bac7151f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:48.616813 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d06de2-f845-45d3-ac11-71bac7151f14 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:48.619738 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d06de2-f845-45d3-ac11-71bac7151f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:48.619738 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d06de2-f845-45d3-ac11-71bac7151f14 admin admin] PATH_INFO: `/v3/groups/7a4460e68178437ebc8e1571efa638e3` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:48.619738 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d06de2-f845-45d3-ac11-71bac7151f14 admin admin] RBAC: Authorizing `identity:get_group(group_id=7a4460e68178437ebc8e1571efa638e3)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:48.621132 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d06de2-f845-45d3-ac11-71bac7151f14 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:48.623079 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 168/335] 10.222.0.18 () {56 vars in 1201 bytes} [Tue Oct 12 18:04:48 2021] GET /identity/v3/groups/7a4460e68178437ebc8e1571efa638e3 => generated 226 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:48.629683 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76204ccd-9699-40ab-a0a2-5dcbdfd7e15e admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:48.643967 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76204ccd-9699-40ab-a0a2-5dcbdfd7e15e admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:48.648819 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a91ec95-cadd-409d-a1f6-50e00c99eea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:48.649669 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91ec95-cadd-409d-a1f6-50e00c99eea3 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:48.650192 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91ec95-cadd-409d-a1f6-50e00c99eea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:48.650652 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91ec95-cadd-409d-a1f6-50e00c99eea3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:48.651781 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a91ec95-cadd-409d-a1f6-50e00c99eea3 admin admin] RBAC: Adding query filter params (group.id=7a4460e68178437ebc8e1571efa638e3, role.id=33b8a5a8d1d643f2a98f598e6ab0a1cf, scope.project.id=d8f9072509b7489eba91457dfb47e439) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:48.652280 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a91ec95-cadd-409d-a1f6-50e00c99eea3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:48.654385 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a91ec95-cadd-409d-a1f6-50e00c99eea3 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:48.661404 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 168/336] 10.222.0.18 () {56 vars in 1397 bytes} [Tue Oct 12 18:04:48 2021] GET /identity/v3/role_assignments?group.id=7a4460e68178437ebc8e1571efa638e3&scope.project.id=d8f9072509b7489eba91457dfb47e439&role.id=33b8a5a8d1d643f2a98f598e6ab0a1cf => generated 611 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:48.729110 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d13d9-a70e-4eb8-ab0e-ff25f625a4c4 None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:48.729398 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d13d9-a70e-4eb8-ab0e-ff25f625a4c4 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:48.729676 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d13d9-a70e-4eb8-ab0e-ff25f625a4c4 None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:48.731788 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 169/337] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:04:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:04:48.738210 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a39c5-5481-47a5-90b0-0430e10df382 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:48.738812 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a39c5-5481-47a5-90b0-0430e10df382 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:48.739112 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a39c5-5481-47a5-90b0-0430e10df382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:48.761656 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-c97a39c5-5481-47a5-90b0-0430e10df382 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:04:48.762871 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-c97a39c5-5481-47a5-90b0-0430e10df382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:04:48.771352 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 169/338] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:04:48 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:04:48.796662 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84d13d9-a70e-4eb8-ab0e-ff25f625a4c4 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:48.809785 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84d13d9-a70e-4eb8-ab0e-ff25f625a4c4 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:48.814129 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fa455a-0b63-4b77-b915-e8933499c35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:48.814957 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa455a-0b63-4b77-b915-e8933499c35d admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:48.815238 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa455a-0b63-4b77-b915-e8933499c35d admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:48.815512 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa455a-0b63-4b77-b915-e8933499c35d admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:48.827102 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fa455a-0b63-4b77-b915-e8933499c35d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 18:04:48.834616 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-54fa455a-0b63-4b77-b915-e8933499c35d admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 18:04:48.836083 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 170/339] 10.222.0.18 () {56 vars in 1135 bytes} [Tue Oct 12 18:04:48 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:04:48.842549 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a39c5-5481-47a5-90b0-0430e10df382 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:48.852879 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a39c5-5481-47a5-90b0-0430e10df382 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:48.857594 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c35ac7-d4a8-4e2d-940a-94672efe9b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:48.858389 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c35ac7-d4a8-4e2d-940a-94672efe9b71 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:48.858742 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c35ac7-d4a8-4e2d-940a-94672efe9b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:48.859082 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c35ac7-d4a8-4e2d-940a-94672efe9b71 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:48.859939 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c35ac7-d4a8-4e2d-940a-94672efe9b71 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:48.860356 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c35ac7-d4a8-4e2d-940a-94672efe9b71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:48.862151 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c35ac7-d4a8-4e2d-940a-94672efe9b71 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:48.872381 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 170/340] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Oct 12 18:04:48 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:48.878669 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fa455a-0b63-4b77-b915-e8933499c35d admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:48.889315 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fa455a-0b63-4b77-b915-e8933499c35d admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:48.894232 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5f5957-4754-47b3-9420-734bfd96bec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:48.894874 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f5957-4754-47b3-9420-734bfd96bec1 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:48.895720 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f5957-4754-47b3-9420-734bfd96bec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:48.895720 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f5957-4754-47b3-9420-734bfd96bec1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:48.904050 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5f5957-4754-47b3-9420-734bfd96bec1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:48.905398 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5f5957-4754-47b3-9420-734bfd96bec1 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:48.914712 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 171/341] 10.222.0.18 () {58 vars in 1324 bytes} [Tue Oct 12 18:04:48 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:04:48.921012 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c35ac7-d4a8-4e2d-940a-94672efe9b71 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:48.930566 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c35ac7-d4a8-4e2d-940a-94672efe9b71 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:48.934974 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3017a6-f924-4b4a-bac7-54345ef4a66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:48.935810 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3017a6-f924-4b4a-bac7-54345ef4a66e admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:48.936089 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3017a6-f924-4b4a-bac7-54345ef4a66e admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:48.936361 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3017a6-f924-4b4a-bac7-54345ef4a66e admin admin] PATH_INFO: `/v3/projects/d8f9072509b7489eba91457dfb47e439` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:48.937577 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3017a6-f924-4b4a-bac7-54345ef4a66e admin admin] RBAC: Authorizing `identity:get_project(project_id=d8f9072509b7489eba91457dfb47e439)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:48.939610 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3017a6-f924-4b4a-bac7-54345ef4a66e admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:48.941662 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 171/342] 10.222.0.18 () {56 vars in 1207 bytes} [Tue Oct 12 18:04:48 2021] GET /identity/v3/projects/d8f9072509b7489eba91457dfb47e439 => generated 302 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:48.948579 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5f5957-4754-47b3-9420-734bfd96bec1 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:48.957607 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5f5957-4754-47b3-9420-734bfd96bec1 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:48.963346 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747dada7-f968-4776-b1ff-7f4b659c5571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:48.964186 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747dada7-f968-4776-b1ff-7f4b659c5571 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:48.965019 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747dada7-f968-4776-b1ff-7f4b659c5571 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:48.965019 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747dada7-f968-4776-b1ff-7f4b659c5571 admin admin] PATH_INFO: `/v3/groups/7a4460e68178437ebc8e1571efa638e3` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:48.967485 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747dada7-f968-4776-b1ff-7f4b659c5571 admin admin] RBAC: Authorizing `identity:get_group(group_id=7a4460e68178437ebc8e1571efa638e3)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:48.969430 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747dada7-f968-4776-b1ff-7f4b659c5571 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:48.971026 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 172/343] 10.222.0.18 () {56 vars in 1201 bytes} [Tue Oct 12 18:04:48 2021] GET /identity/v3/groups/7a4460e68178437ebc8e1571efa638e3 => generated 226 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:48.977911 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3017a6-f924-4b4a-bac7-54345ef4a66e admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:48.987997 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3017a6-f924-4b4a-bac7-54345ef4a66e admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:48.993077 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a00af33-a180-49e7-bdcf-c3ee32fdd618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:48.993724 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a00af33-a180-49e7-bdcf-c3ee32fdd618 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:48.994278 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a00af33-a180-49e7-bdcf-c3ee32fdd618 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:48.994566 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a00af33-a180-49e7-bdcf-c3ee32fdd618 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:48.995409 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a00af33-a180-49e7-bdcf-c3ee32fdd618 admin admin] RBAC: Adding query filter params (group.id=7a4460e68178437ebc8e1571efa638e3, role.id=17c81d2cd8f34ad49f4c495ecb2d982e, scope.project.id=d8f9072509b7489eba91457dfb47e439) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:48.995527 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4510c1-fdda-4699-92ad-26807891e8d6 None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:48.995726 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a00af33-a180-49e7-bdcf-c3ee32fdd618 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:48.995824 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4510c1-fdda-4699-92ad-26807891e8d6 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:48.996081 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4510c1-fdda-4699-92ad-26807891e8d6 None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:48.997621 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a00af33-a180-49e7-bdcf-c3ee32fdd618 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:48.999204 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 173/344] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:04:48 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 18:04:49.004054 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e77e8e2-664f-4451-ba0b-aa22d4c89d59 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:49.004568 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e77e8e2-664f-4451-ba0b-aa22d4c89d59 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:49.004675 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 172/345] 10.222.0.18 () {56 vars in 1397 bytes} [Tue Oct 12 18:04:48 2021] GET /identity/v3/role_assignments?group.id=7a4460e68178437ebc8e1571efa638e3&scope.project.id=d8f9072509b7489eba91457dfb47e439&role.id=17c81d2cd8f34ad49f4c495ecb2d982e => generated 611 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:49.004751 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e77e8e2-664f-4451-ba0b-aa22d4c89d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:49.024097 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-0e77e8e2-664f-4451-ba0b-aa22d4c89d59 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:04:49.025357 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-0e77e8e2-664f-4451-ba0b-aa22d4c89d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:04:49.033894 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 174/346] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:04:49 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:04:49.058931 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a00af33-a180-49e7-bdcf-c3ee32fdd618 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:49.070165 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a00af33-a180-49e7-bdcf-c3ee32fdd618 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:49.075088 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6951d06f-bd8a-421b-8d01-c5f40ecbf740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:49.075907 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951d06f-bd8a-421b-8d01-c5f40ecbf740 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:49.076190 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951d06f-bd8a-421b-8d01-c5f40ecbf740 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:49.076514 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951d06f-bd8a-421b-8d01-c5f40ecbf740 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:49.089012 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6951d06f-bd8a-421b-8d01-c5f40ecbf740 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 18:04:49.096336 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-6951d06f-bd8a-421b-8d01-c5f40ecbf740 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 18:04:49.098997 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 173/347] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Oct 12 18:04:49 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:04:49.104278 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e77e8e2-664f-4451-ba0b-aa22d4c89d59 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:49.113724 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e77e8e2-664f-4451-ba0b-aa22d4c89d59 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:49.118365 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6052c92c-ea5e-439a-847c-f9463d01ebe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:49.119064 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052c92c-ea5e-439a-847c-f9463d01ebe0 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:49.119344 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052c92c-ea5e-439a-847c-f9463d01ebe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:49.119619 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052c92c-ea5e-439a-847c-f9463d01ebe0 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:49.120442 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6052c92c-ea5e-439a-847c-f9463d01ebe0 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:49.120731 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6052c92c-ea5e-439a-847c-f9463d01ebe0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:49.122348 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6052c92c-ea5e-439a-847c-f9463d01ebe0 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:49.132090 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 175/348] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Oct 12 18:04:49 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:49.138660 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6951d06f-bd8a-421b-8d01-c5f40ecbf740 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:49.150073 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6951d06f-bd8a-421b-8d01-c5f40ecbf740 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:49.154647 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ebca7d-ccc8-415d-ba66-b2be22ecfa22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:49.155361 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ebca7d-ccc8-415d-ba66-b2be22ecfa22 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:49.155644 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ebca7d-ccc8-415d-ba66-b2be22ecfa22 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:49.155918 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ebca7d-ccc8-415d-ba66-b2be22ecfa22 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:49.164716 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ebca7d-ccc8-415d-ba66-b2be22ecfa22 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:49.166512 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ebca7d-ccc8-415d-ba66-b2be22ecfa22 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:49.176162 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 174/349] 10.222.0.18 () {58 vars in 1324 bytes} [Tue Oct 12 18:04:49 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:04:49.183358 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6052c92c-ea5e-439a-847c-f9463d01ebe0 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:49.193318 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6052c92c-ea5e-439a-847c-f9463d01ebe0 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:49.198312 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d0138f-ae0d-4f09-905e-e3f39876e241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:49.199180 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0138f-ae0d-4f09-905e-e3f39876e241 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:49.199458 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0138f-ae0d-4f09-905e-e3f39876e241 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:49.199729 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0138f-ae0d-4f09-905e-e3f39876e241 admin admin] PATH_INFO: `/v3/projects/e340b2a295714eb294f0cebe48fde56d` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:49.200975 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d0138f-ae0d-4f09-905e-e3f39876e241 admin admin] RBAC: Authorizing `identity:get_project(project_id=e340b2a295714eb294f0cebe48fde56d)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:49.202786 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d0138f-ae0d-4f09-905e-e3f39876e241 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:49.204501 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 176/350] 10.222.0.18 () {56 vars in 1207 bytes} [Tue Oct 12 18:04:49 2021] GET /identity/v3/projects/e340b2a295714eb294f0cebe48fde56d => generated 344 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:49.210685 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ebca7d-ccc8-415d-ba66-b2be22ecfa22 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:49.219826 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ebca7d-ccc8-415d-ba66-b2be22ecfa22 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:49.224214 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e8de65-a30f-487b-8fa1-01f5f2f53ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:49.225112 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e8de65-a30f-487b-8fa1-01f5f2f53ee8 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:49.225813 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e8de65-a30f-487b-8fa1-01f5f2f53ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:49.225813 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e8de65-a30f-487b-8fa1-01f5f2f53ee8 admin admin] PATH_INFO: `/v3/groups/bc0dcc98220846e49e750ce0d992666a` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:49.226810 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e8de65-a30f-487b-8fa1-01f5f2f53ee8 admin admin] RBAC: Authorizing `identity:get_group(group_id=bc0dcc98220846e49e750ce0d992666a)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:49.228750 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e8de65-a30f-487b-8fa1-01f5f2f53ee8 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:49.230319 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 175/351] 10.222.0.18 () {56 vars in 1201 bytes} [Tue Oct 12 18:04:49 2021] GET /identity/v3/groups/bc0dcc98220846e49e750ce0d992666a => generated 229 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:49.236793 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d0138f-ae0d-4f09-905e-e3f39876e241 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:49.247232 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d0138f-ae0d-4f09-905e-e3f39876e241 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:49.251635 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e615575b-5e16-41b0-9c2a-32be6d9f2dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:49.252284 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e615575b-5e16-41b0-9c2a-32be6d9f2dd5 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:49.252588 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e615575b-5e16-41b0-9c2a-32be6d9f2dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:49.252867 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e615575b-5e16-41b0-9c2a-32be6d9f2dd5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:49.253703 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e615575b-5e16-41b0-9c2a-32be6d9f2dd5 admin admin] RBAC: Adding query filter params (group.id=bc0dcc98220846e49e750ce0d992666a, role.id=6c54f239944d46e3b027ccce97eb8b49, scope.project.id=e340b2a295714eb294f0cebe48fde56d) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:49.254012 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e615575b-5e16-41b0-9c2a-32be6d9f2dd5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:49.255848 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e615575b-5e16-41b0-9c2a-32be6d9f2dd5 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:49.262232 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 177/352] 10.222.0.18 () {56 vars in 1397 bytes} [Tue Oct 12 18:04:49 2021] GET /identity/v3/role_assignments?group.id=bc0dcc98220846e49e750ce0d992666a&scope.project.id=e340b2a295714eb294f0cebe48fde56d&role.id=6c54f239944d46e3b027ccce97eb8b49 => generated 611 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:52.100509 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f87675-5fcc-435f-8483-fceb830abb63 None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:52.101640 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f87675-5fcc-435f-8483-fceb830abb63 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:52.102136 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f87675-5fcc-435f-8483-fceb830abb63 None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:52.104624 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 176/353] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:04:52 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:04:52.112030 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f102b-c29e-469b-b2c0-c946e19f7887 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:52.113104 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f102b-c29e-469b-b2c0-c946e19f7887 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:52.113611 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f102b-c29e-469b-b2c0-c946e19f7887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:52.137883 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-9c5f102b-c29e-469b-b2c0-c946e19f7887 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:04:52.139450 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-9c5f102b-c29e-469b-b2c0-c946e19f7887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:04:52.151587 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 178/354] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:04:52 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:04:52.193092 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f87675-5fcc-435f-8483-fceb830abb63 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:52.210540 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f87675-5fcc-435f-8483-fceb830abb63 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:52.217975 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015feaee-aff2-4c42-8226-8b1167ac90a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:52.219056 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015feaee-aff2-4c42-8226-8b1167ac90a0 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:52.219571 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015feaee-aff2-4c42-8226-8b1167ac90a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:52.220301 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015feaee-aff2-4c42-8226-8b1167ac90a0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:52.235928 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015feaee-aff2-4c42-8226-8b1167ac90a0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:52.238141 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015feaee-aff2-4c42-8226-8b1167ac90a0 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:52.256006 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f68a20e-a597-4b7c-9a3a-b7a6cd85c952 None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:52.256675 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f68a20e-a597-4b7c-9a3a-b7a6cd85c952 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:52.257153 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f68a20e-a597-4b7c-9a3a-b7a6cd85c952 None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:52.259497 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 179/355] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:04:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:04:52.267730 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1deb6d-4369-4432-befe-901f4a698c78 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:52.268298 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1deb6d-4369-4432-befe-901f4a698c78 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:52.268817 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1deb6d-4369-4432-befe-901f4a698c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:52.275517 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-015feaee-aff2-4c42-8226-8b1167ac90a0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 18:04:52.279481 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 177/356] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:04:52 2021] GET /identity/v3/domains/Default => generated 87 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:04:52.294021 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015feaee-aff2-4c42-8226-8b1167ac90a0 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:52.306944 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-5a1deb6d-4369-4432-befe-901f4a698c78 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:04:52.311463 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-5a1deb6d-4369-4432-befe-901f4a698c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:04:52.313079 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015feaee-aff2-4c42-8226-8b1167ac90a0 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:52.326013 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea4a0fe-0b5e-461c-b2bd-efc84e8a26b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:52.327046 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4a0fe-0b5e-461c-b2bd-efc84e8a26b4 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:52.327551 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4a0fe-0b5e-461c-b2bd-efc84e8a26b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:52.328036 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4a0fe-0b5e-461c-b2bd-efc84e8a26b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:52.329565 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea4a0fe-0b5e-461c-b2bd-efc84e8a26b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:52.331038 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 180/357] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:04:52 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:04:52.331585 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea4a0fe-0b5e-461c-b2bd-efc84e8a26b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:52.333472 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea4a0fe-0b5e-461c-b2bd-efc84e8a26b4 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:52.346347 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 178/358] 10.222.0.18 () {56 vars in 1130 bytes} [Tue Oct 12 18:04:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:52.353042 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1deb6d-4369-4432-befe-901f4a698c78 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:52.363365 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1deb6d-4369-4432-befe-901f4a698c78 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:52.371358 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea67910-d531-4907-b957-5db14d1ebb8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:52.372337 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea67910-d531-4907-b957-5db14d1ebb8b admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:52.372877 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea67910-d531-4907-b957-5db14d1ebb8b admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:52.373363 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea67910-d531-4907-b957-5db14d1ebb8b admin admin] PATH_INFO: `/v3/users` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:52.374307 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea67910-d531-4907-b957-5db14d1ebb8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:52.376474 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea67910-d531-4907-b957-5db14d1ebb8b admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:52.379360 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea4a0fe-0b5e-461c-b2bd-efc84e8a26b4 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:52.390148 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea4a0fe-0b5e-461c-b2bd-efc84e8a26b4 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:52.403033 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289fe3f4-1eb9-4113-9125-0426d91e3aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:52.403834 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289fe3f4-1eb9-4113-9125-0426d91e3aa5 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:52.404118 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289fe3f4-1eb9-4113-9125-0426d91e3aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:52.404412 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289fe3f4-1eb9-4113-9125-0426d91e3aa5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:52.419355 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289fe3f4-1eb9-4113-9125-0426d91e3aa5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:52.421282 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289fe3f4-1eb9-4113-9125-0426d91e3aa5 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:52.442566 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-289fe3f4-1eb9-4113-9125-0426d91e3aa5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 18:04:52.444247 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 179/359] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:04:52 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:04:52.450538 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289fe3f4-1eb9-4113-9125-0426d91e3aa5 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:52.466110 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 181/360] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Oct 12 18:04:52 2021] POST /identity/v3/users => generated 246 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:04:52.470032 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289fe3f4-1eb9-4113-9125-0426d91e3aa5 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:52.480983 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a32a7d2-fdce-4956-ae2e-ea42b5b43082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:52.481664 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a32a7d2-fdce-4956-ae2e-ea42b5b43082 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:52.481942 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a32a7d2-fdce-4956-ae2e-ea42b5b43082 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:52.482212 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a32a7d2-fdce-4956-ae2e-ea42b5b43082 admin admin] PATH_INFO: `/v3/domains` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:52.482958 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a32a7d2-fdce-4956-ae2e-ea42b5b43082 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:52.483260 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a32a7d2-fdce-4956-ae2e-ea42b5b43082 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:52.484981 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a32a7d2-fdce-4956-ae2e-ea42b5b43082 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:52.510414 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 180/361] 10.222.0.18 () {56 vars in 1130 bytes} [Tue Oct 12 18:04:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:04:52.517459 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea67910-d531-4907-b957-5db14d1ebb8b admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:52.539341 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea67910-d531-4907-b957-5db14d1ebb8b admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:52.561325 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e402f04b-498d-4481-8983-1d638de99192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:52.562029 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402f04b-498d-4481-8983-1d638de99192 admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:52.562312 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402f04b-498d-4481-8983-1d638de99192 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:52.562589 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402f04b-498d-4481-8983-1d638de99192 admin admin] PATH_INFO: `/v3/users` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:52.563332 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e402f04b-498d-4481-8983-1d638de99192 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:52.565330 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e402f04b-498d-4481-8983-1d638de99192 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:52.677260 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 182/362] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Oct 12 18:04:52 2021] POST /identity/v3/users => generated 248 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:04:52.682445 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b5ad3-ae53-4b47-bd0d-014f01dfc8fc None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:52.682828 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b5ad3-ae53-4b47-bd0d-014f01dfc8fc None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:52.683011 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b5ad3-ae53-4b47-bd0d-014f01dfc8fc None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:52.684995 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 181/363] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:04:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:04:52.691939 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88377fc0-6f97-4594-985b-c78c120487c9 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:52.692277 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88377fc0-6f97-4594-985b-c78c120487c9 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:52.692680 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88377fc0-6f97-4594-985b-c78c120487c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:52.721782 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-88377fc0-6f97-4594-985b-c78c120487c9 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:04:52.723214 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-88377fc0-6f97-4594-985b-c78c120487c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:04:52.732662 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 183/364] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:04:52 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:04:52.758733 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810b5ad3-ae53-4b47-bd0d-014f01dfc8fc None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:52.776415 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810b5ad3-ae53-4b47-bd0d-014f01dfc8fc None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:52.781001 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230b1720-8ab6-43f3-9241-737c2e657542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:52.781810 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b1720-8ab6-43f3-9241-737c2e657542 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:52.782090 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b1720-8ab6-43f3-9241-737c2e657542 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:52.782363 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b1720-8ab6-43f3-9241-737c2e657542 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:52.794247 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230b1720-8ab6-43f3-9241-737c2e657542 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:52.796143 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230b1720-8ab6-43f3-9241-737c2e657542 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:52.814099 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-230b1720-8ab6-43f3-9241-737c2e657542 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 18:04:52.815720 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 182/365] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:04:52 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:04:52.822357 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88377fc0-6f97-4594-985b-c78c120487c9 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:52.827795 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec67937-07e3-4213-99a2-0d585aed2c53 None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:52.828072 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec67937-07e3-4213-99a2-0d585aed2c53 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:52.828346 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec67937-07e3-4213-99a2-0d585aed2c53 None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:52.830462 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 183/366] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:04:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 18:04:52.832725 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88377fc0-6f97-4594-985b-c78c120487c9 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:52.837308 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61faca59-e1c8-40fa-8504-bb191845a17a None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:52.837582 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61faca59-e1c8-40fa-8504-bb191845a17a None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:52.837860 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61faca59-e1c8-40fa-8504-bb191845a17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:52.839502 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869bc789-a30b-4f34-a4b4-c02670f8040b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:52.840457 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869bc789-a30b-4f34-a4b4-c02670f8040b admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:52.840941 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869bc789-a30b-4f34-a4b4-c02670f8040b admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:52.841413 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869bc789-a30b-4f34-a4b4-c02670f8040b admin admin] PATH_INFO: `/v3/domains` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:52.842352 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869bc789-a30b-4f34-a4b4-c02670f8040b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:52.842863 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869bc789-a30b-4f34-a4b4-c02670f8040b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:52.844081 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING py.warnings [None req-869bc789-a30b-4f34-a4b4-c02670f8040b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:04:52.844081 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: warnings.warn(msg) Oct 12 18:04:52.844081 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: Oct 12 18:04:52.845912 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869bc789-a30b-4f34-a4b4-c02670f8040b admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:52.858449 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-61faca59-e1c8-40fa-8504-bb191845a17a None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:04:52.859764 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-61faca59-e1c8-40fa-8504-bb191845a17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:04:52.866237 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 184/367] 10.222.0.18 () {56 vars in 1130 bytes} [Tue Oct 12 18:04:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:04:52.869387 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 184/368] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:04:52 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:04:52.872113 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869bc789-a30b-4f34-a4b4-c02670f8040b admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:52.883157 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869bc789-a30b-4f34-a4b4-c02670f8040b admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:52.888164 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a323956-18d6-4047-bba5-5fc32f37909e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:52.889147 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a323956-18d6-4047-bba5-5fc32f37909e admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:52.889621 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a323956-18d6-4047-bba5-5fc32f37909e admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:52.890036 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a323956-18d6-4047-bba5-5fc32f37909e admin admin] PATH_INFO: `/v3/users` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:52.891234 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a323956-18d6-4047-bba5-5fc32f37909e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:52.893434 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a323956-18d6-4047-bba5-5fc32f37909e admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:52.898895 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61faca59-e1c8-40fa-8504-bb191845a17a None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:52.909235 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61faca59-e1c8-40fa-8504-bb191845a17a None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:52.914708 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270c993b-d984-4fc1-9479-7654b9cf7ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:52.915573 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c993b-d984-4fc1-9479-7654b9cf7ad6 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:52.915854 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c993b-d984-4fc1-9479-7654b9cf7ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:52.916124 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c993b-d984-4fc1-9479-7654b9cf7ad6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:52.930426 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270c993b-d984-4fc1-9479-7654b9cf7ad6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:52.932520 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270c993b-d984-4fc1-9479-7654b9cf7ad6 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:52.950802 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-270c993b-d984-4fc1-9479-7654b9cf7ad6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 18:04:52.952008 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 185/369] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:04:52 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 18:04:52.958374 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270c993b-d984-4fc1-9479-7654b9cf7ad6 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:52.968343 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270c993b-d984-4fc1-9479-7654b9cf7ad6 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:52.972812 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f86e5-20a5-4514-a64d-fd290b453afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:52.973465 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f86e5-20a5-4514-a64d-fd290b453afb admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:52.973742 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f86e5-20a5-4514-a64d-fd290b453afb admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:52.974010 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f86e5-20a5-4514-a64d-fd290b453afb admin admin] PATH_INFO: `/v3/domains` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:52.974775 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2f86e5-20a5-4514-a64d-fd290b453afb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:52.975072 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2f86e5-20a5-4514-a64d-fd290b453afb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:52.976696 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2f86e5-20a5-4514-a64d-fd290b453afb admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:52.988113 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 186/370] 10.222.0.18 () {56 vars in 1130 bytes} [Tue Oct 12 18:04:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:52.994588 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f86e5-20a5-4514-a64d-fd290b453afb admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:53.004236 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f86e5-20a5-4514-a64d-fd290b453afb admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:53.006708 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 185/371] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Oct 12 18:04:52 2021] POST /identity/v3/users => generated 248 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 18:04:53.011600 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4381f35b-4a2b-418e-93e0-d2df6e1e8b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:53.012615 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4381f35b-4a2b-418e-93e0-d2df6e1e8b8e admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:53.012750 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4381f35b-4a2b-418e-93e0-d2df6e1e8b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:53.013128 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4381f35b-4a2b-418e-93e0-d2df6e1e8b8e admin admin] PATH_INFO: `/v3/users` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:53.013968 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4381f35b-4a2b-418e-93e0-d2df6e1e8b8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:53.016308 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4381f35b-4a2b-418e-93e0-d2df6e1e8b8e admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:53.112114 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 187/372] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Oct 12 18:04:52 2021] POST /identity/v3/users => generated 249 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:04:53.578450 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c6722-bd49-41e4-8dce-5e4ea6f6b19b None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:53.578958 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c6722-bd49-41e4-8dce-5e4ea6f6b19b None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:53.579052 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c6722-bd49-41e4-8dce-5e4ea6f6b19b None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:53.581050 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 186/373] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:04:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:04:53.587009 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe716f6-2dd1-4b3f-9670-013333de5a31 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:53.587293 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe716f6-2dd1-4b3f-9670-013333de5a31 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:53.587561 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe716f6-2dd1-4b3f-9670-013333de5a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:53.613704 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-ffe716f6-2dd1-4b3f-9670-013333de5a31 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:04:53.614917 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-ffe716f6-2dd1-4b3f-9670-013333de5a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:04:53.626863 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 188/374] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:04:53 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:04:53.662347 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934c6722-bd49-41e4-8dce-5e4ea6f6b19b None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:53.681711 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934c6722-bd49-41e4-8dce-5e4ea6f6b19b None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:53.686151 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef9ed1-d02b-4fe8-81a8-403edafa6222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:53.686856 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef9ed1-d02b-4fe8-81a8-403edafa6222 admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:53.687138 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef9ed1-d02b-4fe8-81a8-403edafa6222 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:53.687407 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef9ed1-d02b-4fe8-81a8-403edafa6222 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:53.688218 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fef9ed1-d02b-4fe8-81a8-403edafa6222 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:53.689836 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fef9ed1-d02b-4fe8-81a8-403edafa6222 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:53.728002 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.sql.core [None req-9fef9ed1-d02b-4fe8-81a8-403edafa6222 admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 12 18:04:53.728002 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 12 18:04:53.728002 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [parameters: {'id': '25d35ae298e045caa39e24f952d9339a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 12 18:04:53.728002 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=74006) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 12 18:04:53.743348 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-9fef9ed1-d02b-4fe8-81a8-403edafa6222 admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 12 18:04:53.748849 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 187/375] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:04:53 2021] POST /identity/v3/roles => generated 144 bytes in 87 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:04:53.755462 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe716f6-2dd1-4b3f-9670-013333de5a31 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:53.769604 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe716f6-2dd1-4b3f-9670-013333de5a31 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:53.780071 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ce7ff-9b33-4300-b261-d1576b7d309a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:53.781168 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ce7ff-9b33-4300-b261-d1576b7d309a admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:53.781652 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ce7ff-9b33-4300-b261-d1576b7d309a admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:53.782149 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ce7ff-9b33-4300-b261-d1576b7d309a admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:53.797263 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366ce7ff-9b33-4300-b261-d1576b7d309a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 18:04:53.805373 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-366ce7ff-9b33-4300-b261-d1576b7d309a admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 18:04:53.806775 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 189/376] 10.222.0.18 () {56 vars in 1135 bytes} [Tue Oct 12 18:04:53 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:04:53.813163 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef9ed1-d02b-4fe8-81a8-403edafa6222 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:53.825547 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef9ed1-d02b-4fe8-81a8-403edafa6222 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:53.836983 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686ac451-6e18-4987-8015-bc30aa5d4a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:53.837595 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ac451-6e18-4987-8015-bc30aa5d4a1a admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:53.837879 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ac451-6e18-4987-8015-bc30aa5d4a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:53.838153 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ac451-6e18-4987-8015-bc30aa5d4a1a admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:53.838924 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686ac451-6e18-4987-8015-bc30aa5d4a1a admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:53.839230 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686ac451-6e18-4987-8015-bc30aa5d4a1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:53.840883 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686ac451-6e18-4987-8015-bc30aa5d4a1a admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:53.851703 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 188/377] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Oct 12 18:04:53 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:55.282033 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df415cf-f4f4-4026-809a-6aba68420ee6 None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:55.282548 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df415cf-f4f4-4026-809a-6aba68420ee6 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:55.282548 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df415cf-f4f4-4026-809a-6aba68420ee6 None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:55.284681 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 190/378] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:04:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:04:55.290723 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a410e8-5574-4ddd-bf5d-1857ea239336 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:55.291134 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a410e8-5574-4ddd-bf5d-1857ea239336 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:55.291319 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a410e8-5574-4ddd-bf5d-1857ea239336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:55.310172 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-f6a410e8-5574-4ddd-bf5d-1857ea239336 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:04:55.311362 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-f6a410e8-5574-4ddd-bf5d-1857ea239336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:04:55.319640 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 189/379] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:04:55 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:04:55.343578 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df415cf-f4f4-4026-809a-6aba68420ee6 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:55.355916 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df415cf-f4f4-4026-809a-6aba68420ee6 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:55.360348 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1446a2df-d02e-45ce-ac19-a0187992a352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:55.361197 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1446a2df-d02e-45ce-ac19-a0187992a352 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:55.361478 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1446a2df-d02e-45ce-ac19-a0187992a352 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:55.361753 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1446a2df-d02e-45ce-ac19-a0187992a352 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:55.374920 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1446a2df-d02e-45ce-ac19-a0187992a352 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 18:04:55.382618 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-1446a2df-d02e-45ce-ac19-a0187992a352 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 18:04:55.388510 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 191/380] 10.222.0.18 () {56 vars in 1123 bytes} [Tue Oct 12 18:04:55 2021] GET /identity/v3/roles/service => generated 85 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:04:55.390666 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a410e8-5574-4ddd-bf5d-1857ea239336 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:55.400133 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a410e8-5574-4ddd-bf5d-1857ea239336 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:55.404943 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeae04a-87b1-4058-91fe-c58d9070a1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:55.405623 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeae04a-87b1-4058-91fe-c58d9070a1b4 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:55.405904 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeae04a-87b1-4058-91fe-c58d9070a1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:55.406176 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeae04a-87b1-4058-91fe-c58d9070a1b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:55.406944 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeae04a-87b1-4058-91fe-c58d9070a1b4 admin admin] RBAC: Adding query filter params (name=service) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:55.407252 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeae04a-87b1-4058-91fe-c58d9070a1b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:55.408895 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeae04a-87b1-4058-91fe-c58d9070a1b4 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:55.423421 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 190/381] 10.222.0.18 () {56 vars in 1124 bytes} [Tue Oct 12 18:04:55 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:55.424804 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1446a2df-d02e-45ce-ac19-a0187992a352 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:55.435680 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1446a2df-d02e-45ce-ac19-a0187992a352 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:55.440386 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce67eb48-da7c-4a7d-ab6a-6fc42d46e9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:55.441225 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67eb48-da7c-4a7d-ab6a-6fc42d46e9fe admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:55.441505 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67eb48-da7c-4a7d-ab6a-6fc42d46e9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:55.441779 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67eb48-da7c-4a7d-ab6a-6fc42d46e9fe admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:55.465613 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce67eb48-da7c-4a7d-ab6a-6fc42d46e9fe admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:55.467483 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce67eb48-da7c-4a7d-ab6a-6fc42d46e9fe admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:55.486928 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-ce67eb48-da7c-4a7d-ab6a-6fc42d46e9fe admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 18:04:55.488809 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 192/382] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:04:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:04:55.495388 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeae04a-87b1-4058-91fe-c58d9070a1b4 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:55.513463 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeae04a-87b1-4058-91fe-c58d9070a1b4 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:55.522977 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d78046-1d97-4735-a06a-c31d058ae823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:55.523651 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d78046-1d97-4735-a06a-c31d058ae823 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:55.523929 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d78046-1d97-4735-a06a-c31d058ae823 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:55.524198 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d78046-1d97-4735-a06a-c31d058ae823 admin admin] PATH_INFO: `/v3/domains` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:55.524962 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d78046-1d97-4735-a06a-c31d058ae823 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:55.525268 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d78046-1d97-4735-a06a-c31d058ae823 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:55.526879 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d78046-1d97-4735-a06a-c31d058ae823 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:55.549859 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 191/383] 10.222.0.18 () {56 vars in 1130 bytes} [Tue Oct 12 18:04:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:55.555944 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce67eb48-da7c-4a7d-ab6a-6fc42d46e9fe admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:55.570334 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce67eb48-da7c-4a7d-ab6a-6fc42d46e9fe admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:55.576362 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a590bf1-3b6d-47d1-ba11-45b5e1e86bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:55.577210 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a590bf1-3b6d-47d1-ba11-45b5e1e86bc1 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:55.577489 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a590bf1-3b6d-47d1-ba11-45b5e1e86bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:55.577762 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a590bf1-3b6d-47d1-ba11-45b5e1e86bc1 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:55.592437 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a590bf1-3b6d-47d1-ba11-45b5e1e86bc1 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:55.594483 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a590bf1-3b6d-47d1-ba11-45b5e1e86bc1 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:55.614146 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-9a590bf1-3b6d-47d1-ba11-45b5e1e86bc1 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 12 18:04:55.615387 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 193/384] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Oct 12 18:04:55 2021] GET /identity/v3/users/nova => generated 82 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:04:55.626856 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d78046-1d97-4735-a06a-c31d058ae823 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:55.639731 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d78046-1d97-4735-a06a-c31d058ae823 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:55.648792 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c95bf7d-87f4-47f6-8fe6-519f2e704d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:55.649467 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c95bf7d-87f4-47f6-8fe6-519f2e704d21 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:55.649746 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c95bf7d-87f4-47f6-8fe6-519f2e704d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:55.650021 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c95bf7d-87f4-47f6-8fe6-519f2e704d21 admin admin] PATH_INFO: `/v3/users` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:55.650871 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c95bf7d-87f4-47f6-8fe6-519f2e704d21 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:55.651179 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c95bf7d-87f4-47f6-8fe6-519f2e704d21 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:55.652182 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING py.warnings [None req-6c95bf7d-87f4-47f6-8fe6-519f2e704d21 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:04:55.652182 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: warnings.warn(msg) Oct 12 18:04:55.652182 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: Oct 12 18:04:55.653473 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c95bf7d-87f4-47f6-8fe6-519f2e704d21 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:55.659141 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e1bcc-c8e9-4c69-a3dc-8c0cdeee91fb None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:55.659427 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e1bcc-c8e9-4c69-a3dc-8c0cdeee91fb None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:55.659702 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e1bcc-c8e9-4c69-a3dc-8c0cdeee91fb None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:55.661493 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 194/385] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:04:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 18:04:55.667258 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c77c00-2b94-491b-b55c-a130aecb7495 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:55.667541 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c77c00-2b94-491b-b55c-a130aecb7495 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:55.667815 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c77c00-2b94-491b-b55c-a130aecb7495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:55.701479 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-65c77c00-2b94-491b-b55c-a130aecb7495 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:04:55.702710 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-65c77c00-2b94-491b-b55c-a130aecb7495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:04:55.711198 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 192/386] 10.222.0.18 () {56 vars in 1154 bytes} [Tue Oct 12 18:04:55 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:55.720098 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 195/387] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:04:55 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:04:55.722517 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c95bf7d-87f4-47f6-8fe6-519f2e704d21 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:55.732936 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c95bf7d-87f4-47f6-8fe6-519f2e704d21 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:55.744815 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a58b43-7b46-42e6-9c97-ea5b01345f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:55.745470 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a58b43-7b46-42e6-9c97-ea5b01345f7c admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:55.745752 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a58b43-7b46-42e6-9c97-ea5b01345f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:55.746035 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a58b43-7b46-42e6-9c97-ea5b01345f7c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:55.758144 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c77c00-2b94-491b-b55c-a130aecb7495 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:55.760643 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a58b43-7b46-42e6-9c97-ea5b01345f7c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:55.762448 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a58b43-7b46-42e6-9c97-ea5b01345f7c admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:55.773426 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 193/388] 10.222.0.18 () {58 vars in 1324 bytes} [Tue Oct 12 18:04:55 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:04:55.775574 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c77c00-2b94-491b-b55c-a130aecb7495 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:55.784537 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a58b43-7b46-42e6-9c97-ea5b01345f7c admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:55.785793 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea30b33-3824-45dc-a71c-bfd5aeae6117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:55.786837 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea30b33-3824-45dc-a71c-bfd5aeae6117 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:55.787868 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea30b33-3824-45dc-a71c-bfd5aeae6117 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:55.788339 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea30b33-3824-45dc-a71c-bfd5aeae6117 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:55.794122 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a58b43-7b46-42e6-9c97-ea5b01345f7c admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:55.806902 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec39e8a-2f36-4dce-a083-a8af5b418808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:55.807909 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec39e8a-2f36-4dce-a083-a8af5b418808 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:55.808390 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec39e8a-2f36-4dce-a083-a8af5b418808 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:55.808883 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec39e8a-2f36-4dce-a083-a8af5b418808 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:55.810559 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea30b33-3824-45dc-a71c-bfd5aeae6117 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 18:04:55.824971 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-1ea30b33-3824-45dc-a71c-bfd5aeae6117 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 18:04:55.829821 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec39e8a-2f36-4dce-a083-a8af5b418808 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:55.832065 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec39e8a-2f36-4dce-a083-a8af5b418808 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:55.833660 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 196/389] 10.222.0.18 () {56 vars in 1123 bytes} [Tue Oct 12 18:04:55 2021] GET /identity/v3/roles/service => generated 85 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:04:55.840997 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea30b33-3824-45dc-a71c-bfd5aeae6117 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:55.860295 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea30b33-3824-45dc-a71c-bfd5aeae6117 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:55.871468 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-8ec39e8a-2f36-4dce-a083-a8af5b418808 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 18:04:55.873498 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 194/390] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:04:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 18:04:55.874189 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dc7c59-4557-4285-a0af-871047c0588f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:55.876429 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc7c59-4557-4285-a0af-871047c0588f admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:55.876429 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc7c59-4557-4285-a0af-871047c0588f admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:55.876429 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc7c59-4557-4285-a0af-871047c0588f admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:55.876429 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dc7c59-4557-4285-a0af-871047c0588f admin admin] RBAC: Adding query filter params (name=service) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:55.876429 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dc7c59-4557-4285-a0af-871047c0588f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:55.878125 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dc7c59-4557-4285-a0af-871047c0588f admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:55.879492 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec39e8a-2f36-4dce-a083-a8af5b418808 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:55.887745 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 197/391] 10.222.0.18 () {56 vars in 1124 bytes} [Tue Oct 12 18:04:55 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:55.893067 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec39e8a-2f36-4dce-a083-a8af5b418808 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:55.894234 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dc7c59-4557-4285-a0af-871047c0588f admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:55.898096 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee58eb5-ee05-4282-b640-7740b33675dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:55.898921 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee58eb5-ee05-4282-b640-7740b33675dc admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:55.899347 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee58eb5-ee05-4282-b640-7740b33675dc admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:55.899785 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee58eb5-ee05-4282-b640-7740b33675dc admin admin] PATH_INFO: `/v3/domains` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:55.900800 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee58eb5-ee05-4282-b640-7740b33675dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:55.901248 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee58eb5-ee05-4282-b640-7740b33675dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:55.902962 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee58eb5-ee05-4282-b640-7740b33675dc admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:55.909068 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dc7c59-4557-4285-a0af-871047c0588f admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:55.915392 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 195/392] 10.222.0.18 () {56 vars in 1130 bytes} [Tue Oct 12 18:04:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:55.921315 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee58eb5-ee05-4282-b640-7740b33675dc admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:55.929982 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dac146-51bf-4ffe-ab46-ec2a81315cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:55.930783 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dac146-51bf-4ffe-ab46-ec2a81315cdb admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:55.931062 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dac146-51bf-4ffe-ab46-ec2a81315cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:55.931337 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dac146-51bf-4ffe-ab46-ec2a81315cdb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:55.932577 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee58eb5-ee05-4282-b640-7740b33675dc admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:55.937172 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10017c58-c256-41f3-8ec8-719726849bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:55.938109 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10017c58-c256-41f3-8ec8-719726849bca admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:55.938552 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10017c58-c256-41f3-8ec8-719726849bca admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:55.938979 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10017c58-c256-41f3-8ec8-719726849bca admin admin] PATH_INFO: `/v3/projects/service` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:55.946877 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10017c58-c256-41f3-8ec8-719726849bca admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:55.949090 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10017c58-c256-41f3-8ec8-719726849bca admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:55.952243 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dac146-51bf-4ffe-ab46-ec2a81315cdb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:55.954115 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dac146-51bf-4ffe-ab46-ec2a81315cdb admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:55.963855 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-10017c58-c256-41f3-8ec8-719726849bca admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 18:04:55.965535 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 196/393] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Oct 12 18:04:55 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 18:04:55.981581 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-93dac146-51bf-4ffe-ab46-ec2a81315cdb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 18:04:55.983292 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 198/394] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:04:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:04:55.984583 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10017c58-c256-41f3-8ec8-719726849bca admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:55.992421 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dac146-51bf-4ffe-ab46-ec2a81315cdb admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:56.002627 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10017c58-c256-41f3-8ec8-719726849bca admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:56.006052 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dac146-51bf-4ffe-ab46-ec2a81315cdb admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:56.008343 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9237b7b-dbc7-4b5e-9fb8-ee995a10a515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:56.009293 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9237b7b-dbc7-4b5e-9fb8-ee995a10a515 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:56.009784 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9237b7b-dbc7-4b5e-9fb8-ee995a10a515 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:56.010237 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9237b7b-dbc7-4b5e-9fb8-ee995a10a515 admin admin] PATH_INFO: `/v3/projects` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:56.010965 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2014691-6d8e-4c24-8fd6-da591d05367a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:56.011448 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9237b7b-dbc7-4b5e-9fb8-ee995a10a515 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:56.011640 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2014691-6d8e-4c24-8fd6-da591d05367a admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:56.011922 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2014691-6d8e-4c24-8fd6-da591d05367a admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:56.012196 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2014691-6d8e-4c24-8fd6-da591d05367a admin admin] PATH_INFO: `/v3/domains` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:56.012538 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9237b7b-dbc7-4b5e-9fb8-ee995a10a515 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:56.012972 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2014691-6d8e-4c24-8fd6-da591d05367a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:56.013281 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2014691-6d8e-4c24-8fd6-da591d05367a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:56.014170 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING py.warnings [None req-e9237b7b-dbc7-4b5e-9fb8-ee995a10a515 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:04:56.014170 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: warnings.warn(msg) Oct 12 18:04:56.014170 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: Oct 12 18:04:56.014918 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2014691-6d8e-4c24-8fd6-da591d05367a admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:56.016128 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9237b7b-dbc7-4b5e-9fb8-ee995a10a515 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:56.029611 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 199/395] 10.222.0.18 () {56 vars in 1130 bytes} [Tue Oct 12 18:04:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:56.031008 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d92a6-f732-472d-b165-fa4b0df29209 None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:56.031295 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d92a6-f732-472d-b165-fa4b0df29209 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:56.031571 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d92a6-f732-472d-b165-fa4b0df29209 None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:56.038126 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 200/396] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:04:56 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:04:56.038126 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3d92a6-f732-472d-b165-fa4b0df29209 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:56.047599 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3d92a6-f732-472d-b165-fa4b0df29209 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:56.047912 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 197/397] 10.222.0.18 () {56 vars in 1169 bytes} [Tue Oct 12 18:04:55 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:56.049557 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab0be06-e7a1-4fa5-b16d-9fa048dfcc60 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:56.049918 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab0be06-e7a1-4fa5-b16d-9fa048dfcc60 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:56.050193 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab0be06-e7a1-4fa5-b16d-9fa048dfcc60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:56.053377 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63227140-2c4a-44bf-9b82-3f599740f9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:56.054142 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63227140-2c4a-44bf-9b82-3f599740f9e8 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:56.054439 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63227140-2c4a-44bf-9b82-3f599740f9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:56.054680 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63227140-2c4a-44bf-9b82-3f599740f9e8 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:56.063386 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63227140-2c4a-44bf-9b82-3f599740f9e8 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:56.065391 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63227140-2c4a-44bf-9b82-3f599740f9e8 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:56.073475 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-fab0be06-e7a1-4fa5-b16d-9fa048dfcc60 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:04:56.074898 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-fab0be06-e7a1-4fa5-b16d-9fa048dfcc60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:04:56.079169 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-63227140-2c4a-44bf-9b82-3f599740f9e8 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 12 18:04:56.080717 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 201/398] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Oct 12 18:04:56 2021] GET /identity/v3/users/cinder => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:04:56.088540 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63227140-2c4a-44bf-9b82-3f599740f9e8 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:56.088651 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 198/399] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:04:56 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:04:56.089724 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab0be06-e7a1-4fa5-b16d-9fa048dfcc60 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:56.093164 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63227140-2c4a-44bf-9b82-3f599740f9e8 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:56.098035 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6cf717-a46d-4e6f-9229-7ab95ed24f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:56.104435 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6cf717-a46d-4e6f-9229-7ab95ed24f9c admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:56.104435 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6cf717-a46d-4e6f-9229-7ab95ed24f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:56.104435 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6cf717-a46d-4e6f-9229-7ab95ed24f9c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:56.104435 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6cf717-a46d-4e6f-9229-7ab95ed24f9c admin admin] RBAC: Adding query filter params (role.id=24b43b2260b1455e832abdff63df40bd, scope.project.id=e843aaa9e5e44a8e98f7cc7412d9697b, user.id=3417097a280b499086b36df9a2548239) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:56.104435 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6cf717-a46d-4e6f-9229-7ab95ed24f9c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:56.104796 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6cf717-a46d-4e6f-9229-7ab95ed24f9c admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:56.106865 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab0be06-e7a1-4fa5-b16d-9fa048dfcc60 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:56.111972 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c219dfc0-f6ce-403e-80d4-67a05715d26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:56.112564 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 202/400] 10.222.0.18 () {56 vars in 1395 bytes} [Tue Oct 12 18:04:56 2021] GET /identity/v3/role_assignments?user.id=3417097a280b499086b36df9a2548239&scope.project.id=e843aaa9e5e44a8e98f7cc7412d9697b&role.id=24b43b2260b1455e832abdff63df40bd => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:56.113152 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c219dfc0-f6ce-403e-80d4-67a05715d26b admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:56.114905 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c219dfc0-f6ce-403e-80d4-67a05715d26b admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:56.114905 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c219dfc0-f6ce-403e-80d4-67a05715d26b admin admin] PATH_INFO: `/v3/users` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:56.114905 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c219dfc0-f6ce-403e-80d4-67a05715d26b admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:56.116013 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c219dfc0-f6ce-403e-80d4-67a05715d26b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:56.122658 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c219dfc0-f6ce-403e-80d4-67a05715d26b admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:56.153247 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 199/401] 10.222.0.18 () {56 vars in 1158 bytes} [Tue Oct 12 18:04:56 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:56.154071 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6cf717-a46d-4e6f-9229-7ab95ed24f9c admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:56.165479 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c219dfc0-f6ce-403e-80d4-67a05715d26b admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:56.167714 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6cf717-a46d-4e6f-9229-7ab95ed24f9c admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:56.176599 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c219dfc0-f6ce-403e-80d4-67a05715d26b admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:56.182609 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f324141-40bb-4327-b3b0-d0b790e853e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:56.183691 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f324141-40bb-4327-b3b0-d0b790e853e2 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:56.184288 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f324141-40bb-4327-b3b0-d0b790e853e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:56.184779 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f324141-40bb-4327-b3b0-d0b790e853e2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:56.184972 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae47982-5d11-4fee-85c7-4e60fec859ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:56.185788 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae47982-5d11-4fee-85c7-4e60fec859ff admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:56.186121 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae47982-5d11-4fee-85c7-4e60fec859ff admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:56.186446 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae47982-5d11-4fee-85c7-4e60fec859ff admin admin] PATH_INFO: `/v3/roles/service` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:56.195432 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f324141-40bb-4327-b3b0-d0b790e853e2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:56.197649 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f324141-40bb-4327-b3b0-d0b790e853e2 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:56.200299 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae47982-5d11-4fee-85c7-4e60fec859ff admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 18:04:56.208070 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 200/402] 10.222.0.18 () {58 vars in 1324 bytes} [Tue Oct 12 18:04:56 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:04:56.208501 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-2ae47982-5d11-4fee-85c7-4e60fec859ff admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 18:04:56.209995 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094918e-2a1a-42fd-ae54-fc8b83c1f9e2 None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:56.210126 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 203/403] 10.222.0.18 () {56 vars in 1123 bytes} [Tue Oct 12 18:04:56 2021] GET /identity/v3/roles/service => generated 85 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:04:56.210607 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094918e-2a1a-42fd-ae54-fc8b83c1f9e2 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:56.210882 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094918e-2a1a-42fd-ae54-fc8b83c1f9e2 None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:56.214553 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae47982-5d11-4fee-85c7-4e60fec859ff admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:56.215018 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 201/404] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:04:56 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:04:56.218733 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3094918e-2a1a-42fd-ae54-fc8b83c1f9e2 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:56.230524 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae47982-5d11-4fee-85c7-4e60fec859ff admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:56.231295 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3094918e-2a1a-42fd-ae54-fc8b83c1f9e2 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:56.235703 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a03f00f-1d77-4b6d-89a6-3cd8baab7678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:56.236373 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12490d2-e23c-4557-ae5c-f049fc59a1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:56.240927 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12490d2-e23c-4557-ae5c-f049fc59a1a9 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:56.241038 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03f00f-1d77-4b6d-89a6-3cd8baab7678 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:56.241116 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12490d2-e23c-4557-ae5c-f049fc59a1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:56.241184 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03f00f-1d77-4b6d-89a6-3cd8baab7678 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:56.241266 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12490d2-e23c-4557-ae5c-f049fc59a1a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:56.241347 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03f00f-1d77-4b6d-89a6-3cd8baab7678 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:56.241416 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12490d2-e23c-4557-ae5c-f049fc59a1a9 admin admin] RBAC: Adding query filter params (name=service) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:56.241416 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12490d2-e23c-4557-ae5c-f049fc59a1a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:56.241416 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12490d2-e23c-4557-ae5c-f049fc59a1a9 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:56.250447 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 202/405] 10.222.0.18 () {56 vars in 1124 bytes} [Tue Oct 12 18:04:56 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:04:56.251384 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a03f00f-1d77-4b6d-89a6-3cd8baab7678 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:56.251778 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0289c-2c3e-4ccf-be91-6a3c6f5291f7 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:56.252059 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0289c-2c3e-4ccf-be91-6a3c6f5291f7 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:56.252326 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0289c-2c3e-4ccf-be91-6a3c6f5291f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:56.254276 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a03f00f-1d77-4b6d-89a6-3cd8baab7678 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:56.276952 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-84e0289c-2c3e-4ccf-be91-6a3c6f5291f7 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:04:56.277939 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-9a03f00f-1d77-4b6d-89a6-3cd8baab7678 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 18:04:56.278161 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-84e0289c-2c3e-4ccf-be91-6a3c6f5291f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:04:56.279896 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 204/406] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:04:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 18:04:56.284435 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a03f00f-1d77-4b6d-89a6-3cd8baab7678 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:56.286523 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 203/407] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:04:56 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:04:56.293847 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e0289c-2c3e-4ccf-be91-6a3c6f5291f7 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:56.299526 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a03f00f-1d77-4b6d-89a6-3cd8baab7678 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:56.305031 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e0289c-2c3e-4ccf-be91-6a3c6f5291f7 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:56.305503 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669d4cdf-223e-42d0-9763-c510a6abb36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:56.306716 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d4cdf-223e-42d0-9763-c510a6abb36b admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:56.307211 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d4cdf-223e-42d0-9763-c510a6abb36b admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:56.307650 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d4cdf-223e-42d0-9763-c510a6abb36b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:56.309713 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003bf074-3f36-477b-b746-f8878b6fa5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:56.310349 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003bf074-3f36-477b-b746-f8878b6fa5a1 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:56.310624 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003bf074-3f36-477b-b746-f8878b6fa5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:56.310882 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003bf074-3f36-477b-b746-f8878b6fa5a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:56.311630 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003bf074-3f36-477b-b746-f8878b6fa5a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:56.312273 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003bf074-3f36-477b-b746-f8878b6fa5a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:56.313671 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003bf074-3f36-477b-b746-f8878b6fa5a1 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:56.321136 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669d4cdf-223e-42d0-9763-c510a6abb36b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:56.323356 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669d4cdf-223e-42d0-9763-c510a6abb36b admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:56.326612 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 204/408] 10.222.0.18 () {56 vars in 1130 bytes} [Tue Oct 12 18:04:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:56.332739 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003bf074-3f36-477b-b746-f8878b6fa5a1 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:56.342885 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003bf074-3f36-477b-b746-f8878b6fa5a1 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:56.346295 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-669d4cdf-223e-42d0-9763-c510a6abb36b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 18:04:56.348037 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 205/409] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:04:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:04:56.348146 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d485cbf5-2d9b-446b-80b5-fe4e865f6dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:56.348937 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485cbf5-2d9b-446b-80b5-fe4e865f6dba admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:56.349218 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485cbf5-2d9b-446b-80b5-fe4e865f6dba admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:56.350179 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669d4cdf-223e-42d0-9763-c510a6abb36b admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:56.357357 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485cbf5-2d9b-446b-80b5-fe4e865f6dba admin admin] PATH_INFO: `/v3/projects/service` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:56.366751 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d485cbf5-2d9b-446b-80b5-fe4e865f6dba admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:56.368799 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d485cbf5-2d9b-446b-80b5-fe4e865f6dba admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:56.369357 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669d4cdf-223e-42d0-9763-c510a6abb36b admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:56.374377 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf0c15a-0471-4ded-b018-a653c9b48605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:56.375346 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0c15a-0471-4ded-b018-a653c9b48605 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:56.375788 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0c15a-0471-4ded-b018-a653c9b48605 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:56.376067 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0c15a-0471-4ded-b018-a653c9b48605 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:56.383977 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-d485cbf5-2d9b-446b-80b5-fe4e865f6dba admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 18:04:56.385987 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 205/410] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Oct 12 18:04:56 2021] GET /identity/v3/projects/service => generated 88 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 18:04:56.387052 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d485cbf5-2d9b-446b-80b5-fe4e865f6dba admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:56.392671 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf0c15a-0471-4ded-b018-a653c9b48605 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 18:04:56.397800 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d485cbf5-2d9b-446b-80b5-fe4e865f6dba admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:56.399777 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-eaf0c15a-0471-4ded-b018-a653c9b48605 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 18:04:56.401185 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 206/411] 10.222.0.18 () {56 vars in 1123 bytes} [Tue Oct 12 18:04:56 2021] GET /identity/v3/roles/service => generated 85 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:04:56.401954 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf0c15a-0471-4ded-b018-a653c9b48605 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:56.403497 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dfb764-3ae9-4d63-8497-700fdfe74a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:56.404467 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dfb764-3ae9-4d63-8497-700fdfe74a3e admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:56.404946 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dfb764-3ae9-4d63-8497-700fdfe74a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:56.405468 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dfb764-3ae9-4d63-8497-700fdfe74a3e admin admin] PATH_INFO: `/v3/domains` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:56.406582 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dfb764-3ae9-4d63-8497-700fdfe74a3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:56.407087 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dfb764-3ae9-4d63-8497-700fdfe74a3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:56.409052 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dfb764-3ae9-4d63-8497-700fdfe74a3e admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:56.412947 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf0c15a-0471-4ded-b018-a653c9b48605 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:56.417438 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08125ee6-8aee-4044-84c4-b32c1eeeb70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:56.418061 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08125ee6-8aee-4044-84c4-b32c1eeeb70d admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:56.418345 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08125ee6-8aee-4044-84c4-b32c1eeeb70d admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:56.418626 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08125ee6-8aee-4044-84c4-b32c1eeeb70d admin admin] PATH_INFO: `/v3/projects` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:56.419410 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08125ee6-8aee-4044-84c4-b32c1eeeb70d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:56.419707 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08125ee6-8aee-4044-84c4-b32c1eeeb70d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:56.420739 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING py.warnings [None req-08125ee6-8aee-4044-84c4-b32c1eeeb70d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:04:56.420739 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: warnings.warn(msg) Oct 12 18:04:56.420739 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: Oct 12 18:04:56.421883 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08125ee6-8aee-4044-84c4-b32c1eeeb70d admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:56.423972 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 206/412] 10.222.0.18 () {56 vars in 1130 bytes} [Tue Oct 12 18:04:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:56.425351 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dfb764-3ae9-4d63-8497-700fdfe74a3e admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:56.436335 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dfb764-3ae9-4d63-8497-700fdfe74a3e admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:56.441225 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a7172b-ba4d-4a97-ad9c-3cb02836f77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:56.441919 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 207/413] 10.222.0.18 () {56 vars in 1169 bytes} [Tue Oct 12 18:04:56 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:56.442451 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7172b-ba4d-4a97-ad9c-3cb02836f77f admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:56.442758 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08125ee6-8aee-4044-84c4-b32c1eeeb70d admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:56.443226 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7172b-ba4d-4a97-ad9c-3cb02836f77f admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:56.443744 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7172b-ba4d-4a97-ad9c-3cb02836f77f admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:56.444831 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a7172b-ba4d-4a97-ad9c-3cb02836f77f admin admin] RBAC: Adding query filter params (name=service) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:56.445373 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a7172b-ba4d-4a97-ad9c-3cb02836f77f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:56.447323 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a7172b-ba4d-4a97-ad9c-3cb02836f77f admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:56.457298 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 207/414] 10.222.0.18 () {56 vars in 1124 bytes} [Tue Oct 12 18:04:56 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:56.457767 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08125ee6-8aee-4044-84c4-b32c1eeeb70d admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:56.458828 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a7172b-ba4d-4a97-ad9c-3cb02836f77f admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:56.462779 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a848386e-dd84-4727-9bae-154bc5439792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:56.463616 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a848386e-dd84-4727-9bae-154bc5439792 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:56.463946 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a848386e-dd84-4727-9bae-154bc5439792 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:56.464226 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a848386e-dd84-4727-9bae-154bc5439792 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:56.469378 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a7172b-ba4d-4a97-ad9c-3cb02836f77f admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:56.472245 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a848386e-dd84-4727-9bae-154bc5439792 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:56.475055 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a848386e-dd84-4727-9bae-154bc5439792 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:56.475479 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe865a9-caca-480c-9676-456a82c61acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:56.476358 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe865a9-caca-480c-9676-456a82c61acd admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:56.476859 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe865a9-caca-480c-9676-456a82c61acd admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:56.477340 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe865a9-caca-480c-9676-456a82c61acd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:56.478371 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe865a9-caca-480c-9676-456a82c61acd admin admin] RBAC: Adding query filter params (role.id=24b43b2260b1455e832abdff63df40bd, scope.project.id=e843aaa9e5e44a8e98f7cc7412d9697b, user.id=f6966ce0774f4437a9b688494e9d0574) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:56.478880 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe865a9-caca-480c-9676-456a82c61acd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:56.480955 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe865a9-caca-480c-9676-456a82c61acd admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:56.487014 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 208/415] 10.222.0.18 () {56 vars in 1395 bytes} [Tue Oct 12 18:04:56 2021] GET /identity/v3/role_assignments?user.id=f6966ce0774f4437a9b688494e9d0574&scope.project.id=e843aaa9e5e44a8e98f7cc7412d9697b&role.id=24b43b2260b1455e832abdff63df40bd => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:56.488323 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe865a9-caca-480c-9676-456a82c61acd admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:56.495654 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-a848386e-dd84-4727-9bae-154bc5439792 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 12 18:04:56.497155 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 208/416] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Oct 12 18:04:56 2021] GET /identity/v3/users/glance => generated 84 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:04:56.499727 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe865a9-caca-480c-9676-456a82c61acd admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:56.503881 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a848386e-dd84-4727-9bae-154bc5439792 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:56.505179 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130867a3-bfac-4668-a615-a5f6053f18ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:56.506279 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130867a3-bfac-4668-a615-a5f6053f18ed admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:56.506759 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130867a3-bfac-4668-a615-a5f6053f18ed admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:56.507229 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130867a3-bfac-4668-a615-a5f6053f18ed admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:56.515136 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a848386e-dd84-4727-9bae-154bc5439792 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:56.520570 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130867a3-bfac-4668-a615-a5f6053f18ed admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:56.523886 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130867a3-bfac-4668-a615-a5f6053f18ed admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:56.536245 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaee398-6334-4dc6-9e0d-ca36bb15db41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:56.538680 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaee398-6334-4dc6-9e0d-ca36bb15db41 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:56.540704 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaee398-6334-4dc6-9e0d-ca36bb15db41 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:56.541290 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaee398-6334-4dc6-9e0d-ca36bb15db41 admin admin] PATH_INFO: `/v3/users` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:56.542443 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaee398-6334-4dc6-9e0d-ca36bb15db41 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:56.543971 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaee398-6334-4dc6-9e0d-ca36bb15db41 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:56.547615 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING py.warnings [None req-3eaee398-6334-4dc6-9e0d-ca36bb15db41 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:04:56.547615 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: warnings.warn(msg) Oct 12 18:04:56.547615 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: Oct 12 18:04:56.549339 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaee398-6334-4dc6-9e0d-ca36bb15db41 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:56.555022 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-130867a3-bfac-4668-a615-a5f6053f18ed admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 18:04:56.561885 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 209/417] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:04:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:04:56.568531 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130867a3-bfac-4668-a615-a5f6053f18ed admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:56.591026 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130867a3-bfac-4668-a615-a5f6053f18ed admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:56.598898 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 209/418] 10.222.0.18 () {56 vars in 1158 bytes} [Tue Oct 12 18:04:56 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:04:56.603350 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cf03e8-0bbd-47fc-8b24-f387995fbedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:56.604613 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf03e8-0bbd-47fc-8b24-f387995fbedd admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:56.605887 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaee398-6334-4dc6-9e0d-ca36bb15db41 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:56.606946 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf03e8-0bbd-47fc-8b24-f387995fbedd admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:56.607844 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf03e8-0bbd-47fc-8b24-f387995fbedd admin admin] PATH_INFO: `/v3/domains` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:56.611365 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cf03e8-0bbd-47fc-8b24-f387995fbedd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:56.614302 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cf03e8-0bbd-47fc-8b24-f387995fbedd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:56.616487 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cf03e8-0bbd-47fc-8b24-f387995fbedd admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:56.628426 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaee398-6334-4dc6-9e0d-ca36bb15db41 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:56.637787 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 210/419] 10.222.0.18 () {56 vars in 1130 bytes} [Tue Oct 12 18:04:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:56.639801 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5b1da0-0973-44bb-83c1-c353a4245b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:56.641035 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b1da0-0973-44bb-83c1-c353a4245b38 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:56.641480 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b1da0-0973-44bb-83c1-c353a4245b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:56.651744 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b1da0-0973-44bb-83c1-c353a4245b38 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:56.651906 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cf03e8-0bbd-47fc-8b24-f387995fbedd admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:56.658968 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5b1da0-0973-44bb-83c1-c353a4245b38 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:56.662603 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5b1da0-0973-44bb-83c1-c353a4245b38 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:56.668577 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cf03e8-0bbd-47fc-8b24-f387995fbedd admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:56.679290 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 210/420] 10.222.0.18 () {58 vars in 1324 bytes} [Tue Oct 12 18:04:56 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:04:56.681000 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4367ace-6981-4e2e-a372-a6039ffa57c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:56.682359 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4367ace-6981-4e2e-a372-a6039ffa57c1 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:56.682873 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4367ace-6981-4e2e-a372-a6039ffa57c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:56.683347 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4367ace-6981-4e2e-a372-a6039ffa57c1 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:56.687293 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5b1da0-0973-44bb-83c1-c353a4245b38 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:56.701160 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4367ace-6981-4e2e-a372-a6039ffa57c1 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:56.703768 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4367ace-6981-4e2e-a372-a6039ffa57c1 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:56.706420 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5b1da0-0973-44bb-83c1-c353a4245b38 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:56.718436 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78063a51-ef1f-4ac6-997a-fcf1f61000b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:56.719641 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78063a51-ef1f-4ac6-997a-fcf1f61000b6 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:56.720184 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78063a51-ef1f-4ac6-997a-fcf1f61000b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:56.720680 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78063a51-ef1f-4ac6-997a-fcf1f61000b6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:56.736254 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-f4367ace-6981-4e2e-a372-a6039ffa57c1 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 12 18:04:56.741343 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 211/421] 10.222.0.18 () {56 vars in 1123 bytes} [Tue Oct 12 18:04:56 2021] GET /identity/v3/users/neutron => generated 85 bytes in 96 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:04:56.742763 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78063a51-ef1f-4ac6-997a-fcf1f61000b6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:56.745003 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78063a51-ef1f-4ac6-997a-fcf1f61000b6 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:56.747438 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4367ace-6981-4e2e-a372-a6039ffa57c1 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:56.758404 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4367ace-6981-4e2e-a372-a6039ffa57c1 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:56.764269 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be23862-fd4a-4ce6-932c-7462fc26591b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:56.765349 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be23862-fd4a-4ce6-932c-7462fc26591b admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:56.765630 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be23862-fd4a-4ce6-932c-7462fc26591b admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:56.766162 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be23862-fd4a-4ce6-932c-7462fc26591b admin admin] PATH_INFO: `/v3/users` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:56.767046 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be23862-fd4a-4ce6-932c-7462fc26591b admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:56.767356 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be23862-fd4a-4ce6-932c-7462fc26591b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:56.769243 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be23862-fd4a-4ce6-932c-7462fc26591b admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:56.771141 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-78063a51-ef1f-4ac6-997a-fcf1f61000b6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 18:04:56.773700 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 211/422] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:04:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:04:56.775205 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8bb22-71d6-452b-898d-a12c01b9e56a None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:56.775632 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8bb22-71d6-452b-898d-a12c01b9e56a None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:56.776068 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8bb22-71d6-452b-898d-a12c01b9e56a None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:56.778269 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 212/423] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:04:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:04:56.779054 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f8bb22-71d6-452b-898d-a12c01b9e56a None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:56.788005 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 212/424] 10.222.0.18 () {56 vars in 1160 bytes} [Tue Oct 12 18:04:56 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:04:56.789567 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688d052-3313-4ed7-9e44-53fc2fe3aa4d None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:56.790024 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688d052-3313-4ed7-9e44-53fc2fe3aa4d None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:56.790479 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688d052-3313-4ed7-9e44-53fc2fe3aa4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:56.799737 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f8bb22-71d6-452b-898d-a12c01b9e56a None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:56.804952 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8c44b7-a48d-43ae-8b4e-e1cc25aaabc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:56.805761 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c44b7-a48d-43ae-8b4e-e1cc25aaabc7 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:56.806200 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c44b7-a48d-43ae-8b4e-e1cc25aaabc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:56.806618 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c44b7-a48d-43ae-8b4e-e1cc25aaabc7 admin admin] PATH_INFO: `/v3/domains` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:56.807489 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8c44b7-a48d-43ae-8b4e-e1cc25aaabc7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:56.807944 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8c44b7-a48d-43ae-8b4e-e1cc25aaabc7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:56.809727 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8c44b7-a48d-43ae-8b4e-e1cc25aaabc7 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:56.813741 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-5688d052-3313-4ed7-9e44-53fc2fe3aa4d None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:04:56.815041 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-5688d052-3313-4ed7-9e44-53fc2fe3aa4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:04:56.822678 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 213/425] 10.222.0.18 () {56 vars in 1130 bytes} [Tue Oct 12 18:04:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:04:56.823701 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8c44b7-a48d-43ae-8b4e-e1cc25aaabc7 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:56.824902 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 213/426] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:04:56 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:04:56.833539 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5688d052-3313-4ed7-9e44-53fc2fe3aa4d None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:56.842640 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8c44b7-a48d-43ae-8b4e-e1cc25aaabc7 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:56.852985 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5688d052-3313-4ed7-9e44-53fc2fe3aa4d None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:56.854173 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a45cde-4b45-48f0-b48d-83902470bca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:56.854872 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a45cde-4b45-48f0-b48d-83902470bca3 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:56.855159 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a45cde-4b45-48f0-b48d-83902470bca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:56.855430 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a45cde-4b45-48f0-b48d-83902470bca3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:56.863881 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f42eaf-ab05-43ab-8bd2-88574f70e032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:56.864505 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a45cde-4b45-48f0-b48d-83902470bca3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:56.865213 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f42eaf-ab05-43ab-8bd2-88574f70e032 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:56.865759 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f42eaf-ab05-43ab-8bd2-88574f70e032 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:56.866265 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f42eaf-ab05-43ab-8bd2-88574f70e032 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:56.866678 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a45cde-4b45-48f0-b48d-83902470bca3 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:56.874561 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f42eaf-ab05-43ab-8bd2-88574f70e032 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:56.875648 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 214/427] 10.222.0.18 () {58 vars in 1324 bytes} [Tue Oct 12 18:04:56 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:04:56.880253 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a45cde-4b45-48f0-b48d-83902470bca3 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:56.880376 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f42eaf-ab05-43ab-8bd2-88574f70e032 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:56.889416 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a45cde-4b45-48f0-b48d-83902470bca3 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:56.894486 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4a1b5e-107c-4a20-8b99-d1209f292ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:56.895453 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a1b5e-107c-4a20-8b99-d1209f292ae1 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:56.895949 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a1b5e-107c-4a20-8b99-d1209f292ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:56.896980 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a1b5e-107c-4a20-8b99-d1209f292ae1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:56.898881 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-76f42eaf-ab05-43ab-8bd2-88574f70e032 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 18:04:56.900302 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 214/428] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Oct 12 18:04:56 2021] GET /identity/v3/projects/service => generated 88 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:04:56.901071 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f42eaf-ab05-43ab-8bd2-88574f70e032 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:56.908928 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4a1b5e-107c-4a20-8b99-d1209f292ae1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:56.911026 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4a1b5e-107c-4a20-8b99-d1209f292ae1 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:56.911695 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f42eaf-ab05-43ab-8bd2-88574f70e032 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:56.916384 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e08d19-b727-430f-b52b-def50e82e05e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:56.917333 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e08d19-b727-430f-b52b-def50e82e05e admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:56.917710 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e08d19-b727-430f-b52b-def50e82e05e admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:56.918098 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e08d19-b727-430f-b52b-def50e82e05e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:56.929239 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e08d19-b727-430f-b52b-def50e82e05e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:56.931196 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e08d19-b727-430f-b52b-def50e82e05e admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:56.931396 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-4f4a1b5e-107c-4a20-8b99-d1209f292ae1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 18:04:56.932846 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 215/429] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:04:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:04:56.933791 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4a1b5e-107c-4a20-8b99-d1209f292ae1 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:56.949293 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4a1b5e-107c-4a20-8b99-d1209f292ae1 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:56.953960 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8962e584-aca5-4ccd-9f05-3c0d176e8594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:56.954714 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962e584-aca5-4ccd-9f05-3c0d176e8594 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:56.955126 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962e584-aca5-4ccd-9f05-3c0d176e8594 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:56.955501 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962e584-aca5-4ccd-9f05-3c0d176e8594 admin admin] PATH_INFO: `/v3/projects` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:56.955849 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-34e08d19-b727-430f-b52b-def50e82e05e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 18:04:56.956530 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8962e584-aca5-4ccd-9f05-3c0d176e8594 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:56.956942 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8962e584-aca5-4ccd-9f05-3c0d176e8594 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:56.957604 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 215/430] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:04:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:04:56.958613 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e08d19-b727-430f-b52b-def50e82e05e admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:56.964878 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8962e584-aca5-4ccd-9f05-3c0d176e8594 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:56.972804 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e08d19-b727-430f-b52b-def50e82e05e admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:56.978845 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0ce989-8354-4de2-a210-004fc9d590e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:56.979672 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ce989-8354-4de2-a210-004fc9d590e7 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:56.980097 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ce989-8354-4de2-a210-004fc9d590e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:56.980448 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 216/431] 10.222.0.18 () {56 vars in 1169 bytes} [Tue Oct 12 18:04:56 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:56.980714 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ce989-8354-4de2-a210-004fc9d590e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:56.981585 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0ce989-8354-4de2-a210-004fc9d590e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:56.981714 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8962e584-aca5-4ccd-9f05-3c0d176e8594 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:56.982145 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0ce989-8354-4de2-a210-004fc9d590e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:56.983946 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0ce989-8354-4de2-a210-004fc9d590e7 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:56.993332 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8962e584-aca5-4ccd-9f05-3c0d176e8594 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:56.997657 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 216/432] 10.222.0.18 () {56 vars in 1130 bytes} [Tue Oct 12 18:04:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:56.998604 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0ce989-8354-4de2-a210-004fc9d590e7 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:57.004257 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae87f9a7-bd29-49d5-b90d-8060631bd847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:57.005618 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87f9a7-bd29-49d5-b90d-8060631bd847 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:57.006037 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87f9a7-bd29-49d5-b90d-8060631bd847 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:57.006414 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87f9a7-bd29-49d5-b90d-8060631bd847 admin admin] PATH_INFO: `/v3/domains` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:57.007566 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae87f9a7-bd29-49d5-b90d-8060631bd847 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:57.008020 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae87f9a7-bd29-49d5-b90d-8060631bd847 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:57.009329 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0ce989-8354-4de2-a210-004fc9d590e7 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:57.009993 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae87f9a7-bd29-49d5-b90d-8060631bd847 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:57.014813 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482a6b9d-6312-4b85-ba55-0bbae482c5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:57.015635 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a6b9d-6312-4b85-ba55-0bbae482c5a1 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:57.016309 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a6b9d-6312-4b85-ba55-0bbae482c5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:57.016750 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a6b9d-6312-4b85-ba55-0bbae482c5a1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:57.017721 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482a6b9d-6312-4b85-ba55-0bbae482c5a1 admin admin] RBAC: Adding query filter params (role.id=24b43b2260b1455e832abdff63df40bd, scope.project.id=e843aaa9e5e44a8e98f7cc7412d9697b, user.id=7a3d3e5a5cfc4ac3afcece4e55f23552) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:57.018657 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482a6b9d-6312-4b85-ba55-0bbae482c5a1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:57.021140 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482a6b9d-6312-4b85-ba55-0bbae482c5a1 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:57.024426 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 217/433] 10.222.0.18 () {56 vars in 1130 bytes} [Tue Oct 12 18:04:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:57.029150 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae87f9a7-bd29-49d5-b90d-8060631bd847 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:57.032389 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 217/434] 10.222.0.18 () {56 vars in 1395 bytes} [Tue Oct 12 18:04:56 2021] GET /identity/v3/role_assignments?user.id=7a3d3e5a5cfc4ac3afcece4e55f23552&scope.project.id=e843aaa9e5e44a8e98f7cc7412d9697b&role.id=24b43b2260b1455e832abdff63df40bd => generated 259 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:57.037661 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482a6b9d-6312-4b85-ba55-0bbae482c5a1 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:57.048311 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae87f9a7-bd29-49d5-b90d-8060631bd847 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:57.054638 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482a6b9d-6312-4b85-ba55-0bbae482c5a1 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:57.059432 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3570585-30be-4d58-bfc6-ed7e5a0a8f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:57.061103 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3570585-30be-4d58-bfc6-ed7e5a0a8f38 admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:57.062037 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3570585-30be-4d58-bfc6-ed7e5a0a8f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:57.062938 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3570585-30be-4d58-bfc6-ed7e5a0a8f38 admin admin] PATH_INFO: `/v3/users` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:57.064223 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3570585-30be-4d58-bfc6-ed7e5a0a8f38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:57.067462 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3570585-30be-4d58-bfc6-ed7e5a0a8f38 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:57.069160 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3a21d8-ceaa-4d8a-b393-137358167a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:57.070159 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3a21d8-ceaa-4d8a-b393-137358167a52 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:57.072080 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3a21d8-ceaa-4d8a-b393-137358167a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:57.072632 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3a21d8-ceaa-4d8a-b393-137358167a52 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:57.091884 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3a21d8-ceaa-4d8a-b393-137358167a52 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:57.091884 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3a21d8-ceaa-4d8a-b393-137358167a52 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:57.112654 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-7a3a21d8-ceaa-4d8a-b393-137358167a52 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 18:04:57.113971 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 218/435] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Oct 12 18:04:57 2021] GET /identity/v3/projects/service => generated 88 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:04:57.120721 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3a21d8-ceaa-4d8a-b393-137358167a52 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:57.139189 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3a21d8-ceaa-4d8a-b393-137358167a52 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:57.144800 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9a9588-bdc5-4dbc-a0b9-ec6d505c3725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:57.145566 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a9588-bdc5-4dbc-a0b9-ec6d505c3725 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:57.145897 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a9588-bdc5-4dbc-a0b9-ec6d505c3725 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:57.146242 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a9588-bdc5-4dbc-a0b9-ec6d505c3725 admin admin] PATH_INFO: `/v3/projects` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:57.147142 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9a9588-bdc5-4dbc-a0b9-ec6d505c3725 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:57.147507 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9a9588-bdc5-4dbc-a0b9-ec6d505c3725 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:57.149771 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9a9588-bdc5-4dbc-a0b9-ec6d505c3725 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:57.164251 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 219/436] 10.222.0.18 () {56 vars in 1169 bytes} [Tue Oct 12 18:04:57 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:04:57.172765 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9a9588-bdc5-4dbc-a0b9-ec6d505c3725 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:57.183677 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9a9588-bdc5-4dbc-a0b9-ec6d505c3725 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:57.188680 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a019ba4d-144c-41fe-8312-a80f1a4bbd9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:57.189485 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a019ba4d-144c-41fe-8312-a80f1a4bbd9a admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:57.189879 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a019ba4d-144c-41fe-8312-a80f1a4bbd9a admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:57.190225 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a019ba4d-144c-41fe-8312-a80f1a4bbd9a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:57.191211 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a019ba4d-144c-41fe-8312-a80f1a4bbd9a admin admin] RBAC: Adding query filter params (role.id=24b43b2260b1455e832abdff63df40bd, scope.project.id=e843aaa9e5e44a8e98f7cc7412d9697b, user.id=9a1ea6f47a7c41aba102ad481f5ad5c8) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:57.191678 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a019ba4d-144c-41fe-8312-a80f1a4bbd9a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:57.194322 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a019ba4d-144c-41fe-8312-a80f1a4bbd9a admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:57.201217 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 220/437] 10.222.0.18 () {56 vars in 1395 bytes} [Tue Oct 12 18:04:57 2021] GET /identity/v3/role_assignments?user.id=9a1ea6f47a7c41aba102ad481f5ad5c8&scope.project.id=e843aaa9e5e44a8e98f7cc7412d9697b&role.id=24b43b2260b1455e832abdff63df40bd => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:57.223485 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 218/438] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Oct 12 18:04:57 2021] POST /identity/v3/users => generated 247 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:04:58.860991 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa4da6-a402-4095-8f81-4b374bbd11a5 None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:58.861497 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa4da6-a402-4095-8f81-4b374bbd11a5 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:58.861572 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa4da6-a402-4095-8f81-4b374bbd11a5 None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:58.863578 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 221/439] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:04:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:04:58.869989 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc0f0ce-08f0-465a-a70e-3dc64c523978 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:58.870400 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc0f0ce-08f0-465a-a70e-3dc64c523978 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:58.870476 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc0f0ce-08f0-465a-a70e-3dc64c523978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:58.893742 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-abc0f0ce-08f0-465a-a70e-3dc64c523978 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:04:58.894968 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-abc0f0ce-08f0-465a-a70e-3dc64c523978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:04:58.903678 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 219/440] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:04:58 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:04:58.948430 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc0f0ce-08f0-465a-a70e-3dc64c523978 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:58.948961 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac716db5-6288-4ae8-abd9-f402a9d7fd50 None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:58.949251 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac716db5-6288-4ae8-abd9-f402a9d7fd50 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:58.949530 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac716db5-6288-4ae8-abd9-f402a9d7fd50 None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:58.951546 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 222/441] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:04:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:04:58.958805 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc0f0ce-08f0-465a-a70e-3dc64c523978 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:58.967790 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211548b1-2408-4efc-ae25-c2b3b7154ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:58.968863 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211548b1-2408-4efc-ae25-c2b3b7154ad2 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:58.969340 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211548b1-2408-4efc-ae25-c2b3b7154ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:58.969818 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211548b1-2408-4efc-ae25-c2b3b7154ad2 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:58.972835 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17914e98-eb48-45f9-9f1a-61a0cd5eb6ab None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:58.973131 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17914e98-eb48-45f9-9f1a-61a0cd5eb6ab None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:58.973412 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17914e98-eb48-45f9-9f1a-61a0cd5eb6ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:58.986741 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211548b1-2408-4efc-ae25-c2b3b7154ad2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 18:04:58.999969 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-211548b1-2408-4efc-ae25-c2b3b7154ad2 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 18:04:59.001530 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 220/442] 10.222.0.18 () {56 vars in 1123 bytes} [Tue Oct 12 18:04:58 2021] GET /identity/v3/roles/service => generated 85 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 18:04:59.008019 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211548b1-2408-4efc-ae25-c2b3b7154ad2 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:59.008139 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-17914e98-eb48-45f9-9f1a-61a0cd5eb6ab None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:04:59.009472 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-17914e98-eb48-45f9-9f1a-61a0cd5eb6ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:04:59.018014 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211548b1-2408-4efc-ae25-c2b3b7154ad2 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:59.022527 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738c0cef-fbcc-45f6-a293-3a59021cec79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:59.023163 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c0cef-fbcc-45f6-a293-3a59021cec79 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:59.023446 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c0cef-fbcc-45f6-a293-3a59021cec79 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:59.023723 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c0cef-fbcc-45f6-a293-3a59021cec79 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:59.024524 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738c0cef-fbcc-45f6-a293-3a59021cec79 admin admin] RBAC: Adding query filter params (name=service) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:59.024935 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738c0cef-fbcc-45f6-a293-3a59021cec79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:59.026555 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738c0cef-fbcc-45f6-a293-3a59021cec79 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:59.034287 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 223/443] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:04:58 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:04:59.035505 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 221/444] 10.222.0.18 () {56 vars in 1124 bytes} [Tue Oct 12 18:04:59 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:04:59.051682 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17914e98-eb48-45f9-9f1a-61a0cd5eb6ab None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:59.061634 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17914e98-eb48-45f9-9f1a-61a0cd5eb6ab None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:59.064866 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738c0cef-fbcc-45f6-a293-3a59021cec79 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:59.070211 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb3c370-0b97-4e94-aa79-979db9b063da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:59.071234 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb3c370-0b97-4e94-aa79-979db9b063da admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:59.071709 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb3c370-0b97-4e94-aa79-979db9b063da admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:59.072195 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb3c370-0b97-4e94-aa79-979db9b063da admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:59.076373 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738c0cef-fbcc-45f6-a293-3a59021cec79 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:59.086549 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c68500-7274-40d1-a482-8189e2270bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:59.087343 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c68500-7274-40d1-a482-8189e2270bfb admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:59.087625 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c68500-7274-40d1-a482-8189e2270bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:59.087897 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c68500-7274-40d1-a482-8189e2270bfb admin admin] PATH_INFO: `/v3/roles/service` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:59.094131 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb3c370-0b97-4e94-aa79-979db9b063da admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:59.096001 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb3c370-0b97-4e94-aa79-979db9b063da admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:59.106296 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c68500-7274-40d1-a482-8189e2270bfb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 18:04:59.113380 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-00c68500-7274-40d1-a482-8189e2270bfb admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 18:04:59.114598 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 222/445] 10.222.0.18 () {56 vars in 1123 bytes} [Tue Oct 12 18:04:59 2021] GET /identity/v3/roles/service => generated 85 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 18:04:59.124487 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-dfb3c370-0b97-4e94-aa79-979db9b063da admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 18:04:59.132770 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 224/446] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:04:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:04:59.134035 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c68500-7274-40d1-a482-8189e2270bfb admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:59.140749 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb3c370-0b97-4e94-aa79-979db9b063da admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:59.150914 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c68500-7274-40d1-a482-8189e2270bfb admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:59.155526 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb3c370-0b97-4e94-aa79-979db9b063da admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:59.160565 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e6837a-22ef-4452-ae6f-24d97c0fae9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:59.161231 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e6837a-22ef-4452-ae6f-24d97c0fae9e admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:59.161511 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e6837a-22ef-4452-ae6f-24d97c0fae9e admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:59.161814 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e6837a-22ef-4452-ae6f-24d97c0fae9e admin admin] PATH_INFO: `/v3/domains` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:59.162552 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e6837a-22ef-4452-ae6f-24d97c0fae9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:59.162855 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e6837a-22ef-4452-ae6f-24d97c0fae9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:59.164462 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e6837a-22ef-4452-ae6f-24d97c0fae9e admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:59.167408 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc1c918-339c-4f57-9b00-9e01044cf63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:59.168579 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1c918-339c-4f57-9b00-9e01044cf63d admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:59.169071 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1c918-339c-4f57-9b00-9e01044cf63d admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:59.169565 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1c918-339c-4f57-9b00-9e01044cf63d admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:59.170535 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc1c918-339c-4f57-9b00-9e01044cf63d admin admin] RBAC: Adding query filter params (name=service) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:59.171046 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc1c918-339c-4f57-9b00-9e01044cf63d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:59.173155 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc1c918-339c-4f57-9b00-9e01044cf63d admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:59.190574 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 225/447] 10.222.0.18 () {56 vars in 1124 bytes} [Tue Oct 12 18:04:59 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:59.193866 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 223/448] 10.222.0.18 () {56 vars in 1130 bytes} [Tue Oct 12 18:04:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:04:59.201415 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc1c918-339c-4f57-9b00-9e01044cf63d admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:59.201803 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e6837a-22ef-4452-ae6f-24d97c0fae9e admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:59.218114 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc1c918-339c-4f57-9b00-9e01044cf63d admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:59.220392 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e6837a-22ef-4452-ae6f-24d97c0fae9e admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:59.227358 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffbb8c6-2913-462c-bcde-996c05c6cf79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:59.228924 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffbb8c6-2913-462c-bcde-996c05c6cf79 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:59.230698 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffbb8c6-2913-462c-bcde-996c05c6cf79 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:59.231201 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffbb8c6-2913-462c-bcde-996c05c6cf79 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:59.231957 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cdf702-0abd-4597-a71f-6be4bae89acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:59.233502 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cdf702-0abd-4597-a71f-6be4bae89acf admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:59.235407 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cdf702-0abd-4597-a71f-6be4bae89acf admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:59.235919 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cdf702-0abd-4597-a71f-6be4bae89acf admin admin] PATH_INFO: `/v3/users/nova` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:59.250845 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cdf702-0abd-4597-a71f-6be4bae89acf admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:59.254170 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cdf702-0abd-4597-a71f-6be4bae89acf admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:59.258761 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffbb8c6-2913-462c-bcde-996c05c6cf79 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:59.260675 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffbb8c6-2913-462c-bcde-996c05c6cf79 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:59.271873 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-01cdf702-0abd-4597-a71f-6be4bae89acf admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 12 18:04:59.273654 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 224/449] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Oct 12 18:04:59 2021] GET /identity/v3/users/nova => generated 82 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:04:59.287976 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-5ffbb8c6-2913-462c-bcde-996c05c6cf79 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 18:04:59.289144 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cdf702-0abd-4597-a71f-6be4bae89acf admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:59.299478 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cdf702-0abd-4597-a71f-6be4bae89acf admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:59.301091 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 226/450] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:04:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 100 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:04:59.307631 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffbb8c6-2913-462c-bcde-996c05c6cf79 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:59.315843 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a13d4c-0b01-4267-b0e9-70ed0683f634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:59.316781 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a13d4c-0b01-4267-b0e9-70ed0683f634 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:59.317267 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a13d4c-0b01-4267-b0e9-70ed0683f634 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:59.317742 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a13d4c-0b01-4267-b0e9-70ed0683f634 admin admin] PATH_INFO: `/v3/users` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:59.319322 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a13d4c-0b01-4267-b0e9-70ed0683f634 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:59.320827 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a13d4c-0b01-4267-b0e9-70ed0683f634 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:59.323908 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a13d4c-0b01-4267-b0e9-70ed0683f634 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:59.328146 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffbb8c6-2913-462c-bcde-996c05c6cf79 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:59.341700 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9331f102-0402-4603-a5bd-8f27c8b87a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:59.342678 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331f102-0402-4603-a5bd-8f27c8b87a87 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:59.343165 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331f102-0402-4603-a5bd-8f27c8b87a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:59.343648 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331f102-0402-4603-a5bd-8f27c8b87a87 admin admin] PATH_INFO: `/v3/domains` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:59.344645 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9331f102-0402-4603-a5bd-8f27c8b87a87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:59.345175 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9331f102-0402-4603-a5bd-8f27c8b87a87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:59.347004 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9331f102-0402-4603-a5bd-8f27c8b87a87 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:59.364468 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 225/451] 10.222.0.18 () {56 vars in 1154 bytes} [Tue Oct 12 18:04:59 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:04:59.373476 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a13d4c-0b01-4267-b0e9-70ed0683f634 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:59.373615 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 227/452] 10.222.0.18 () {56 vars in 1130 bytes} [Tue Oct 12 18:04:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:04:59.379617 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9331f102-0402-4603-a5bd-8f27c8b87a87 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:59.384518 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a13d4c-0b01-4267-b0e9-70ed0683f634 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:59.389603 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9331f102-0402-4603-a5bd-8f27c8b87a87 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:59.397183 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbc7fc8-496d-4e65-8e26-47517a641d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:59.397971 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc7fc8-496d-4e65-8e26-47517a641d90 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:59.398247 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc7fc8-496d-4e65-8e26-47517a641d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:59.398523 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc7fc8-496d-4e65-8e26-47517a641d90 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:59.399648 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec369b0-eb2e-434c-96a7-52af5721a1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:59.400441 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec369b0-eb2e-434c-96a7-52af5721a1c3 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:59.400716 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec369b0-eb2e-434c-96a7-52af5721a1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:59.400979 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec369b0-eb2e-434c-96a7-52af5721a1c3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:59.416980 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbc7fc8-496d-4e65-8e26-47517a641d90 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:59.419076 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbc7fc8-496d-4e65-8e26-47517a641d90 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:59.421953 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec369b0-eb2e-434c-96a7-52af5721a1c3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:59.424074 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec369b0-eb2e-434c-96a7-52af5721a1c3 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:59.443908 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-acbc7fc8-496d-4e65-8e26-47517a641d90 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 12 18:04:59.446137 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 228/453] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Oct 12 18:04:59 2021] GET /identity/v3/users/cinder => generated 84 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 18:04:59.452511 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-cec369b0-eb2e-434c-96a7-52af5721a1c3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 18:04:59.453070 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbc7fc8-496d-4e65-8e26-47517a641d90 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:59.453759 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 226/454] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:04:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:04:59.460705 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec369b0-eb2e-434c-96a7-52af5721a1c3 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:59.471615 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec369b0-eb2e-434c-96a7-52af5721a1c3 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:59.474826 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbc7fc8-496d-4e65-8e26-47517a641d90 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:59.480420 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d74fdf-82ef-4450-9e7f-a926d8fe9431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:59.480420 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d74fdf-82ef-4450-9e7f-a926d8fe9431 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:59.480420 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d74fdf-82ef-4450-9e7f-a926d8fe9431 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:59.480420 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d74fdf-82ef-4450-9e7f-a926d8fe9431 admin admin] PATH_INFO: `/v3/domains` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:59.480769 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d74fdf-82ef-4450-9e7f-a926d8fe9431 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:59.480769 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d74fdf-82ef-4450-9e7f-a926d8fe9431 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:59.480769 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d74fdf-82ef-4450-9e7f-a926d8fe9431 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:59.485502 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa09823d-4dd3-4687-9e6f-db44b2cd9ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:59.486436 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa09823d-4dd3-4687-9e6f-db44b2cd9ee3 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:59.486921 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa09823d-4dd3-4687-9e6f-db44b2cd9ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:59.487884 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa09823d-4dd3-4687-9e6f-db44b2cd9ee3 admin admin] PATH_INFO: `/v3/users` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:59.489410 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa09823d-4dd3-4687-9e6f-db44b2cd9ee3 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:59.490036 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa09823d-4dd3-4687-9e6f-db44b2cd9ee3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:59.492343 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa09823d-4dd3-4687-9e6f-db44b2cd9ee3 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:59.492698 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 227/455] 10.222.0.18 () {56 vars in 1130 bytes} [Tue Oct 12 18:04:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:04:59.500490 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d74fdf-82ef-4450-9e7f-a926d8fe9431 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:59.522475 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d74fdf-82ef-4450-9e7f-a926d8fe9431 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:59.531516 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc1db86-e798-4516-bb26-095fbb7459b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:59.533620 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1db86-e798-4516-bb26-095fbb7459b1 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:59.534190 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1db86-e798-4516-bb26-095fbb7459b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:59.534464 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1db86-e798-4516-bb26-095fbb7459b1 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:59.535407 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 229/456] 10.222.0.18 () {56 vars in 1158 bytes} [Tue Oct 12 18:04:59 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:04:59.542207 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa09823d-4dd3-4687-9e6f-db44b2cd9ee3 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:59.549873 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc1db86-e798-4516-bb26-095fbb7459b1 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:59.552028 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa09823d-4dd3-4687-9e6f-db44b2cd9ee3 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:59.552377 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc1db86-e798-4516-bb26-095fbb7459b1 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:59.556717 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcbab3b-8a6b-45bf-985a-1eb282e026ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:59.564437 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcbab3b-8a6b-45bf-985a-1eb282e026ed admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:59.564437 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcbab3b-8a6b-45bf-985a-1eb282e026ed admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:59.564437 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcbab3b-8a6b-45bf-985a-1eb282e026ed admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:59.569874 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcbab3b-8a6b-45bf-985a-1eb282e026ed admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:59.572064 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcbab3b-8a6b-45bf-985a-1eb282e026ed admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:59.576425 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-adc1db86-e798-4516-bb26-095fbb7459b1 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 18:04:59.578109 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 228/457] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Oct 12 18:04:59 2021] GET /identity/v3/projects/service => generated 88 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:04:59.579553 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c348f70-1e62-44df-97ec-01c3b9ca4d2f None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:59.580041 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c348f70-1e62-44df-97ec-01c3b9ca4d2f None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:59.580569 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c348f70-1e62-44df-97ec-01c3b9ca4d2f None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:59.582676 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 229/458] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:04:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:04:59.588297 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c348f70-1e62-44df-97ec-01c3b9ca4d2f None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:59.595904 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-5dcbab3b-8a6b-45bf-985a-1eb282e026ed admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 18:04:59.597446 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 230/459] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:04:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:04:59.598628 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87056863-dd7f-48b9-9a1f-ff181ca4e50f None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:59.598908 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87056863-dd7f-48b9-9a1f-ff181ca4e50f None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:59.599180 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87056863-dd7f-48b9-9a1f-ff181ca4e50f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:59.601427 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c348f70-1e62-44df-97ec-01c3b9ca4d2f None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:59.606264 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eef5b1-cd0d-45d0-aef2-68eb8484b0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:59.607091 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eef5b1-cd0d-45d0-aef2-68eb8484b0a8 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:59.607563 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eef5b1-cd0d-45d0-aef2-68eb8484b0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:59.608015 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eef5b1-cd0d-45d0-aef2-68eb8484b0a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:59.609002 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eef5b1-cd0d-45d0-aef2-68eb8484b0a8 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:59.609518 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eef5b1-cd0d-45d0-aef2-68eb8484b0a8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:59.611517 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eef5b1-cd0d-45d0-aef2-68eb8484b0a8 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:59.623511 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-87056863-dd7f-48b9-9a1f-ff181ca4e50f None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:04:59.625964 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-87056863-dd7f-48b9-9a1f-ff181ca4e50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:04:59.627903 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 230/460] 10.222.0.18 () {56 vars in 1169 bytes} [Tue Oct 12 18:04:59 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:59.629428 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eef5b1-cd0d-45d0-aef2-68eb8484b0a8 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:59.642667 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 231/461] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:04:59 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:04:59.647913 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eef5b1-cd0d-45d0-aef2-68eb8484b0a8 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:59.648036 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87056863-dd7f-48b9-9a1f-ff181ca4e50f None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:59.656242 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87056863-dd7f-48b9-9a1f-ff181ca4e50f None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:59.659062 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0443aeea-71c5-41fe-b635-8e97d1fee39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:59.660671 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0443aeea-71c5-41fe-b635-8e97d1fee39a admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:59.661519 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0443aeea-71c5-41fe-b635-8e97d1fee39a admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:59.662421 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0443aeea-71c5-41fe-b635-8e97d1fee39a admin admin] PATH_INFO: `/v3/domains` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:59.663763 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0443aeea-71c5-41fe-b635-8e97d1fee39a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:59.664991 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0443aeea-71c5-41fe-b635-8e97d1fee39a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:59.666136 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6222897-c2a6-420c-9d9f-c4f71f135f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:59.667922 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6222897-c2a6-420c-9d9f-c4f71f135f09 admin admin] REQUEST_METHOD: `PUT` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:59.668881 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6222897-c2a6-420c-9d9f-c4f71f135f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:59.669129 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0443aeea-71c5-41fe-b635-8e97d1fee39a admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:59.669494 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6222897-c2a6-420c-9d9f-c4f71f135f09 admin admin] PATH_INFO: `/v3/projects/e843aaa9e5e44a8e98f7cc7412d9697b/users/3417097a280b499086b36df9a2548239/roles/24b43b2260b1455e832abdff63df40bd` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:59.684705 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 231/462] 10.222.0.18 () {56 vars in 1130 bytes} [Tue Oct 12 18:04:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:59.685789 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0443aeea-71c5-41fe-b635-8e97d1fee39a admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:59.695018 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6222897-c2a6-420c-9d9f-c4f71f135f09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e843aaa9e5e44a8e98f7cc7412d9697b, user_id=3417097a280b499086b36df9a2548239, role_id=24b43b2260b1455e832abdff63df40bd)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:59.695383 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0443aeea-71c5-41fe-b635-8e97d1fee39a admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:59.698682 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6222897-c2a6-420c-9d9f-c4f71f135f09 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:59.700271 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c703a18c-b6ec-4332-a08f-06601533f196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:59.701166 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703a18c-b6ec-4332-a08f-06601533f196 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:59.701593 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703a18c-b6ec-4332-a08f-06601533f196 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:59.701983 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703a18c-b6ec-4332-a08f-06601533f196 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:59.713059 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c703a18c-b6ec-4332-a08f-06601533f196 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 18:04:59.720108 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-c703a18c-b6ec-4332-a08f-06601533f196 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 18:04:59.721559 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 232/463] 10.222.0.18 () {56 vars in 1123 bytes} [Tue Oct 12 18:04:59 2021] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:04:59.724530 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c703a18c-b6ec-4332-a08f-06601533f196 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:59.733611 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c703a18c-b6ec-4332-a08f-06601533f196 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:59.737972 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177dee74-e671-4821-8f81-d7fed5cd266f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:59.738796 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177dee74-e671-4821-8f81-d7fed5cd266f admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:59.739191 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177dee74-e671-4821-8f81-d7fed5cd266f admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:59.739558 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177dee74-e671-4821-8f81-d7fed5cd266f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:59.751400 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177dee74-e671-4821-8f81-d7fed5cd266f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:59.753460 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177dee74-e671-4821-8f81-d7fed5cd266f admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:59.770106 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-177dee74-e671-4821-8f81-d7fed5cd266f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 18:04:59.771719 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 233/464] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Oct 12 18:04:59 2021] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:04:59.776752 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177dee74-e671-4821-8f81-d7fed5cd266f admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:59.787318 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177dee74-e671-4821-8f81-d7fed5cd266f admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:59.791814 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0179def-7de2-4dcb-9ba7-88d834f20d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:59.792493 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0179def-7de2-4dcb-9ba7-88d834f20d71 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:59.792774 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0179def-7de2-4dcb-9ba7-88d834f20d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:59.793043 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0179def-7de2-4dcb-9ba7-88d834f20d71 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:59.793797 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0179def-7de2-4dcb-9ba7-88d834f20d71 admin admin] RBAC: Adding query filter params (name=service) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:59.794095 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0179def-7de2-4dcb-9ba7-88d834f20d71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:59.795692 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0179def-7de2-4dcb-9ba7-88d834f20d71 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:59.807763 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 232/465] 10.222.0.18 () {58 vars in 1460 bytes} [Tue Oct 12 18:04:59 2021] PUT /identity/v3/projects/e843aaa9e5e44a8e98f7cc7412d9697b/users/3417097a280b499086b36df9a2548239/roles/24b43b2260b1455e832abdff63df40bd => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:04:59.808690 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6222897-c2a6-420c-9d9f-c4f71f135f09 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:59.811398 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 234/466] 10.222.0.18 () {56 vars in 1124 bytes} [Tue Oct 12 18:04:59 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:59.821872 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0179def-7de2-4dcb-9ba7-88d834f20d71 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:59.840749 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0179def-7de2-4dcb-9ba7-88d834f20d71 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:59.924935 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6222897-c2a6-420c-9d9f-c4f71f135f09 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:59.930056 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1a0fad-aa54-4154-ab98-506f4a90148f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:59.930413 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91fa6ac-9d30-46c7-9715-e7823528bd47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:59.930831 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a0fad-aa54-4154-ab98-506f4a90148f admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:59.930976 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a0fad-aa54-4154-ab98-506f4a90148f admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:59.931246 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a0fad-aa54-4154-ab98-506f4a90148f admin admin] PATH_INFO: `/v3/projects` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:59.931572 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91fa6ac-9d30-46c7-9715-e7823528bd47 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:59.931951 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91fa6ac-9d30-46c7-9715-e7823528bd47 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:59.932105 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1a0fad-aa54-4154-ab98-506f4a90148f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:04:59.932420 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91fa6ac-9d30-46c7-9715-e7823528bd47 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:59.932519 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1a0fad-aa54-4154-ab98-506f4a90148f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:59.934423 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1a0fad-aa54-4154-ab98-506f4a90148f admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:59.943477 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91fa6ac-9d30-46c7-9715-e7823528bd47 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:04:59.945551 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91fa6ac-9d30-46c7-9715-e7823528bd47 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:04:59.949607 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 233/467] 10.222.0.18 () {56 vars in 1169 bytes} [Tue Oct 12 18:04:59 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:04:59.951283 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b3f66-9ff7-4ce5-b091-63a930a9271c None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:59.951708 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b3f66-9ff7-4ce5-b091-63a930a9271c None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:59.952117 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b3f66-9ff7-4ce5-b091-63a930a9271c None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:59.954409 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 234/468] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:04:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:04:59.955390 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774b3f66-9ff7-4ce5-b091-63a930a9271c None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:04:59.967579 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-b91fa6ac-9d30-46c7-9715-e7823528bd47 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 18:04:59.969434 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 235/469] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:04:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 18:04:59.976033 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9629174d-5a8f-4306-a9bb-19293d6977aa None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:59.976659 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9629174d-5a8f-4306-a9bb-19293d6977aa None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:59.977112 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9629174d-5a8f-4306-a9bb-19293d6977aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:04:59.979652 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774b3f66-9ff7-4ce5-b091-63a930a9271c None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:04:59.991935 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222322ce-c141-4df0-93ff-44dcc71fe296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:04:59.993152 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222322ce-c141-4df0-93ff-44dcc71fe296 admin admin] REQUEST_METHOD: `PUT` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:04:59.993575 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222322ce-c141-4df0-93ff-44dcc71fe296 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:04:59.994002 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222322ce-c141-4df0-93ff-44dcc71fe296 admin admin] PATH_INFO: `/v3/projects/e843aaa9e5e44a8e98f7cc7412d9697b/users/f6966ce0774f4437a9b688494e9d0574/roles/24b43b2260b1455e832abdff63df40bd` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:00.002867 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-9629174d-5a8f-4306-a9bb-19293d6977aa None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:05:00.004299 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-9629174d-5a8f-4306-a9bb-19293d6977aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:05:00.011955 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222322ce-c141-4df0-93ff-44dcc71fe296 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e843aaa9e5e44a8e98f7cc7412d9697b, user_id=f6966ce0774f4437a9b688494e9d0574, role_id=24b43b2260b1455e832abdff63df40bd)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:00.013196 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 236/470] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:04:59 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:05:00.014197 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9629174d-5a8f-4306-a9bb-19293d6977aa None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:00.022892 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222322ce-c141-4df0-93ff-44dcc71fe296 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:00.024721 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9629174d-5a8f-4306-a9bb-19293d6977aa None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:00.029715 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7d0535-d2d8-4b1d-8f70-c292c73ba762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:00.030663 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d0535-d2d8-4b1d-8f70-c292c73ba762 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:00.031085 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d0535-d2d8-4b1d-8f70-c292c73ba762 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:00.031499 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d0535-d2d8-4b1d-8f70-c292c73ba762 admin admin] PATH_INFO: `/v3/domains` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:00.032441 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7d0535-d2d8-4b1d-8f70-c292c73ba762 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:00.032882 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7d0535-d2d8-4b1d-8f70-c292c73ba762 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:00.034728 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7d0535-d2d8-4b1d-8f70-c292c73ba762 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:00.048587 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 237/471] 10.222.0.18 () {56 vars in 1130 bytes} [Tue Oct 12 18:05:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:00.049682 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7d0535-d2d8-4b1d-8f70-c292c73ba762 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:00.065520 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7d0535-d2d8-4b1d-8f70-c292c73ba762 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:00.070472 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb79c2c-b493-46bd-b574-a8b866605567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:00.071527 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb79c2c-b493-46bd-b574-a8b866605567 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:00.072015 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb79c2c-b493-46bd-b574-a8b866605567 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:00.072462 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb79c2c-b493-46bd-b574-a8b866605567 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:00.083568 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb79c2c-b493-46bd-b574-a8b866605567 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 18:05:00.090722 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-2bb79c2c-b493-46bd-b574-a8b866605567 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 18:05:00.095963 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 238/472] 10.222.0.18 () {56 vars in 1123 bytes} [Tue Oct 12 18:05:00 2021] GET /identity/v3/roles/service => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:00.095963 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb79c2c-b493-46bd-b574-a8b866605567 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:00.099061 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 235/473] 10.222.0.18 () {58 vars in 1460 bytes} [Tue Oct 12 18:04:59 2021] PUT /identity/v3/projects/e843aaa9e5e44a8e98f7cc7412d9697b/users/f6966ce0774f4437a9b688494e9d0574/roles/24b43b2260b1455e832abdff63df40bd => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 18:05:00.103500 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222322ce-c141-4df0-93ff-44dcc71fe296 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:00.108323 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb79c2c-b493-46bd-b574-a8b866605567 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:00.208095 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a5030d-0648-461b-8e4f-4c1653f14135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:00.209312 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a5030d-0648-461b-8e4f-4c1653f14135 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:00.209779 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a5030d-0648-461b-8e4f-4c1653f14135 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:00.210227 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a5030d-0648-461b-8e4f-4c1653f14135 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:00.218956 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a5030d-0648-461b-8e4f-4c1653f14135 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:00.221477 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a5030d-0648-461b-8e4f-4c1653f14135 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:00.236599 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-67a5030d-0648-461b-8e4f-4c1653f14135 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 12 18:05:00.238493 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 239/474] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Oct 12 18:05:00 2021] GET /identity/v3/users/glance => generated 84 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:00.239159 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222322ce-c141-4df0-93ff-44dcc71fe296 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:00.245233 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a5030d-0648-461b-8e4f-4c1653f14135 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:00.246481 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370c0727-e9ed-4a17-afa2-f10f8b1e48b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:00.247768 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c0727-e9ed-4a17-afa2-f10f8b1e48b7 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:00.252015 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c0727-e9ed-4a17-afa2-f10f8b1e48b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:00.252548 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c0727-e9ed-4a17-afa2-f10f8b1e48b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:00.253536 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370c0727-e9ed-4a17-afa2-f10f8b1e48b7 admin admin] RBAC: Adding query filter params (name=service) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:00.256616 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370c0727-e9ed-4a17-afa2-f10f8b1e48b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:00.260026 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370c0727-e9ed-4a17-afa2-f10f8b1e48b7 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:00.264468 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a5030d-0648-461b-8e4f-4c1653f14135 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:00.276572 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29793773-a2af-485a-ab96-56a58e58ee3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:00.277619 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29793773-a2af-485a-ab96-56a58e58ee3d admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:00.278468 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29793773-a2af-485a-ab96-56a58e58ee3d admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:00.279038 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 236/475] 10.222.0.18 () {56 vars in 1124 bytes} [Tue Oct 12 18:05:00 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:05:00.284873 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29793773-a2af-485a-ab96-56a58e58ee3d admin admin] PATH_INFO: `/v3/users` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:00.286144 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29793773-a2af-485a-ab96-56a58e58ee3d admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:00.286653 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29793773-a2af-485a-ab96-56a58e58ee3d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:00.289566 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29793773-a2af-485a-ab96-56a58e58ee3d admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:00.303428 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370c0727-e9ed-4a17-afa2-f10f8b1e48b7 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:00.316022 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370c0727-e9ed-4a17-afa2-f10f8b1e48b7 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:00.321266 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1edae7-4489-4bed-9a1b-cb4f509626cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:00.322376 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1edae7-4489-4bed-9a1b-cb4f509626cd admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:00.322899 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1edae7-4489-4bed-9a1b-cb4f509626cd admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:00.323353 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1edae7-4489-4bed-9a1b-cb4f509626cd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:00.327068 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 240/476] 10.222.0.18 () {56 vars in 1158 bytes} [Tue Oct 12 18:05:00 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:05:00.333649 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29793773-a2af-485a-ab96-56a58e58ee3d admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:00.335863 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1edae7-4489-4bed-9a1b-cb4f509626cd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:00.338166 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1edae7-4489-4bed-9a1b-cb4f509626cd admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:00.345772 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29793773-a2af-485a-ab96-56a58e58ee3d admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:00.360221 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-5a1edae7-4489-4bed-9a1b-cb4f509626cd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 18:05:00.361702 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 237/477] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:05:00 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:00.362219 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00274d70-6df9-4341-b9b0-14f98916df57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:00.363017 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00274d70-6df9-4341-b9b0-14f98916df57 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:00.363299 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00274d70-6df9-4341-b9b0-14f98916df57 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:00.363570 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00274d70-6df9-4341-b9b0-14f98916df57 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:00.369386 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1edae7-4489-4bed-9a1b-cb4f509626cd admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:00.381532 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00274d70-6df9-4341-b9b0-14f98916df57 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:00.382944 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1edae7-4489-4bed-9a1b-cb4f509626cd admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:00.383433 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00274d70-6df9-4341-b9b0-14f98916df57 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:00.389244 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387e2565-a3a2-422d-92d5-02c295d86caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:00.390328 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e2565-a3a2-422d-92d5-02c295d86caa admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:00.391162 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e2565-a3a2-422d-92d5-02c295d86caa admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:00.391714 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e2565-a3a2-422d-92d5-02c295d86caa admin admin] PATH_INFO: `/v3/domains` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:00.393384 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387e2565-a3a2-422d-92d5-02c295d86caa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:00.393933 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387e2565-a3a2-422d-92d5-02c295d86caa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:00.397150 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387e2565-a3a2-422d-92d5-02c295d86caa admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:00.404696 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-00274d70-6df9-4341-b9b0-14f98916df57 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 18:05:00.405715 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 241/478] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:05:00 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:00.410912 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 238/479] 10.222.0.18 () {56 vars in 1130 bytes} [Tue Oct 12 18:05:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:00.411868 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00274d70-6df9-4341-b9b0-14f98916df57 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:00.421343 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387e2565-a3a2-422d-92d5-02c295d86caa admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:00.426308 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00274d70-6df9-4341-b9b0-14f98916df57 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:00.432306 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08384949-0195-4ebb-afe4-d58b1b696793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:00.432985 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08384949-0195-4ebb-afe4-d58b1b696793 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:00.433266 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08384949-0195-4ebb-afe4-d58b1b696793 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:00.433540 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08384949-0195-4ebb-afe4-d58b1b696793 admin admin] PATH_INFO: `/v3/domains` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:00.434268 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08384949-0195-4ebb-afe4-d58b1b696793 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:00.434571 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08384949-0195-4ebb-afe4-d58b1b696793 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:00.436163 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08384949-0195-4ebb-afe4-d58b1b696793 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:00.439328 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387e2565-a3a2-422d-92d5-02c295d86caa admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:00.445345 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e5ce20-d305-4dc0-8878-d1124fbf7e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:00.446442 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5ce20-d305-4dc0-8878-d1124fbf7e0c admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:00.446750 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5ce20-d305-4dc0-8878-d1124fbf7e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:00.447002 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5ce20-d305-4dc0-8878-d1124fbf7e0c admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:00.451519 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 242/480] 10.222.0.18 () {56 vars in 1130 bytes} [Tue Oct 12 18:05:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:00.460609 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08384949-0195-4ebb-afe4-d58b1b696793 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:00.462063 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e5ce20-d305-4dc0-8878-d1124fbf7e0c admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:00.466524 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e5ce20-d305-4dc0-8878-d1124fbf7e0c admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:00.482297 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-99e5ce20-d305-4dc0-8878-d1124fbf7e0c admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 12 18:05:00.482718 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08384949-0195-4ebb-afe4-d58b1b696793 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:00.484343 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 239/481] 10.222.0.18 () {56 vars in 1123 bytes} [Tue Oct 12 18:05:00 2021] GET /identity/v3/users/neutron => generated 85 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:00.491338 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e5ce20-d305-4dc0-8878-d1124fbf7e0c admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:00.502001 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e5ce20-d305-4dc0-8878-d1124fbf7e0c admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:00.503777 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa1b7e7-2236-482e-afb6-0aa6d5f1c49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:00.504600 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa1b7e7-2236-482e-afb6-0aa6d5f1c49a admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:00.504882 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa1b7e7-2236-482e-afb6-0aa6d5f1c49a admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:00.505153 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa1b7e7-2236-482e-afb6-0aa6d5f1c49a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:00.508310 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c2f6a-31a1-45ba-bd2c-b200bfb9c481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:00.509186 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c2f6a-31a1-45ba-bd2c-b200bfb9c481 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:00.509675 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c2f6a-31a1-45ba-bd2c-b200bfb9c481 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:00.510144 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c2f6a-31a1-45ba-bd2c-b200bfb9c481 admin admin] PATH_INFO: `/v3/users` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:00.511193 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85c2f6a-31a1-45ba-bd2c-b200bfb9c481 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:00.511647 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85c2f6a-31a1-45ba-bd2c-b200bfb9c481 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:00.513913 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85c2f6a-31a1-45ba-bd2c-b200bfb9c481 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:00.525576 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa1b7e7-2236-482e-afb6-0aa6d5f1c49a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:00.527672 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa1b7e7-2236-482e-afb6-0aa6d5f1c49a admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:00.533989 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 240/482] 10.222.0.18 () {56 vars in 1160 bytes} [Tue Oct 12 18:05:00 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:00.540259 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3490cf-23a9-40e7-97cb-62d935012de2 None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:00.540766 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3490cf-23a9-40e7-97cb-62d935012de2 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:00.541216 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3490cf-23a9-40e7-97cb-62d935012de2 None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:00.542273 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-afa1b7e7-2236-482e-afb6-0aa6d5f1c49a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 18:05:00.543519 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 243/484] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Oct 12 18:05:00 2021] GET /identity/v3/projects/service => generated 88 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 18:05:00.543686 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 241/484] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:05:00 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:05:00.548426 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa1b7e7-2236-482e-afb6-0aa6d5f1c49a admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:00.550514 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b267703e-6c27-44c6-bd45-1ccc1d2c7aca None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:00.550951 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b267703e-6c27-44c6-bd45-1ccc1d2c7aca None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:00.551374 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b267703e-6c27-44c6-bd45-1ccc1d2c7aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:00.559153 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa1b7e7-2236-482e-afb6-0aa6d5f1c49a admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:00.564103 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895ed1a1-68b3-4582-8eaf-9e6163d88132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:00.564961 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ed1a1-68b3-4582-8eaf-9e6163d88132 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:00.565364 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ed1a1-68b3-4582-8eaf-9e6163d88132 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:00.565640 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ed1a1-68b3-4582-8eaf-9e6163d88132 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:00.572577 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-b267703e-6c27-44c6-bd45-1ccc1d2c7aca None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:05:00.573956 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-b267703e-6c27-44c6-bd45-1ccc1d2c7aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:05:00.577431 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895ed1a1-68b3-4582-8eaf-9e6163d88132 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:00.579343 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895ed1a1-68b3-4582-8eaf-9e6163d88132 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:00.582635 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 242/485] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:05:00 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:05:00.583610 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b267703e-6c27-44c6-bd45-1ccc1d2c7aca None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:00.596999 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b267703e-6c27-44c6-bd45-1ccc1d2c7aca None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:00.602421 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1fbb24-5db0-4adc-8d2b-f5230911dec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:00.603797 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1fbb24-5db0-4adc-8d2b-f5230911dec1 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:00.604443 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1fbb24-5db0-4adc-8d2b-f5230911dec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:00.604873 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1fbb24-5db0-4adc-8d2b-f5230911dec1 admin admin] PATH_INFO: `/v3/projects` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:00.605935 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1fbb24-5db0-4adc-8d2b-f5230911dec1 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:00.606390 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1fbb24-5db0-4adc-8d2b-f5230911dec1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:00.608513 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1fbb24-5db0-4adc-8d2b-f5230911dec1 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:00.621725 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-895ed1a1-68b3-4582-8eaf-9e6163d88132 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 18:05:00.623123 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 244/486] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:05:00 2021] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:00.623718 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895ed1a1-68b3-4582-8eaf-9e6163d88132 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:00.634080 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 243/487] 10.222.0.18 () {56 vars in 1169 bytes} [Tue Oct 12 18:05:00 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:00.635763 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1fbb24-5db0-4adc-8d2b-f5230911dec1 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:00.647693 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895ed1a1-68b3-4582-8eaf-9e6163d88132 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:00.648250 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1fbb24-5db0-4adc-8d2b-f5230911dec1 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:00.653103 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73e1ed4-1bdd-49e3-be08-7db763c4a58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:00.653546 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fcce9d-3eb6-4e7b-a7e3-3dba2d1eb451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:00.654243 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e1ed4-1bdd-49e3-be08-7db763c4a58e admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:00.654424 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fcce9d-3eb6-4e7b-a7e3-3dba2d1eb451 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:00.654803 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e1ed4-1bdd-49e3-be08-7db763c4a58e admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:00.654911 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fcce9d-3eb6-4e7b-a7e3-3dba2d1eb451 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:00.655276 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fcce9d-3eb6-4e7b-a7e3-3dba2d1eb451 admin admin] PATH_INFO: `/v3/domains` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:00.655437 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e1ed4-1bdd-49e3-be08-7db763c4a58e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:00.656250 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fcce9d-3eb6-4e7b-a7e3-3dba2d1eb451 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:00.656691 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fcce9d-3eb6-4e7b-a7e3-3dba2d1eb451 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:00.658665 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fcce9d-3eb6-4e7b-a7e3-3dba2d1eb451 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:00.666567 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73e1ed4-1bdd-49e3-be08-7db763c4a58e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 18:05:00.671662 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 244/488] 10.222.0.18 () {56 vars in 1130 bytes} [Tue Oct 12 18:05:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:00.677093 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fcce9d-3eb6-4e7b-a7e3-3dba2d1eb451 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:00.679253 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-d73e1ed4-1bdd-49e3-be08-7db763c4a58e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 18:05:00.680590 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 245/489] 10.222.0.18 () {56 vars in 1123 bytes} [Tue Oct 12 18:05:00 2021] GET /identity/v3/roles/service => generated 85 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:00.682938 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73e1ed4-1bdd-49e3-be08-7db763c4a58e admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:00.694821 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fcce9d-3eb6-4e7b-a7e3-3dba2d1eb451 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:00.698260 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73e1ed4-1bdd-49e3-be08-7db763c4a58e admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:00.700389 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9fda6e-d757-4d08-ad5a-72015d3f0c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:00.701692 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9fda6e-d757-4d08-ad5a-72015d3f0c2c admin admin] REQUEST_METHOD: `PUT` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:00.702196 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9fda6e-d757-4d08-ad5a-72015d3f0c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:00.702748 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9fda6e-d757-4d08-ad5a-72015d3f0c2c admin admin] PATH_INFO: `/v3/projects/e843aaa9e5e44a8e98f7cc7412d9697b/users/7a3d3e5a5cfc4ac3afcece4e55f23552/roles/24b43b2260b1455e832abdff63df40bd` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:00.702931 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f243cc79-d228-4092-a71f-1544be130fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:00.703634 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f243cc79-d228-4092-a71f-1544be130fa3 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:00.704003 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f243cc79-d228-4092-a71f-1544be130fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:00.704282 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f243cc79-d228-4092-a71f-1544be130fa3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:00.711626 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f243cc79-d228-4092-a71f-1544be130fa3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:00.714051 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f243cc79-d228-4092-a71f-1544be130fa3 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:00.720938 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9fda6e-d757-4d08-ad5a-72015d3f0c2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e843aaa9e5e44a8e98f7cc7412d9697b, user_id=7a3d3e5a5cfc4ac3afcece4e55f23552, role_id=24b43b2260b1455e832abdff63df40bd)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:00.723816 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9fda6e-d757-4d08-ad5a-72015d3f0c2c admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:00.728172 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-f243cc79-d228-4092-a71f-1544be130fa3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 18:05:00.732486 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 246/490] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Oct 12 18:05:00 2021] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:00.732486 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f243cc79-d228-4092-a71f-1544be130fa3 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:00.743600 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f243cc79-d228-4092-a71f-1544be130fa3 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:00.748269 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f194e076-a7a6-4b12-b69c-708515c20956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:00.749087 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f194e076-a7a6-4b12-b69c-708515c20956 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:00.749577 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f194e076-a7a6-4b12-b69c-708515c20956 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:00.749997 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f194e076-a7a6-4b12-b69c-708515c20956 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:00.750893 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f194e076-a7a6-4b12-b69c-708515c20956 admin admin] RBAC: Adding query filter params (name=service) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:00.751342 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f194e076-a7a6-4b12-b69c-708515c20956 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:00.753176 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f194e076-a7a6-4b12-b69c-708515c20956 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:00.762163 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 247/491] 10.222.0.18 () {56 vars in 1124 bytes} [Tue Oct 12 18:05:00 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:00.763104 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f194e076-a7a6-4b12-b69c-708515c20956 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:00.774254 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f194e076-a7a6-4b12-b69c-708515c20956 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:00.779176 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122f1023-e16b-4148-96c9-90b614582014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:00.780008 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f1023-e16b-4148-96c9-90b614582014 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:00.783609 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f1023-e16b-4148-96c9-90b614582014 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:00.783609 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f1023-e16b-4148-96c9-90b614582014 admin admin] PATH_INFO: `/v3/projects` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:00.783609 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122f1023-e16b-4148-96c9-90b614582014 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:00.783609 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122f1023-e16b-4148-96c9-90b614582014 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:00.784292 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122f1023-e16b-4148-96c9-90b614582014 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:00.798259 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 248/492] 10.222.0.18 () {56 vars in 1169 bytes} [Tue Oct 12 18:05:00 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:00.798259 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122f1023-e16b-4148-96c9-90b614582014 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:00.808051 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122f1023-e16b-4148-96c9-90b614582014 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:00.812540 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc75d91b-82d4-470b-b0d4-3484d1e2116b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:00.813381 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75d91b-82d4-470b-b0d4-3484d1e2116b admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:00.825707 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75d91b-82d4-470b-b0d4-3484d1e2116b admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:00.825707 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75d91b-82d4-470b-b0d4-3484d1e2116b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:00.825707 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc75d91b-82d4-470b-b0d4-3484d1e2116b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:00.826792 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc75d91b-82d4-470b-b0d4-3484d1e2116b admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:00.842821 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-cc75d91b-82d4-470b-b0d4-3484d1e2116b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 18:05:00.844248 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 249/493] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:05:00 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:00.845573 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc75d91b-82d4-470b-b0d4-3484d1e2116b admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:00.855796 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc75d91b-82d4-470b-b0d4-3484d1e2116b admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:00.860308 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4998363f-2671-4743-81e9-1d6122f9c340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:00.861225 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4998363f-2671-4743-81e9-1d6122f9c340 admin admin] REQUEST_METHOD: `PUT` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:00.861582 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4998363f-2671-4743-81e9-1d6122f9c340 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:00.861928 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4998363f-2671-4743-81e9-1d6122f9c340 admin admin] PATH_INFO: `/v3/projects/e843aaa9e5e44a8e98f7cc7412d9697b/users/9a1ea6f47a7c41aba102ad481f5ad5c8/roles/24b43b2260b1455e832abdff63df40bd` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:00.872938 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 245/494] 10.222.0.18 () {58 vars in 1460 bytes} [Tue Oct 12 18:05:00 2021] PUT /identity/v3/projects/e843aaa9e5e44a8e98f7cc7412d9697b/users/7a3d3e5a5cfc4ac3afcece4e55f23552/roles/24b43b2260b1455e832abdff63df40bd => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:05:00.874194 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9fda6e-d757-4d08-ad5a-72015d3f0c2c admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:00.877619 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4998363f-2671-4743-81e9-1d6122f9c340 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e843aaa9e5e44a8e98f7cc7412d9697b, user_id=9a1ea6f47a7c41aba102ad481f5ad5c8, role_id=24b43b2260b1455e832abdff63df40bd)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:00.880958 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4998363f-2671-4743-81e9-1d6122f9c340 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:00.949630 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9fda6e-d757-4d08-ad5a-72015d3f0c2c admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:00.955296 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b5ed5a-1a79-4cb3-ad5b-50d63c2e55df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:00.956463 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b5ed5a-1a79-4cb3-ad5b-50d63c2e55df admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:00.956911 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b5ed5a-1a79-4cb3-ad5b-50d63c2e55df admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:00.957374 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b5ed5a-1a79-4cb3-ad5b-50d63c2e55df admin admin] PATH_INFO: `/v3/domains` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:00.958272 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b5ed5a-1a79-4cb3-ad5b-50d63c2e55df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:00.959289 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b5ed5a-1a79-4cb3-ad5b-50d63c2e55df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:00.961368 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b5ed5a-1a79-4cb3-ad5b-50d63c2e55df admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:00.974958 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 250/495] 10.222.0.18 () {58 vars in 1460 bytes} [Tue Oct 12 18:05:00 2021] PUT /identity/v3/projects/e843aaa9e5e44a8e98f7cc7412d9697b/users/9a1ea6f47a7c41aba102ad481f5ad5c8/roles/24b43b2260b1455e832abdff63df40bd => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:05:00.979645 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 246/496] 10.222.0.18 () {56 vars in 1130 bytes} [Tue Oct 12 18:05:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:00.987168 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4998363f-2671-4743-81e9-1d6122f9c340 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:01.061609 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4998363f-2671-4743-81e9-1d6122f9c340 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:01.066806 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62315dd2-9bee-4efa-8779-1d42caa3d37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:01.068537 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62315dd2-9bee-4efa-8779-1d42caa3d37d admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:01.068961 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62315dd2-9bee-4efa-8779-1d42caa3d37d admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:01.069371 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62315dd2-9bee-4efa-8779-1d42caa3d37d admin admin] PATH_INFO: `/v3/users/swift` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:01.083141 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62315dd2-9bee-4efa-8779-1d42caa3d37d admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:01.085693 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62315dd2-9bee-4efa-8779-1d42caa3d37d admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:01.104042 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-62315dd2-9bee-4efa-8779-1d42caa3d37d admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 12 18:05:01.105338 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 251/497] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Oct 12 18:05:00 2021] GET /identity/v3/users/swift => generated 83 bytes in 119 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:01.111953 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b5ed5a-1a79-4cb3-ad5b-50d63c2e55df admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:01.123015 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b5ed5a-1a79-4cb3-ad5b-50d63c2e55df admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:01.129902 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef95aa28-d22c-4243-8cc1-60a510f77e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:01.130635 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef95aa28-d22c-4243-8cc1-60a510f77e5d admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:01.130917 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef95aa28-d22c-4243-8cc1-60a510f77e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:01.131192 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef95aa28-d22c-4243-8cc1-60a510f77e5d admin admin] PATH_INFO: `/v3/users` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:01.132141 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef95aa28-d22c-4243-8cc1-60a510f77e5d admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:01.132473 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef95aa28-d22c-4243-8cc1-60a510f77e5d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:01.137376 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef95aa28-d22c-4243-8cc1-60a510f77e5d admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:01.160721 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 247/498] 10.222.0.18 () {56 vars in 1156 bytes} [Tue Oct 12 18:05:01 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:01.163591 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62315dd2-9bee-4efa-8779-1d42caa3d37d admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:01.176598 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62315dd2-9bee-4efa-8779-1d42caa3d37d admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:01.181673 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb83d98-4aca-49a1-bc5b-a1a7209c4e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:01.182404 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb83d98-4aca-49a1-bc5b-a1a7209c4e11 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:01.182731 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb83d98-4aca-49a1-bc5b-a1a7209c4e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:01.183012 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb83d98-4aca-49a1-bc5b-a1a7209c4e11 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:01.197386 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb83d98-4aca-49a1-bc5b-a1a7209c4e11 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:01.199269 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb83d98-4aca-49a1-bc5b-a1a7209c4e11 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:01.215697 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 252/499] 10.222.0.18 () {58 vars in 1324 bytes} [Tue Oct 12 18:05:01 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:05:01.222114 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef95aa28-d22c-4243-8cc1-60a510f77e5d admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:01.233251 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef95aa28-d22c-4243-8cc1-60a510f77e5d admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:01.238543 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac46cdc-0f60-4d1e-a63e-043bf8d13076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:01.239351 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac46cdc-0f60-4d1e-a63e-043bf8d13076 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:01.239632 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac46cdc-0f60-4d1e-a63e-043bf8d13076 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:01.239942 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac46cdc-0f60-4d1e-a63e-043bf8d13076 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:01.251269 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac46cdc-0f60-4d1e-a63e-043bf8d13076 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:01.253167 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac46cdc-0f60-4d1e-a63e-043bf8d13076 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:01.272724 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-eac46cdc-0f60-4d1e-a63e-043bf8d13076 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 18:05:01.274237 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 248/500] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:05:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:01.280593 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb83d98-4aca-49a1-bc5b-a1a7209c4e11 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:01.290038 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb83d98-4aca-49a1-bc5b-a1a7209c4e11 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:01.294452 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f616448-1e88-452c-ae95-09e8a96a74a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:01.295105 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f616448-1e88-452c-ae95-09e8a96a74a5 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:01.295383 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f616448-1e88-452c-ae95-09e8a96a74a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:01.295656 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f616448-1e88-452c-ae95-09e8a96a74a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:01.296381 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f616448-1e88-452c-ae95-09e8a96a74a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:01.298161 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f616448-1e88-452c-ae95-09e8a96a74a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:01.299765 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f616448-1e88-452c-ae95-09e8a96a74a5 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:01.316893 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 253/501] 10.222.0.18 () {56 vars in 1130 bytes} [Tue Oct 12 18:05:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:01.323155 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac46cdc-0f60-4d1e-a63e-043bf8d13076 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:01.333109 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac46cdc-0f60-4d1e-a63e-043bf8d13076 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:01.338220 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d90750-ad85-4e98-b022-77b33d873f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:01.339059 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d90750-ad85-4e98-b022-77b33d873f94 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:01.339334 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d90750-ad85-4e98-b022-77b33d873f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:01.339604 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d90750-ad85-4e98-b022-77b33d873f94 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:01.346955 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d90750-ad85-4e98-b022-77b33d873f94 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:01.349123 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d90750-ad85-4e98-b022-77b33d873f94 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:01.362470 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-98d90750-ad85-4e98-b022-77b33d873f94 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 18:05:01.363659 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 249/502] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Oct 12 18:05:01 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:01.370681 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f616448-1e88-452c-ae95-09e8a96a74a5 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:01.381757 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f616448-1e88-452c-ae95-09e8a96a74a5 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:01.386408 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af1538-7287-489d-9233-d9cabc8c5fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:01.387179 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af1538-7287-489d-9233-d9cabc8c5fc1 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:01.387532 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af1538-7287-489d-9233-d9cabc8c5fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:01.387872 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af1538-7287-489d-9233-d9cabc8c5fc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:01.388808 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9af1538-7287-489d-9233-d9cabc8c5fc1 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:01.389185 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9af1538-7287-489d-9233-d9cabc8c5fc1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:01.391531 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9af1538-7287-489d-9233-d9cabc8c5fc1 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:01.404808 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 254/503] 10.222.0.18 () {56 vars in 1169 bytes} [Tue Oct 12 18:05:01 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:01.411499 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d90750-ad85-4e98-b022-77b33d873f94 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:01.423472 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d90750-ad85-4e98-b022-77b33d873f94 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:01.428950 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c2e75e-d5d3-4491-b086-695c24137d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:01.429780 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c2e75e-d5d3-4491-b086-695c24137d63 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:01.430129 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c2e75e-d5d3-4491-b086-695c24137d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:01.430518 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c2e75e-d5d3-4491-b086-695c24137d63 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:01.431438 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c2e75e-d5d3-4491-b086-695c24137d63 admin admin] RBAC: Adding query filter params (role.id=24b43b2260b1455e832abdff63df40bd, scope.project.id=e843aaa9e5e44a8e98f7cc7412d9697b, user.id=7f527f925af24eba8cabffe457fceb09) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:01.431954 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c2e75e-d5d3-4491-b086-695c24137d63 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:01.433957 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c2e75e-d5d3-4491-b086-695c24137d63 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:01.440483 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 250/504] 10.222.0.18 () {56 vars in 1395 bytes} [Tue Oct 12 18:05:01 2021] GET /identity/v3/role_assignments?user.id=7f527f925af24eba8cabffe457fceb09&scope.project.id=e843aaa9e5e44a8e98f7cc7412d9697b&role.id=24b43b2260b1455e832abdff63df40bd => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:02.534636 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba083dd9-49eb-4497-9255-446cdc83a960 None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:02.535389 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba083dd9-49eb-4497-9255-446cdc83a960 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:02.535389 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba083dd9-49eb-4497-9255-446cdc83a960 None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:02.537891 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 255/505] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:05:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:05:02.544187 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a9193-304b-411b-87bc-c2f3e6b83b45 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:02.544871 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a9193-304b-411b-87bc-c2f3e6b83b45 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:02.544871 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a9193-304b-411b-87bc-c2f3e6b83b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:02.566325 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-759a9193-304b-411b-87bc-c2f3e6b83b45 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:05:02.567511 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-759a9193-304b-411b-87bc-c2f3e6b83b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:05:02.578546 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 251/506] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:05:02 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:05:02.609973 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba083dd9-49eb-4497-9255-446cdc83a960 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:02.635594 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba083dd9-49eb-4497-9255-446cdc83a960 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:02.639882 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63656f45-a782-416f-a869-7b44aa8efe24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:02.644797 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63656f45-a782-416f-a869-7b44aa8efe24 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:02.645089 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63656f45-a782-416f-a869-7b44aa8efe24 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:02.645367 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63656f45-a782-416f-a869-7b44aa8efe24 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:02.661712 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63656f45-a782-416f-a869-7b44aa8efe24 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 18:05:02.669384 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-63656f45-a782-416f-a869-7b44aa8efe24 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 18:05:02.670995 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 256/507] 10.222.0.18 () {56 vars in 1123 bytes} [Tue Oct 12 18:05:02 2021] GET /identity/v3/roles/service => generated 85 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:02.677030 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759a9193-304b-411b-87bc-c2f3e6b83b45 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:02.686948 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759a9193-304b-411b-87bc-c2f3e6b83b45 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:02.691560 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80077d01-b374-4230-a716-edb019d8637a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:02.692239 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80077d01-b374-4230-a716-edb019d8637a admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:02.692550 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80077d01-b374-4230-a716-edb019d8637a admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:02.692920 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80077d01-b374-4230-a716-edb019d8637a admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:02.693744 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80077d01-b374-4230-a716-edb019d8637a admin admin] RBAC: Adding query filter params (name=service) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:02.694050 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80077d01-b374-4230-a716-edb019d8637a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:02.695640 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80077d01-b374-4230-a716-edb019d8637a admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:02.712100 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 252/508] 10.222.0.18 () {56 vars in 1124 bytes} [Tue Oct 12 18:05:02 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:02.718177 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63656f45-a782-416f-a869-7b44aa8efe24 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:02.733446 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63656f45-a782-416f-a869-7b44aa8efe24 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:02.737878 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b906fc4-d64c-4cc6-96a3-c6c71baaed42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:02.738660 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b906fc4-d64c-4cc6-96a3-c6c71baaed42 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:02.738935 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b906fc4-d64c-4cc6-96a3-c6c71baaed42 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:02.739203 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b906fc4-d64c-4cc6-96a3-c6c71baaed42 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:02.753714 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b906fc4-d64c-4cc6-96a3-c6c71baaed42 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:02.755614 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b906fc4-d64c-4cc6-96a3-c6c71baaed42 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:02.776426 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-8b906fc4-d64c-4cc6-96a3-c6c71baaed42 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 18:05:02.777852 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 257/509] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:05:02 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:02.783673 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80077d01-b374-4230-a716-edb019d8637a admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:02.800952 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80077d01-b374-4230-a716-edb019d8637a admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:02.801806 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a9139a-1570-48c7-80d0-923600399705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:02.802538 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9139a-1570-48c7-80d0-923600399705 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:02.802821 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9139a-1570-48c7-80d0-923600399705 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:02.803093 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9139a-1570-48c7-80d0-923600399705 admin admin] PATH_INFO: `/v3/domains` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:02.803826 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a9139a-1570-48c7-80d0-923600399705 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:02.804128 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a9139a-1570-48c7-80d0-923600399705 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:02.805746 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a9139a-1570-48c7-80d0-923600399705 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:02.821251 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 253/510] 10.222.0.18 () {56 vars in 1130 bytes} [Tue Oct 12 18:05:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:02.825246 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c5fb2-3e2f-4528-ba79-5efdfdb30241 None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:02.825529 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c5fb2-3e2f-4528-ba79-5efdfdb30241 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:02.825801 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c5fb2-3e2f-4528-ba79-5efdfdb30241 None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:02.827698 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 258/511] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:05:02 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:05:02.828425 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a9139a-1570-48c7-80d0-923600399705 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:02.832865 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837bc026-dbfe-4bcb-8cd0-17b01fae9439 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:02.833142 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837bc026-dbfe-4bcb-8cd0-17b01fae9439 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:02.833407 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837bc026-dbfe-4bcb-8cd0-17b01fae9439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:02.852196 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a9139a-1570-48c7-80d0-923600399705 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:02.859495 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-837bc026-dbfe-4bcb-8cd0-17b01fae9439 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:05:02.862430 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da14ebb-21a2-4175-81ea-58b3b6ec6684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:02.862908 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-837bc026-dbfe-4bcb-8cd0-17b01fae9439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:05:02.864297 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da14ebb-21a2-4175-81ea-58b3b6ec6684 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:02.864598 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da14ebb-21a2-4175-81ea-58b3b6ec6684 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:02.865811 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da14ebb-21a2-4175-81ea-58b3b6ec6684 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:02.878589 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 259/512] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:05:02 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:05:02.879871 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da14ebb-21a2-4175-81ea-58b3b6ec6684 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:02.882232 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da14ebb-21a2-4175-81ea-58b3b6ec6684 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:02.896882 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-4da14ebb-21a2-4175-81ea-58b3b6ec6684 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 12 18:05:02.898301 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 254/513] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Oct 12 18:05:02 2021] GET /identity/v3/users/nova => generated 82 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:02.904042 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837bc026-dbfe-4bcb-8cd0-17b01fae9439 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:02.914240 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837bc026-dbfe-4bcb-8cd0-17b01fae9439 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:02.918675 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b788427-999d-4ee2-9d02-cd3e505d8630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:02.919365 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b788427-999d-4ee2-9d02-cd3e505d8630 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:02.919645 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b788427-999d-4ee2-9d02-cd3e505d8630 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:02.919912 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b788427-999d-4ee2-9d02-cd3e505d8630 admin admin] PATH_INFO: `/v3/users` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:02.920779 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b788427-999d-4ee2-9d02-cd3e505d8630 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:02.921089 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b788427-999d-4ee2-9d02-cd3e505d8630 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:02.922995 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b788427-999d-4ee2-9d02-cd3e505d8630 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:02.946891 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 260/514] 10.222.0.18 () {56 vars in 1154 bytes} [Tue Oct 12 18:05:02 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:02.949076 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da14ebb-21a2-4175-81ea-58b3b6ec6684 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:02.959623 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da14ebb-21a2-4175-81ea-58b3b6ec6684 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:02.960862 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b788427-999d-4ee2-9d02-cd3e505d8630 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:02.970187 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cc22ff-cca5-4fd3-9aae-b814fea6ebb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:02.972221 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cc22ff-cca5-4fd3-9aae-b814fea6ebb3 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:02.972691 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cc22ff-cca5-4fd3-9aae-b814fea6ebb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:02.973010 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cc22ff-cca5-4fd3-9aae-b814fea6ebb3 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:02.978898 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b788427-999d-4ee2-9d02-cd3e505d8630 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:02.989185 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352b6b56-d255-4e4a-a8c3-23f0dfc02a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:02.991095 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352b6b56-d255-4e4a-a8c3-23f0dfc02a7a admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:02.991375 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352b6b56-d255-4e4a-a8c3-23f0dfc02a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:02.991644 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352b6b56-d255-4e4a-a8c3-23f0dfc02a7a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:02.996463 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cc22ff-cca5-4fd3-9aae-b814fea6ebb3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 18:05:03.009690 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352b6b56-d255-4e4a-a8c3-23f0dfc02a7a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:03.011529 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352b6b56-d255-4e4a-a8c3-23f0dfc02a7a admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:03.012239 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-b4cc22ff-cca5-4fd3-9aae-b814fea6ebb3 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 18:05:03.015616 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 255/515] 10.222.0.18 () {56 vars in 1123 bytes} [Tue Oct 12 18:05:02 2021] GET /identity/v3/roles/service => generated 85 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:03.024317 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cc22ff-cca5-4fd3-9aae-b814fea6ebb3 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:03.035746 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 261/516] 10.222.0.18 () {58 vars in 1324 bytes} [Tue Oct 12 18:05:02 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:05:03.036088 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cc22ff-cca5-4fd3-9aae-b814fea6ebb3 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:03.043082 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352b6b56-d255-4e4a-a8c3-23f0dfc02a7a admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:03.053018 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29038da9-c747-4bdf-aea0-b97a7c013a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:03.053671 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29038da9-c747-4bdf-aea0-b97a7c013a37 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:03.053946 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29038da9-c747-4bdf-aea0-b97a7c013a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:03.054217 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29038da9-c747-4bdf-aea0-b97a7c013a37 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:03.055040 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29038da9-c747-4bdf-aea0-b97a7c013a37 admin admin] RBAC: Adding query filter params (name=service) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:03.055342 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29038da9-c747-4bdf-aea0-b97a7c013a37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:03.058249 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29038da9-c747-4bdf-aea0-b97a7c013a37 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:03.061523 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352b6b56-d255-4e4a-a8c3-23f0dfc02a7a admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:03.072648 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5442384a-16c4-4d93-ad66-bb3cad561070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:03.073500 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5442384a-16c4-4d93-ad66-bb3cad561070 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:03.073774 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5442384a-16c4-4d93-ad66-bb3cad561070 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:03.074090 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5442384a-16c4-4d93-ad66-bb3cad561070 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:03.080979 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 256/517] 10.222.0.18 () {56 vars in 1124 bytes} [Tue Oct 12 18:05:03 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:05:03.084614 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29038da9-c747-4bdf-aea0-b97a7c013a37 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:03.093947 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5442384a-16c4-4d93-ad66-bb3cad561070 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:03.096906 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5442384a-16c4-4d93-ad66-bb3cad561070 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:03.102512 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29038da9-c747-4bdf-aea0-b97a7c013a37 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:03.111227 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80efee3-646e-4954-94f3-5a48057a8db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:03.113291 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80efee3-646e-4954-94f3-5a48057a8db6 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:03.113573 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80efee3-646e-4954-94f3-5a48057a8db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:03.113847 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80efee3-646e-4954-94f3-5a48057a8db6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:03.134795 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-5442384a-16c4-4d93-ad66-bb3cad561070 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 18:05:03.136009 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 262/518] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:05:03 2021] GET /identity/v3/domains/Default => generated 87 bytes in 93 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:03.141677 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80efee3-646e-4954-94f3-5a48057a8db6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:03.143599 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80efee3-646e-4954-94f3-5a48057a8db6 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:03.147838 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5442384a-16c4-4d93-ad66-bb3cad561070 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:03.162924 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5442384a-16c4-4d93-ad66-bb3cad561070 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:03.175907 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2679ad9-bc75-4f0d-b53f-e8dcc671695e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:03.176661 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2679ad9-bc75-4f0d-b53f-e8dcc671695e admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:03.176942 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2679ad9-bc75-4f0d-b53f-e8dcc671695e admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:03.177245 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2679ad9-bc75-4f0d-b53f-e8dcc671695e admin admin] PATH_INFO: `/v3/domains` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:03.177987 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2679ad9-bc75-4f0d-b53f-e8dcc671695e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:03.178340 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2679ad9-bc75-4f0d-b53f-e8dcc671695e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:03.181826 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-d80efee3-646e-4954-94f3-5a48057a8db6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 18:05:03.183388 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 257/519] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:05:03 2021] GET /identity/v3/domains/Default => generated 87 bytes in 99 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 18:05:03.183738 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2679ad9-bc75-4f0d-b53f-e8dcc671695e admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:03.189041 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80efee3-646e-4954-94f3-5a48057a8db6 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:03.204512 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80efee3-646e-4954-94f3-5a48057a8db6 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:03.207555 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 263/520] 10.222.0.18 () {56 vars in 1130 bytes} [Tue Oct 12 18:05:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:05:03.216263 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568ce844-72c7-44c1-ba15-ac7e594a567d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:03.216994 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568ce844-72c7-44c1-ba15-ac7e594a567d admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:03.217271 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568ce844-72c7-44c1-ba15-ac7e594a567d admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:03.217597 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568ce844-72c7-44c1-ba15-ac7e594a567d admin admin] PATH_INFO: `/v3/domains` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:03.218485 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568ce844-72c7-44c1-ba15-ac7e594a567d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:03.218790 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568ce844-72c7-44c1-ba15-ac7e594a567d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:03.220509 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568ce844-72c7-44c1-ba15-ac7e594a567d admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:03.224233 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2679ad9-bc75-4f0d-b53f-e8dcc671695e admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:03.234279 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2679ad9-bc75-4f0d-b53f-e8dcc671695e admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:03.245510 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c24513-14ad-4bcf-a9b6-6d687bef5e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:03.246292 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c24513-14ad-4bcf-a9b6-6d687bef5e42 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:03.247271 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c24513-14ad-4bcf-a9b6-6d687bef5e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:03.247586 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c24513-14ad-4bcf-a9b6-6d687bef5e42 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:03.252862 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 258/521] 10.222.0.18 () {56 vars in 1130 bytes} [Tue Oct 12 18:05:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:05:03.257999 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c24513-14ad-4bcf-a9b6-6d687bef5e42 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:03.259317 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568ce844-72c7-44c1-ba15-ac7e594a567d admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:03.266641 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c24513-14ad-4bcf-a9b6-6d687bef5e42 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:03.271877 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568ce844-72c7-44c1-ba15-ac7e594a567d admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:03.280506 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1abea46-55de-4f4d-8a44-1cbd536bc8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:03.281416 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1abea46-55de-4f4d-8a44-1cbd536bc8e5 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:03.281797 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1abea46-55de-4f4d-8a44-1cbd536bc8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:03.282173 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1abea46-55de-4f4d-8a44-1cbd536bc8e5 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:03.291938 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-11c24513-14ad-4bcf-a9b6-6d687bef5e42 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 18:05:03.294171 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 264/522] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Oct 12 18:05:03 2021] GET /identity/v3/projects/service => generated 88 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 18:05:03.300246 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1abea46-55de-4f4d-8a44-1cbd536bc8e5 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:03.300629 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c24513-14ad-4bcf-a9b6-6d687bef5e42 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:03.302883 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1abea46-55de-4f4d-8a44-1cbd536bc8e5 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:03.321124 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c24513-14ad-4bcf-a9b6-6d687bef5e42 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:03.321787 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-f1abea46-55de-4f4d-8a44-1cbd536bc8e5 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 12 18:05:03.323566 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 259/523] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Oct 12 18:05:03 2021] GET /identity/v3/users/cinder => generated 84 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 18:05:03.329802 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1abea46-55de-4f4d-8a44-1cbd536bc8e5 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:03.330047 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e344eb15-34f2-4746-81c8-c5812b30f007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:03.330811 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344eb15-34f2-4746-81c8-c5812b30f007 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:03.331189 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344eb15-34f2-4746-81c8-c5812b30f007 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:03.331462 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344eb15-34f2-4746-81c8-c5812b30f007 admin admin] PATH_INFO: `/v3/projects` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:03.332260 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e344eb15-34f2-4746-81c8-c5812b30f007 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:03.332588 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e344eb15-34f2-4746-81c8-c5812b30f007 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:03.335006 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e344eb15-34f2-4746-81c8-c5812b30f007 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:03.348314 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1abea46-55de-4f4d-8a44-1cbd536bc8e5 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:03.356065 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c99777-dd9b-430f-9b7e-68968d40e9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:03.356959 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c99777-dd9b-430f-9b7e-68968d40e9dd admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:03.357470 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c99777-dd9b-430f-9b7e-68968d40e9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:03.357905 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c99777-dd9b-430f-9b7e-68968d40e9dd admin admin] PATH_INFO: `/v3/users` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:03.358120 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 265/524] 10.222.0.18 () {56 vars in 1169 bytes} [Tue Oct 12 18:05:03 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:05:03.359160 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c99777-dd9b-430f-9b7e-68968d40e9dd admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:03.359604 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c99777-dd9b-430f-9b7e-68968d40e9dd admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:03.361796 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e344eb15-34f2-4746-81c8-c5812b30f007 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:03.365192 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c99777-dd9b-430f-9b7e-68968d40e9dd admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:03.379595 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e344eb15-34f2-4746-81c8-c5812b30f007 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:03.392881 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 260/525] 10.222.0.18 () {56 vars in 1158 bytes} [Tue Oct 12 18:05:03 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:05:03.400869 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b68ca82-6b96-4cf4-b30b-f3242e6cfe8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:03.402190 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c99777-dd9b-430f-9b7e-68968d40e9dd admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:03.402848 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b68ca82-6b96-4cf4-b30b-f3242e6cfe8d admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:03.404090 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b68ca82-6b96-4cf4-b30b-f3242e6cfe8d admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:03.405455 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b68ca82-6b96-4cf4-b30b-f3242e6cfe8d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:03.406454 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b68ca82-6b96-4cf4-b30b-f3242e6cfe8d admin admin] RBAC: Adding query filter params (role.id=24b43b2260b1455e832abdff63df40bd, scope.project.id=e843aaa9e5e44a8e98f7cc7412d9697b, user.id=3417097a280b499086b36df9a2548239) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:03.408473 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b68ca82-6b96-4cf4-b30b-f3242e6cfe8d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:03.410566 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b68ca82-6b96-4cf4-b30b-f3242e6cfe8d admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:03.420534 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c99777-dd9b-430f-9b7e-68968d40e9dd admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:03.423314 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 266/526] 10.222.0.18 () {56 vars in 1395 bytes} [Tue Oct 12 18:05:03 2021] GET /identity/v3/role_assignments?user.id=3417097a280b499086b36df9a2548239&scope.project.id=e843aaa9e5e44a8e98f7cc7412d9697b&role.id=24b43b2260b1455e832abdff63df40bd => generated 608 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:03.436706 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1684f50a-f385-44b2-bd6b-bc268ae0ee63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:03.437703 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1684f50a-f385-44b2-bd6b-bc268ae0ee63 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:03.438135 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1684f50a-f385-44b2-bd6b-bc268ae0ee63 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:03.438573 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1684f50a-f385-44b2-bd6b-bc268ae0ee63 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:03.452556 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1684f50a-f385-44b2-bd6b-bc268ae0ee63 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:03.454644 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1684f50a-f385-44b2-bd6b-bc268ae0ee63 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:03.471038 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 261/527] 10.222.0.18 () {58 vars in 1324 bytes} [Tue Oct 12 18:05:03 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:05:03.477630 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b68ca82-6b96-4cf4-b30b-f3242e6cfe8d admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:03.488376 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b68ca82-6b96-4cf4-b30b-f3242e6cfe8d admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:03.497908 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc22c48-1d7e-409f-8fe8-e52d2a6ff3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:03.499061 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc22c48-1d7e-409f-8fe8-e52d2a6ff3f0 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:03.499558 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc22c48-1d7e-409f-8fe8-e52d2a6ff3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:03.499970 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc22c48-1d7e-409f-8fe8-e52d2a6ff3f0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:03.521061 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc22c48-1d7e-409f-8fe8-e52d2a6ff3f0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:03.522964 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc22c48-1d7e-409f-8fe8-e52d2a6ff3f0 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:03.551193 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-6bc22c48-1d7e-409f-8fe8-e52d2a6ff3f0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 18:05:03.553059 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 267/528] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:05:03 2021] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:03.559760 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1684f50a-f385-44b2-bd6b-bc268ae0ee63 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:03.577198 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1684f50a-f385-44b2-bd6b-bc268ae0ee63 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:03.585498 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf7c142-bc45-44d7-92cf-6ca39fde9087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:03.586600 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf7c142-bc45-44d7-92cf-6ca39fde9087 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:03.587119 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf7c142-bc45-44d7-92cf-6ca39fde9087 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:03.587600 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf7c142-bc45-44d7-92cf-6ca39fde9087 admin admin] PATH_INFO: `/v3/domains` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:03.588619 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf7c142-bc45-44d7-92cf-6ca39fde9087 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:03.589132 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf7c142-bc45-44d7-92cf-6ca39fde9087 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:03.590957 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf7c142-bc45-44d7-92cf-6ca39fde9087 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:03.610851 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 262/529] 10.222.0.18 () {56 vars in 1130 bytes} [Tue Oct 12 18:05:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:03.621756 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc22c48-1d7e-409f-8fe8-e52d2a6ff3f0 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:03.638202 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc22c48-1d7e-409f-8fe8-e52d2a6ff3f0 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:03.647532 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b57198a-58a3-4e86-87e1-6aaad55e9fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:03.648331 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b57198a-58a3-4e86-87e1-6aaad55e9fe0 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:03.648633 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b57198a-58a3-4e86-87e1-6aaad55e9fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:03.648905 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b57198a-58a3-4e86-87e1-6aaad55e9fe0 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:03.661745 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b57198a-58a3-4e86-87e1-6aaad55e9fe0 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:03.663749 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b57198a-58a3-4e86-87e1-6aaad55e9fe0 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:03.688207 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-5b57198a-58a3-4e86-87e1-6aaad55e9fe0 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 18:05:03.690072 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 268/530] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Oct 12 18:05:03 2021] GET /identity/v3/projects/service => generated 88 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:03.696675 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf7c142-bc45-44d7-92cf-6ca39fde9087 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:03.710496 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf7c142-bc45-44d7-92cf-6ca39fde9087 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:03.719001 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a4e01-5274-44db-91dd-0cb56af0c26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:03.719781 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a4e01-5274-44db-91dd-0cb56af0c26d admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:03.720159 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a4e01-5274-44db-91dd-0cb56af0c26d admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:03.720573 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a4e01-5274-44db-91dd-0cb56af0c26d admin admin] PATH_INFO: `/v3/projects` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:03.721472 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29a4e01-5274-44db-91dd-0cb56af0c26d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:03.721876 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29a4e01-5274-44db-91dd-0cb56af0c26d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:03.723817 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29a4e01-5274-44db-91dd-0cb56af0c26d admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:03.733699 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76a427d-b86e-4a51-b2ef-840b457ec557 None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:03.734214 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76a427d-b86e-4a51-b2ef-840b457ec557 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:03.734630 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76a427d-b86e-4a51-b2ef-840b457ec557 None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:03.737494 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 269/531] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:05:03 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 18:05:03.745460 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3546d-793e-49dc-adad-a3e931a66920 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:03.745891 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3546d-793e-49dc-adad-a3e931a66920 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:03.746283 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3546d-793e-49dc-adad-a3e931a66920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:03.747550 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 263/532] 10.222.0.18 () {56 vars in 1169 bytes} [Tue Oct 12 18:05:03 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:03.754276 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a4e01-5274-44db-91dd-0cb56af0c26d admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:03.768064 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a4e01-5274-44db-91dd-0cb56af0c26d admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:03.770531 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-79f3546d-793e-49dc-adad-a3e931a66920 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:05:03.770531 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-79f3546d-793e-49dc-adad-a3e931a66920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:05:03.777495 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a8a58-e86c-4843-900a-0ebe5964c3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:03.778374 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a8a58-e86c-4843-900a-0ebe5964c3f6 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:03.778859 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a8a58-e86c-4843-900a-0ebe5964c3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:03.779272 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a8a58-e86c-4843-900a-0ebe5964c3f6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:03.780370 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852a8a58-e86c-4843-900a-0ebe5964c3f6 admin admin] RBAC: Adding query filter params (role.id=24b43b2260b1455e832abdff63df40bd, scope.project.id=e843aaa9e5e44a8e98f7cc7412d9697b, user.id=f6966ce0774f4437a9b688494e9d0574) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:03.780902 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852a8a58-e86c-4843-900a-0ebe5964c3f6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:03.781340 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 270/533] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:05:03 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:05:03.783155 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852a8a58-e86c-4843-900a-0ebe5964c3f6 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:03.796793 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 264/534] 10.222.0.18 () {56 vars in 1395 bytes} [Tue Oct 12 18:05:03 2021] GET /identity/v3/role_assignments?user.id=f6966ce0774f4437a9b688494e9d0574&scope.project.id=e843aaa9e5e44a8e98f7cc7412d9697b&role.id=24b43b2260b1455e832abdff63df40bd => generated 608 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:05:03.819294 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f3546d-793e-49dc-adad-a3e931a66920 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:03.830565 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f3546d-793e-49dc-adad-a3e931a66920 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:03.837476 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ec86a5-6906-4524-bd85-91a628d293e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:03.838804 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ec86a5-6906-4524-bd85-91a628d293e6 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:03.839299 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ec86a5-6906-4524-bd85-91a628d293e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:03.839780 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ec86a5-6906-4524-bd85-91a628d293e6 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:03.859485 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ec86a5-6906-4524-bd85-91a628d293e6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 18:05:03.867883 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-15ec86a5-6906-4524-bd85-91a628d293e6 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 18:05:03.870848 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 271/535] 10.222.0.18 () {56 vars in 1123 bytes} [Tue Oct 12 18:05:03 2021] GET /identity/v3/roles/service => generated 85 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:03.877963 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a8a58-e86c-4843-900a-0ebe5964c3f6 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:03.890398 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a8a58-e86c-4843-900a-0ebe5964c3f6 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:03.892781 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef72db-23d5-42fc-8af3-edf0e3db4bc2 None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:03.893238 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef72db-23d5-42fc-8af3-edf0e3db4bc2 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:03.893669 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef72db-23d5-42fc-8af3-edf0e3db4bc2 None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:03.896345 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 272/536] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:05:03 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:05:03.902678 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f76ad94-6f3f-4107-af17-2dd66ddf05ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:03.903472 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f76ad94-6f3f-4107-af17-2dd66ddf05ab admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:03.903853 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f76ad94-6f3f-4107-af17-2dd66ddf05ab admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:03.904228 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f76ad94-6f3f-4107-af17-2dd66ddf05ab admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:03.905132 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f76ad94-6f3f-4107-af17-2dd66ddf05ab admin admin] RBAC: Adding query filter params (name=service) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:03.905562 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f76ad94-6f3f-4107-af17-2dd66ddf05ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:03.907363 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f76ad94-6f3f-4107-af17-2dd66ddf05ab admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:03.913630 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c7502d-03cf-42a7-9a0f-65f760bd7211 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:03.914182 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c7502d-03cf-42a7-9a0f-65f760bd7211 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:03.914590 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c7502d-03cf-42a7-9a0f-65f760bd7211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:03.922590 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 265/537] 10.222.0.18 () {56 vars in 1124 bytes} [Tue Oct 12 18:05:03 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:03.931318 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f76ad94-6f3f-4107-af17-2dd66ddf05ab admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:03.935294 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-50c7502d-03cf-42a7-9a0f-65f760bd7211 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:05:03.936774 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-50c7502d-03cf-42a7-9a0f-65f760bd7211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:05:03.944319 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f76ad94-6f3f-4107-af17-2dd66ddf05ab admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:03.952461 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 273/538] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:05:03 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:05:03.953421 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dcdf27-34c2-457b-98a2-a06b85735f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:03.954372 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dcdf27-34c2-457b-98a2-a06b85735f2a admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:03.954727 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dcdf27-34c2-457b-98a2-a06b85735f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:03.955077 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dcdf27-34c2-457b-98a2-a06b85735f2a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:03.967714 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dcdf27-34c2-457b-98a2-a06b85735f2a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:03.969863 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dcdf27-34c2-457b-98a2-a06b85735f2a admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:03.978128 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c7502d-03cf-42a7-9a0f-65f760bd7211 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:03.987526 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c7502d-03cf-42a7-9a0f-65f760bd7211 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:03.989575 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-13dcdf27-34c2-457b-98a2-a06b85735f2a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 18:05:03.991826 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 266/539] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:05:03 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 18:05:03.993812 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ee0c50-a034-4c3f-8f8b-20c98b0f9bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:03.994956 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee0c50-a034-4c3f-8f8b-20c98b0f9bbe admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:03.995456 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee0c50-a034-4c3f-8f8b-20c98b0f9bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:03.995923 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee0c50-a034-4c3f-8f8b-20c98b0f9bbe admin admin] PATH_INFO: `/v3/roles/service` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:03.998100 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dcdf27-34c2-457b-98a2-a06b85735f2a admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:04.008888 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dcdf27-34c2-457b-98a2-a06b85735f2a admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:04.010211 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ee0c50-a034-4c3f-8f8b-20c98b0f9bbe admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 18:05:04.013948 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0c9f69-5cbd-4599-9f26-aca857bc99f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:04.014678 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c9f69-5cbd-4599-9f26-aca857bc99f8 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:04.014963 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c9f69-5cbd-4599-9f26-aca857bc99f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:04.015239 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c9f69-5cbd-4599-9f26-aca857bc99f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:04.016303 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0c9f69-5cbd-4599-9f26-aca857bc99f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:04.016701 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0c9f69-5cbd-4599-9f26-aca857bc99f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:04.018469 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0c9f69-5cbd-4599-9f26-aca857bc99f8 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:04.020686 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-24ee0c50-a034-4c3f-8f8b-20c98b0f9bbe admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 18:05:04.023132 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 274/540] 10.222.0.18 () {56 vars in 1123 bytes} [Tue Oct 12 18:05:03 2021] GET /identity/v3/roles/service => generated 85 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 18:05:04.030666 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ee0c50-a034-4c3f-8f8b-20c98b0f9bbe admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:04.033976 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 267/541] 10.222.0.18 () {56 vars in 1130 bytes} [Tue Oct 12 18:05:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:05:04.040676 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0c9f69-5cbd-4599-9f26-aca857bc99f8 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:04.042821 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ee0c50-a034-4c3f-8f8b-20c98b0f9bbe admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:04.047891 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f5977a-98a6-43a1-9bfe-8ffc9fe02c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:04.048910 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5977a-98a6-43a1-9bfe-8ffc9fe02c46 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:04.049393 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5977a-98a6-43a1-9bfe-8ffc9fe02c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:04.049854 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5977a-98a6-43a1-9bfe-8ffc9fe02c46 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:04.050825 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f5977a-98a6-43a1-9bfe-8ffc9fe02c46 admin admin] RBAC: Adding query filter params (name=service) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:04.051320 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f5977a-98a6-43a1-9bfe-8ffc9fe02c46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:04.053223 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0c9f69-5cbd-4599-9f26-aca857bc99f8 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:04.053555 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f5977a-98a6-43a1-9bfe-8ffc9fe02c46 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:04.058441 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca95bf0-7084-49eb-bf31-62041010811d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:04.059404 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca95bf0-7084-49eb-bf31-62041010811d admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:04.059792 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca95bf0-7084-49eb-bf31-62041010811d admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:04.060124 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca95bf0-7084-49eb-bf31-62041010811d admin admin] PATH_INFO: `/v3/users/glance` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:04.066338 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 275/542] 10.222.0.18 () {56 vars in 1124 bytes} [Tue Oct 12 18:05:04 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:05:04.073800 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f5977a-98a6-43a1-9bfe-8ffc9fe02c46 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:04.074186 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca95bf0-7084-49eb-bf31-62041010811d admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:04.076548 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca95bf0-7084-49eb-bf31-62041010811d admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:04.094006 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f5977a-98a6-43a1-9bfe-8ffc9fe02c46 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:04.094006 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf4553-6e98-43ef-9cdd-525cb05a4772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:04.094006 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf4553-6e98-43ef-9cdd-525cb05a4772 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:04.094006 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf4553-6e98-43ef-9cdd-525cb05a4772 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:04.094380 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf4553-6e98-43ef-9cdd-525cb05a4772 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:04.094447 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-bca95bf0-7084-49eb-bf31-62041010811d admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 12 18:05:04.094905 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 268/543] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Oct 12 18:05:04 2021] GET /identity/v3/users/glance => generated 84 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 18:05:04.101888 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca95bf0-7084-49eb-bf31-62041010811d admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:04.105917 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaf4553-6e98-43ef-9cdd-525cb05a4772 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:04.108239 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaf4553-6e98-43ef-9cdd-525cb05a4772 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:04.113462 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca95bf0-7084-49eb-bf31-62041010811d admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:04.118379 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0e52a9-5ad3-407c-bcff-bc4131ba1dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:04.119040 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0e52a9-5ad3-407c-bcff-bc4131ba1dcd admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:04.119319 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0e52a9-5ad3-407c-bcff-bc4131ba1dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:04.119593 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0e52a9-5ad3-407c-bcff-bc4131ba1dcd admin admin] PATH_INFO: `/v3/users` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:04.121188 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0e52a9-5ad3-407c-bcff-bc4131ba1dcd admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:04.121188 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0e52a9-5ad3-407c-bcff-bc4131ba1dcd admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:04.123113 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0e52a9-5ad3-407c-bcff-bc4131ba1dcd admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:04.133730 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-bdaf4553-6e98-43ef-9cdd-525cb05a4772 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 18:05:04.135262 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 276/544] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:05:04 2021] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 18:05:04.142276 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 269/545] 10.222.0.18 () {56 vars in 1158 bytes} [Tue Oct 12 18:05:04 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:04.143269 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf4553-6e98-43ef-9cdd-525cb05a4772 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:04.148216 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0e52a9-5ad3-407c-bcff-bc4131ba1dcd admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:04.155254 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf4553-6e98-43ef-9cdd-525cb05a4772 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:04.158206 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0e52a9-5ad3-407c-bcff-bc4131ba1dcd admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:04.161183 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa96e55-a26b-46a3-b1eb-e36f7832cf3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:04.162185 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa96e55-a26b-46a3-b1eb-e36f7832cf3f admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:04.162758 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa96e55-a26b-46a3-b1eb-e36f7832cf3f admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:04.162960 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd3a008-8583-454d-9812-6a7533cd36f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:04.163435 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa96e55-a26b-46a3-b1eb-e36f7832cf3f admin admin] PATH_INFO: `/v3/domains` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:04.163636 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3a008-8583-454d-9812-6a7533cd36f7 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:04.163860 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3a008-8583-454d-9812-6a7533cd36f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:04.164131 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3a008-8583-454d-9812-6a7533cd36f7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:04.165007 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa96e55-a26b-46a3-b1eb-e36f7832cf3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:04.165597 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa96e55-a26b-46a3-b1eb-e36f7832cf3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:04.167439 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa96e55-a26b-46a3-b1eb-e36f7832cf3f admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:04.173521 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd3a008-8583-454d-9812-6a7533cd36f7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:04.176518 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd3a008-8583-454d-9812-6a7533cd36f7 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:04.183072 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 277/546] 10.222.0.18 () {56 vars in 1130 bytes} [Tue Oct 12 18:05:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:05:04.187274 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 270/547] 10.222.0.18 () {58 vars in 1324 bytes} [Tue Oct 12 18:05:04 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 18:05:04.189560 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa96e55-a26b-46a3-b1eb-e36f7832cf3f admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:04.193139 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd3a008-8583-454d-9812-6a7533cd36f7 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:04.201753 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd3a008-8583-454d-9812-6a7533cd36f7 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:04.202375 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa96e55-a26b-46a3-b1eb-e36f7832cf3f admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:04.207484 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235632a9-4f52-4b61-9178-bf8b208577c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:04.209139 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235632a9-4f52-4b61-9178-bf8b208577c1 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:04.209410 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc88405a-db7c-4fab-a548-c9e9d0cc7526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:04.209525 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235632a9-4f52-4b61-9178-bf8b208577c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:04.209702 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235632a9-4f52-4b61-9178-bf8b208577c1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:04.210830 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc88405a-db7c-4fab-a548-c9e9d0cc7526 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:04.211321 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc88405a-db7c-4fab-a548-c9e9d0cc7526 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:04.211774 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc88405a-db7c-4fab-a548-c9e9d0cc7526 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:04.220632 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235632a9-4f52-4b61-9178-bf8b208577c1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:04.221654 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc88405a-db7c-4fab-a548-c9e9d0cc7526 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:04.222476 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235632a9-4f52-4b61-9178-bf8b208577c1 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:04.223668 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc88405a-db7c-4fab-a548-c9e9d0cc7526 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:04.238492 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-bc88405a-db7c-4fab-a548-c9e9d0cc7526 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 12 18:05:04.244436 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 278/548] 10.222.0.18 () {56 vars in 1123 bytes} [Tue Oct 12 18:05:04 2021] GET /identity/v3/users/neutron => generated 85 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:04.244549 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-235632a9-4f52-4b61-9178-bf8b208577c1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 18:05:04.244625 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc24c0-0e4c-4898-8932-575867766f24 None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:04.244625 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc24c0-0e4c-4898-8932-575867766f24 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:04.244625 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc24c0-0e4c-4898-8932-575867766f24 None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:04.244817 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 271/549] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:05:04 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 18:05:04.245175 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 279/550] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:05:04 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:05:04.251005 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235632a9-4f52-4b61-9178-bf8b208577c1 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:04.251719 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46c8c3-4952-4ed6-8abb-a5672b3edb28 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:04.252328 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46c8c3-4952-4ed6-8abb-a5672b3edb28 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:04.252822 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46c8c3-4952-4ed6-8abb-a5672b3edb28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:04.261187 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235632a9-4f52-4b61-9178-bf8b208577c1 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:04.266185 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db1532e-f968-4069-ac90-53ab1de2b129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:04.266840 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db1532e-f968-4069-ac90-53ab1de2b129 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:04.267116 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db1532e-f968-4069-ac90-53ab1de2b129 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:04.267441 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db1532e-f968-4069-ac90-53ab1de2b129 admin admin] PATH_INFO: `/v3/users` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:04.268285 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db1532e-f968-4069-ac90-53ab1de2b129 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:04.268652 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db1532e-f968-4069-ac90-53ab1de2b129 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:04.270619 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db1532e-f968-4069-ac90-53ab1de2b129 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:04.273609 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-0f46c8c3-4952-4ed6-8abb-a5672b3edb28 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:05:04.275173 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-0f46c8c3-4952-4ed6-8abb-a5672b3edb28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:05:04.288490 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 280/551] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:05:04 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:05:04.289533 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f46c8c3-4952-4ed6-8abb-a5672b3edb28 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:04.297286 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 272/552] 10.222.0.18 () {56 vars in 1160 bytes} [Tue Oct 12 18:05:04 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:04.306848 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db1532e-f968-4069-ac90-53ab1de2b129 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:04.320045 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f46c8c3-4952-4ed6-8abb-a5672b3edb28 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:04.320959 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db1532e-f968-4069-ac90-53ab1de2b129 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:04.326326 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffcb673-6fe8-4d79-9021-6edee7a3ee75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:04.326981 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffcb673-6fe8-4d79-9021-6edee7a3ee75 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:04.327399 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffcb673-6fe8-4d79-9021-6edee7a3ee75 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:04.327674 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffcb673-6fe8-4d79-9021-6edee7a3ee75 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:04.328335 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1101d31-f75c-4936-b68e-b3e67ed89266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:04.329328 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1101d31-f75c-4936-b68e-b3e67ed89266 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:04.329818 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1101d31-f75c-4936-b68e-b3e67ed89266 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:04.330280 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1101d31-f75c-4936-b68e-b3e67ed89266 admin admin] PATH_INFO: `/v3/domains` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:04.331218 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1101d31-f75c-4936-b68e-b3e67ed89266 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:04.331724 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1101d31-f75c-4936-b68e-b3e67ed89266 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:04.334103 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1101d31-f75c-4936-b68e-b3e67ed89266 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:04.337784 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffcb673-6fe8-4d79-9021-6edee7a3ee75 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:04.339603 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffcb673-6fe8-4d79-9021-6edee7a3ee75 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:04.346429 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 281/553] 10.222.0.18 () {56 vars in 1130 bytes} [Tue Oct 12 18:05:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:04.347457 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1101d31-f75c-4936-b68e-b3e67ed89266 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:04.351491 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 273/554] 10.222.0.18 () {58 vars in 1324 bytes} [Tue Oct 12 18:05:04 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 18:05:04.356590 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffcb673-6fe8-4d79-9021-6edee7a3ee75 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:04.366234 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1101d31-f75c-4936-b68e-b3e67ed89266 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:04.367326 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffcb673-6fe8-4d79-9021-6edee7a3ee75 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:04.371406 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd7c34-b76f-495a-a077-0f27024dad3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:04.372247 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32cc978-235e-4e67-8729-30701ee22364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:04.372859 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd7c34-b76f-495a-a077-0f27024dad3c admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:04.373183 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32cc978-235e-4e67-8729-30701ee22364 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:04.373463 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32cc978-235e-4e67-8729-30701ee22364 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:04.373737 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32cc978-235e-4e67-8729-30701ee22364 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:04.374001 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd7c34-b76f-495a-a077-0f27024dad3c admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:04.374481 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd7c34-b76f-495a-a077-0f27024dad3c admin admin] PATH_INFO: `/v3/roles/service` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:04.382290 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32cc978-235e-4e67-8729-30701ee22364 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:04.384734 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32cc978-235e-4e67-8729-30701ee22364 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:04.386506 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cd7c34-b76f-495a-a077-0f27024dad3c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 18:05:04.394335 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-d2cd7c34-b76f-495a-a077-0f27024dad3c admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 18:05:04.396042 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 282/555] 10.222.0.18 () {56 vars in 1123 bytes} [Tue Oct 12 18:05:04 2021] GET /identity/v3/roles/service => generated 85 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:04.397257 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd7c34-b76f-495a-a077-0f27024dad3c admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:04.403576 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-c32cc978-235e-4e67-8729-30701ee22364 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 18:05:04.405897 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 274/556] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Oct 12 18:05:04 2021] GET /identity/v3/projects/service => generated 88 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:04.406903 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32cc978-235e-4e67-8729-30701ee22364 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:04.416573 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd7c34-b76f-495a-a077-0f27024dad3c admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:04.422607 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32cc978-235e-4e67-8729-30701ee22364 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:04.423485 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09260f43-b8c9-49e4-8cbf-c84cfd04b1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:04.425618 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09260f43-b8c9-49e4-8cbf-c84cfd04b1c2 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:04.426353 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09260f43-b8c9-49e4-8cbf-c84cfd04b1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:04.427001 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09260f43-b8c9-49e4-8cbf-c84cfd04b1c2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:04.427715 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d962b0c-0ada-47f5-8240-b80b377b7d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:04.428372 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d962b0c-0ada-47f5-8240-b80b377b7d04 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:04.428685 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d962b0c-0ada-47f5-8240-b80b377b7d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:04.428971 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d962b0c-0ada-47f5-8240-b80b377b7d04 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:04.429737 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d962b0c-0ada-47f5-8240-b80b377b7d04 admin admin] RBAC: Adding query filter params (name=service) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:04.430042 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d962b0c-0ada-47f5-8240-b80b377b7d04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:04.431645 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d962b0c-0ada-47f5-8240-b80b377b7d04 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:04.440305 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 275/557] 10.222.0.18 () {56 vars in 1124 bytes} [Tue Oct 12 18:05:04 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:04.441122 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d962b0c-0ada-47f5-8240-b80b377b7d04 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:04.442306 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09260f43-b8c9-49e4-8cbf-c84cfd04b1c2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:04.444758 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09260f43-b8c9-49e4-8cbf-c84cfd04b1c2 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:04.450862 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d962b0c-0ada-47f5-8240-b80b377b7d04 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:04.455864 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853a4e59-e65a-43e7-8ba2-15e4156188f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:04.456596 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a4e59-e65a-43e7-8ba2-15e4156188f4 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:04.456884 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a4e59-e65a-43e7-8ba2-15e4156188f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:04.457162 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a4e59-e65a-43e7-8ba2-15e4156188f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:04.458006 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853a4e59-e65a-43e7-8ba2-15e4156188f4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:04.458317 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853a4e59-e65a-43e7-8ba2-15e4156188f4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:04.460889 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853a4e59-e65a-43e7-8ba2-15e4156188f4 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:04.465231 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-09260f43-b8c9-49e4-8cbf-c84cfd04b1c2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 18:05:04.466887 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 283/558] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:05:04 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:04.473472 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09260f43-b8c9-49e4-8cbf-c84cfd04b1c2 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:04.473591 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 276/559] 10.222.0.18 () {56 vars in 1169 bytes} [Tue Oct 12 18:05:04 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:04.474211 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853a4e59-e65a-43e7-8ba2-15e4156188f4 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:04.486688 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09260f43-b8c9-49e4-8cbf-c84cfd04b1c2 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:04.488614 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853a4e59-e65a-43e7-8ba2-15e4156188f4 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:04.492904 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c14894-a1fb-449e-be73-3fee4eb1ec3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:04.493697 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d050858c-32b1-4478-9ac1-36cd64c57a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:04.494327 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050858c-32b1-4478-9ac1-36cd64c57a2b admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:04.494616 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050858c-32b1-4478-9ac1-36cd64c57a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:04.494907 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050858c-32b1-4478-9ac1-36cd64c57a2b admin admin] PATH_INFO: `/v3/domains` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:04.495374 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c14894-a1fb-449e-be73-3fee4eb1ec3a admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:04.495644 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d050858c-32b1-4478-9ac1-36cd64c57a2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:04.495946 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d050858c-32b1-4478-9ac1-36cd64c57a2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:04.496501 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c14894-a1fb-449e-be73-3fee4eb1ec3a admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:04.496972 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c14894-a1fb-449e-be73-3fee4eb1ec3a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:04.497608 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d050858c-32b1-4478-9ac1-36cd64c57a2b admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:04.508322 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c14894-a1fb-449e-be73-3fee4eb1ec3a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:04.514207 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 277/560] 10.222.0.18 () {56 vars in 1130 bytes} [Tue Oct 12 18:05:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:04.514207 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d050858c-32b1-4478-9ac1-36cd64c57a2b admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:04.514400 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c14894-a1fb-449e-be73-3fee4eb1ec3a admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:04.524452 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d050858c-32b1-4478-9ac1-36cd64c57a2b admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:04.531107 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf105f9f-9d81-4a5e-b518-12d5441cbffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:04.532077 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf105f9f-9d81-4a5e-b518-12d5441cbffd admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:04.532625 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf105f9f-9d81-4a5e-b518-12d5441cbffd admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:04.533148 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf105f9f-9d81-4a5e-b518-12d5441cbffd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:04.534190 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf105f9f-9d81-4a5e-b518-12d5441cbffd admin admin] RBAC: Adding query filter params (role.id=24b43b2260b1455e832abdff63df40bd, scope.project.id=e843aaa9e5e44a8e98f7cc7412d9697b, user.id=7a3d3e5a5cfc4ac3afcece4e55f23552) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:04.534728 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf105f9f-9d81-4a5e-b518-12d5441cbffd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:04.535473 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-00c14894-a1fb-449e-be73-3fee4eb1ec3a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 18:05:04.536928 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 284/561] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:05:04 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:04.537549 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c14894-a1fb-449e-be73-3fee4eb1ec3a admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:04.537984 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf105f9f-9d81-4a5e-b518-12d5441cbffd admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:04.545592 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 278/562] 10.222.0.18 () {56 vars in 1395 bytes} [Tue Oct 12 18:05:04 2021] GET /identity/v3/role_assignments?user.id=7a3d3e5a5cfc4ac3afcece4e55f23552&scope.project.id=e843aaa9e5e44a8e98f7cc7412d9697b&role.id=24b43b2260b1455e832abdff63df40bd => generated 608 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:04.546614 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf105f9f-9d81-4a5e-b518-12d5441cbffd admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:04.546941 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c14894-a1fb-449e-be73-3fee4eb1ec3a admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:04.557337 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf105f9f-9d81-4a5e-b518-12d5441cbffd admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:04.562848 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bda0e3-1691-4ac6-9cb1-5a1fcfbd135d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:04.564386 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bda0e3-1691-4ac6-9cb1-5a1fcfbd135d admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:04.565086 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bda0e3-1691-4ac6-9cb1-5a1fcfbd135d admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:04.565641 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bda0e3-1691-4ac6-9cb1-5a1fcfbd135d admin admin] PATH_INFO: `/v3/domains` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:04.566645 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bda0e3-1691-4ac6-9cb1-5a1fcfbd135d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:04.567158 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bda0e3-1691-4ac6-9cb1-5a1fcfbd135d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:04.569883 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bda0e3-1691-4ac6-9cb1-5a1fcfbd135d admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:04.573209 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf989a8-fcd6-4757-bea7-fba3a5ab036b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:04.574071 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf989a8-fcd6-4757-bea7-fba3a5ab036b admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:04.574320 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf989a8-fcd6-4757-bea7-fba3a5ab036b admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:04.574544 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf989a8-fcd6-4757-bea7-fba3a5ab036b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:04.585436 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 279/563] 10.222.0.18 () {56 vars in 1130 bytes} [Tue Oct 12 18:05:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:04.592274 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bda0e3-1691-4ac6-9cb1-5a1fcfbd135d admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:04.601488 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf989a8-fcd6-4757-bea7-fba3a5ab036b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:04.603411 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf989a8-fcd6-4757-bea7-fba3a5ab036b admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:04.604497 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bda0e3-1691-4ac6-9cb1-5a1fcfbd135d admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:04.612539 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9930687-6849-4eb1-a21e-a07f2e0cb6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:04.615023 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9930687-6849-4eb1-a21e-a07f2e0cb6d0 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:04.615855 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9930687-6849-4eb1-a21e-a07f2e0cb6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:04.617353 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9930687-6849-4eb1-a21e-a07f2e0cb6d0 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:04.634373 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9930687-6849-4eb1-a21e-a07f2e0cb6d0 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:04.637457 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-8bf989a8-fcd6-4757-bea7-fba3a5ab036b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 18:05:04.639935 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9930687-6849-4eb1-a21e-a07f2e0cb6d0 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:04.641717 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 285/564] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Oct 12 18:05:04 2021] GET /identity/v3/projects/service => generated 88 bytes in 104 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:04.653467 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf989a8-fcd6-4757-bea7-fba3a5ab036b admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:04.663055 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-a9930687-6849-4eb1-a21e-a07f2e0cb6d0 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 12 18:05:04.674959 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 280/565] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Oct 12 18:05:04 2021] GET /identity/v3/users/swift => generated 83 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:04.679080 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf989a8-fcd6-4757-bea7-fba3a5ab036b admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:04.682909 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9930687-6849-4eb1-a21e-a07f2e0cb6d0 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:04.690927 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27715d6d-b6f6-4580-99c3-d2ab078bc0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:04.691605 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27715d6d-b6f6-4580-99c3-d2ab078bc0e0 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:04.691891 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27715d6d-b6f6-4580-99c3-d2ab078bc0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:04.692175 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27715d6d-b6f6-4580-99c3-d2ab078bc0e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:04.693532 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27715d6d-b6f6-4580-99c3-d2ab078bc0e0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:04.693840 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27715d6d-b6f6-4580-99c3-d2ab078bc0e0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:04.695573 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9930687-6849-4eb1-a21e-a07f2e0cb6d0 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:04.695716 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27715d6d-b6f6-4580-99c3-d2ab078bc0e0 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:04.700716 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51605f0c-baad-4002-a85a-59ae5443a707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:04.701663 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51605f0c-baad-4002-a85a-59ae5443a707 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:04.702150 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51605f0c-baad-4002-a85a-59ae5443a707 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:04.702572 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51605f0c-baad-4002-a85a-59ae5443a707 admin admin] PATH_INFO: `/v3/users` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:04.703671 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51605f0c-baad-4002-a85a-59ae5443a707 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:04.704192 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51605f0c-baad-4002-a85a-59ae5443a707 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:04.707192 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51605f0c-baad-4002-a85a-59ae5443a707 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:04.735084 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 286/567] 10.222.0.18 () {56 vars in 1169 bytes} [Tue Oct 12 18:05:04 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:04.735394 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 281/567] 10.222.0.18 () {56 vars in 1156 bytes} [Tue Oct 12 18:05:04 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:05:04.737121 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27715d6d-b6f6-4580-99c3-d2ab078bc0e0 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:04.737255 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51605f0c-baad-4002-a85a-59ae5443a707 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:04.748556 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51605f0c-baad-4002-a85a-59ae5443a707 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:04.754360 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de473bfd-d113-4f27-a4eb-1857fe030176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:04.755325 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de473bfd-d113-4f27-a4eb-1857fe030176 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:04.755861 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de473bfd-d113-4f27-a4eb-1857fe030176 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:04.756279 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de473bfd-d113-4f27-a4eb-1857fe030176 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:04.757360 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de473bfd-d113-4f27-a4eb-1857fe030176 admin admin] RBAC: Adding query filter params (role.id=24b43b2260b1455e832abdff63df40bd, scope.project.id=e843aaa9e5e44a8e98f7cc7412d9697b, user.id=9a1ea6f47a7c41aba102ad481f5ad5c8) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:04.758132 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de473bfd-d113-4f27-a4eb-1857fe030176 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:04.760071 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27715d6d-b6f6-4580-99c3-d2ab078bc0e0 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:04.760556 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de473bfd-d113-4f27-a4eb-1857fe030176 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:04.765163 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65576a14-7e31-4dbd-96e5-fb00da90979e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:04.765647 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65576a14-7e31-4dbd-96e5-fb00da90979e admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:04.766188 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65576a14-7e31-4dbd-96e5-fb00da90979e admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:04.766462 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65576a14-7e31-4dbd-96e5-fb00da90979e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:04.770319 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 282/568] 10.222.0.18 () {56 vars in 1395 bytes} [Tue Oct 12 18:05:04 2021] GET /identity/v3/role_assignments?user.id=9a1ea6f47a7c41aba102ad481f5ad5c8&scope.project.id=e843aaa9e5e44a8e98f7cc7412d9697b&role.id=24b43b2260b1455e832abdff63df40bd => generated 608 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:04.781635 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65576a14-7e31-4dbd-96e5-fb00da90979e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:04.783775 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65576a14-7e31-4dbd-96e5-fb00da90979e admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:04.802472 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-65576a14-7e31-4dbd-96e5-fb00da90979e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 18:05:04.804087 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 287/569] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:05:04 2021] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:04.810414 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de473bfd-d113-4f27-a4eb-1857fe030176 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:04.827272 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de473bfd-d113-4f27-a4eb-1857fe030176 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:04.832044 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f7043-0a21-4ec1-9bd9-4bb9d640ea8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:04.832762 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f7043-0a21-4ec1-9bd9-4bb9d640ea8c admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:04.833046 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f7043-0a21-4ec1-9bd9-4bb9d640ea8c admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:04.833326 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f7043-0a21-4ec1-9bd9-4bb9d640ea8c admin admin] PATH_INFO: `/v3/domains` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:04.834640 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84f7043-0a21-4ec1-9bd9-4bb9d640ea8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:04.834947 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84f7043-0a21-4ec1-9bd9-4bb9d640ea8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:04.836713 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84f7043-0a21-4ec1-9bd9-4bb9d640ea8c admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:04.853847 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 283/570] 10.222.0.18 () {56 vars in 1130 bytes} [Tue Oct 12 18:05:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:04.859947 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65576a14-7e31-4dbd-96e5-fb00da90979e admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:04.876166 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65576a14-7e31-4dbd-96e5-fb00da90979e admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:04.881713 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affcb9d3-0e99-475a-adcb-7a752da70585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:04.882591 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affcb9d3-0e99-475a-adcb-7a752da70585 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:04.882947 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affcb9d3-0e99-475a-adcb-7a752da70585 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:04.883222 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affcb9d3-0e99-475a-adcb-7a752da70585 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:04.891476 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affcb9d3-0e99-475a-adcb-7a752da70585 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:04.893676 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affcb9d3-0e99-475a-adcb-7a752da70585 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:04.909000 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-affcb9d3-0e99-475a-adcb-7a752da70585 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 18:05:04.910604 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 288/571] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Oct 12 18:05:04 2021] GET /identity/v3/projects/service => generated 88 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:04.916806 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f7043-0a21-4ec1-9bd9-4bb9d640ea8c admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:04.931276 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f7043-0a21-4ec1-9bd9-4bb9d640ea8c admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:04.939514 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e3ff5c-cd8c-4969-8b6e-2960fa68eda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:04.940370 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e3ff5c-cd8c-4969-8b6e-2960fa68eda3 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:04.940742 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e3ff5c-cd8c-4969-8b6e-2960fa68eda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:04.941087 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e3ff5c-cd8c-4969-8b6e-2960fa68eda3 admin admin] PATH_INFO: `/v3/projects` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:04.941998 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e3ff5c-cd8c-4969-8b6e-2960fa68eda3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:04.942426 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e3ff5c-cd8c-4969-8b6e-2960fa68eda3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:04.945107 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e3ff5c-cd8c-4969-8b6e-2960fa68eda3 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:04.962519 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 284/572] 10.222.0.18 () {56 vars in 1169 bytes} [Tue Oct 12 18:05:04 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:04.969271 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affcb9d3-0e99-475a-adcb-7a752da70585 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:04.979634 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affcb9d3-0e99-475a-adcb-7a752da70585 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:04.984476 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6832f8e7-1452-4c2f-8a98-69a9e9a28da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:04.985451 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6832f8e7-1452-4c2f-8a98-69a9e9a28da5 admin admin] REQUEST_METHOD: `PUT` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:04.985795 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6832f8e7-1452-4c2f-8a98-69a9e9a28da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:04.986071 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6832f8e7-1452-4c2f-8a98-69a9e9a28da5 admin admin] PATH_INFO: `/v3/projects/e843aaa9e5e44a8e98f7cc7412d9697b/users/7f527f925af24eba8cabffe457fceb09/roles/24b43b2260b1455e832abdff63df40bd` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:05.004063 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6832f8e7-1452-4c2f-8a98-69a9e9a28da5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e843aaa9e5e44a8e98f7cc7412d9697b, user_id=7f527f925af24eba8cabffe457fceb09, role_id=24b43b2260b1455e832abdff63df40bd)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:05.007573 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6832f8e7-1452-4c2f-8a98-69a9e9a28da5 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:05.093670 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 289/573] 10.222.0.18 () {58 vars in 1460 bytes} [Tue Oct 12 18:05:04 2021] PUT /identity/v3/projects/e843aaa9e5e44a8e98f7cc7412d9697b/users/7f527f925af24eba8cabffe457fceb09/roles/24b43b2260b1455e832abdff63df40bd => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:05:06.386902 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb896f33-df8a-47d1-b6a7-a8dbb5b85b76 None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:06.387440 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb896f33-df8a-47d1-b6a7-a8dbb5b85b76 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:06.387440 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb896f33-df8a-47d1-b6a7-a8dbb5b85b76 None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:06.389604 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 285/574] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:05:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:05:06.396674 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d814e83-7924-4dea-90b2-9a6cb0d36be3 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:06.397224 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d814e83-7924-4dea-90b2-9a6cb0d36be3 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:06.397224 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d814e83-7924-4dea-90b2-9a6cb0d36be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:06.421642 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-5d814e83-7924-4dea-90b2-9a6cb0d36be3 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:05:06.423362 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-5d814e83-7924-4dea-90b2-9a6cb0d36be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:05:06.506494 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 290/575] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:05:06 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:05:06.548059 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a74e9e-1c20-4862-b35a-f3670d7d750e None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:06.548340 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a74e9e-1c20-4862-b35a-f3670d7d750e None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:06.548673 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a74e9e-1c20-4862-b35a-f3670d7d750e None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:06.551918 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 286/576] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:05:06 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:05:06.557883 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b517b4-9299-49e8-b227-e953fe18da39 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:06.558340 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b517b4-9299-49e8-b227-e953fe18da39 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:06.558619 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b517b4-9299-49e8-b227-e953fe18da39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:06.558939 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a74e9e-1c20-4862-b35a-f3670d7d750e None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:06.585171 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a74e9e-1c20-4862-b35a-f3670d7d750e None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:06.587999 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-70b517b4-9299-49e8-b227-e953fe18da39 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:05:06.589189 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-70b517b4-9299-49e8-b227-e953fe18da39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:05:06.592207 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae82565f-d375-4fef-acdb-4de600daa2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:06.593054 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82565f-d375-4fef-acdb-4de600daa2e2 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:06.593443 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82565f-d375-4fef-acdb-4de600daa2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:06.593877 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82565f-d375-4fef-acdb-4de600daa2e2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:06.611126 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 291/577] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:05:06 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:05:06.611981 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae82565f-d375-4fef-acdb-4de600daa2e2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 18:05:06.619375 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-ae82565f-d375-4fef-acdb-4de600daa2e2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 18:05:06.620852 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 287/578] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Oct 12 18:05:06 2021] GET /identity/v3/roles/admin => generated 83 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 18:05:06.629025 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b517b4-9299-49e8-b227-e953fe18da39 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:06.641567 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b517b4-9299-49e8-b227-e953fe18da39 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:06.651368 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9063df38-28ff-4fb3-8f85-07184f3af253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:06.652024 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9063df38-28ff-4fb3-8f85-07184f3af253 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:06.652301 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9063df38-28ff-4fb3-8f85-07184f3af253 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:06.652608 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9063df38-28ff-4fb3-8f85-07184f3af253 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:06.653367 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9063df38-28ff-4fb3-8f85-07184f3af253 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:06.653666 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9063df38-28ff-4fb3-8f85-07184f3af253 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:06.655264 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9063df38-28ff-4fb3-8f85-07184f3af253 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:06.658533 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae82565f-d375-4fef-acdb-4de600daa2e2 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:06.671729 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae82565f-d375-4fef-acdb-4de600daa2e2 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:06.676344 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 292/579] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Oct 12 18:05:06 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:06.683464 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d9adfe-7f95-41e8-89f0-552b661cc4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:06.684266 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d9adfe-7f95-41e8-89f0-552b661cc4a8 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:06.684571 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d9adfe-7f95-41e8-89f0-552b661cc4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:06.684844 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d9adfe-7f95-41e8-89f0-552b661cc4a8 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:06.685514 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d9adfe-7f95-41e8-89f0-552b661cc4a8 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:06.686513 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING py.warnings [None req-05d9adfe-7f95-41e8-89f0-552b661cc4a8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:05:06.686513 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: warnings.warn(msg) Oct 12 18:05:06.686513 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: Oct 12 18:05:06.687398 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d9adfe-7f95-41e8-89f0-552b661cc4a8 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:06.690215 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9063df38-28ff-4fb3-8f85-07184f3af253 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:06.712025 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-05d9adfe-7f95-41e8-89f0-552b661cc4a8 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 12 18:05:06.714521 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9063df38-28ff-4fb3-8f85-07184f3af253 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:06.719087 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016e2878-1531-41dd-9d0a-834778b49b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:06.719862 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016e2878-1531-41dd-9d0a-834778b49b31 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:06.720140 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016e2878-1531-41dd-9d0a-834778b49b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:06.720423 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016e2878-1531-41dd-9d0a-834778b49b31 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:06.723159 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 288/580] 10.222.0.18 () {56 vars in 1150 bytes} [Tue Oct 12 18:05:06 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:06.735239 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d9adfe-7f95-41e8-89f0-552b661cc4a8 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:06.744622 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016e2878-1531-41dd-9d0a-834778b49b31 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:06.746470 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016e2878-1531-41dd-9d0a-834778b49b31 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:06.753197 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d9adfe-7f95-41e8-89f0-552b661cc4a8 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:06.770015 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-016e2878-1531-41dd-9d0a-834778b49b31 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 18:05:06.771758 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 293/581] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:05:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 18:05:06.778043 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcf6fb0-140f-4e78-96f7-24477d69f444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:06.778708 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf6fb0-140f-4e78-96f7-24477d69f444 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:06.778985 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf6fb0-140f-4e78-96f7-24477d69f444 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:06.779258 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf6fb0-140f-4e78-96f7-24477d69f444 admin admin] PATH_INFO: `/v3/services` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:06.779982 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcf6fb0-140f-4e78-96f7-24477d69f444 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:06.780284 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcf6fb0-140f-4e78-96f7-24477d69f444 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:06.781312 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING py.warnings [None req-dfcf6fb0-140f-4e78-96f7-24477d69f444 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:05:06.781312 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: warnings.warn(msg) Oct 12 18:05:06.781312 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: Oct 12 18:05:06.782189 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcf6fb0-140f-4e78-96f7-24477d69f444 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:06.785694 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016e2878-1531-41dd-9d0a-834778b49b31 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:06.793975 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 289/582] 10.222.0.18 () {56 vars in 1145 bytes} [Tue Oct 12 18:05:06 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:06.801755 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcf6fb0-140f-4e78-96f7-24477d69f444 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:06.811347 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016e2878-1531-41dd-9d0a-834778b49b31 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:06.815813 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcf6fb0-140f-4e78-96f7-24477d69f444 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:06.823157 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9ee225-cbfd-48c8-aac3-524fdb81ae58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:06.824089 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ee225-cbfd-48c8-aac3-524fdb81ae58 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:06.824578 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ee225-cbfd-48c8-aac3-524fdb81ae58 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:06.825030 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ee225-cbfd-48c8-aac3-524fdb81ae58 admin admin] PATH_INFO: `/v3/domains` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:06.825953 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9ee225-cbfd-48c8-aac3-524fdb81ae58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:06.826254 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9ee225-cbfd-48c8-aac3-524fdb81ae58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:06.827861 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9ee225-cbfd-48c8-aac3-524fdb81ae58 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:06.830835 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b82806c-a0ff-410d-8d9f-d440ca2daac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:06.831483 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82806c-a0ff-410d-8d9f-d440ca2daac4 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:06.831754 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82806c-a0ff-410d-8d9f-d440ca2daac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:06.832023 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82806c-a0ff-410d-8d9f-d440ca2daac4 admin admin] PATH_INFO: `/v3/services` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:06.832758 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b82806c-a0ff-410d-8d9f-d440ca2daac4 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:06.833058 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b82806c-a0ff-410d-8d9f-d440ca2daac4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:06.835470 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b82806c-a0ff-410d-8d9f-d440ca2daac4 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:06.846529 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 290/583] 10.222.0.18 () {56 vars in 1145 bytes} [Tue Oct 12 18:05:06 2021] GET /identity/v3/services?type=block-storage => generated 130 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:05:06.856260 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 294/584] 10.222.0.18 () {56 vars in 1130 bytes} [Tue Oct 12 18:05:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:06.862576 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b82806c-a0ff-410d-8d9f-d440ca2daac4 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:06.877800 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b82806c-a0ff-410d-8d9f-d440ca2daac4 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:06.886677 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06824536-6b8e-4c1c-a188-4f3e64981e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:06.887482 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06824536-6b8e-4c1c-a188-4f3e64981e57 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:06.887758 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06824536-6b8e-4c1c-a188-4f3e64981e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:06.888032 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06824536-6b8e-4c1c-a188-4f3e64981e57 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:06.901974 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06824536-6b8e-4c1c-a188-4f3e64981e57 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:06.905568 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06824536-6b8e-4c1c-a188-4f3e64981e57 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:06.922837 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-06824536-6b8e-4c1c-a188-4f3e64981e57 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 12 18:05:06.924035 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 291/585] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Oct 12 18:05:06 2021] GET /identity/v3/users/nova => generated 82 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:06.930294 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9ee225-cbfd-48c8-aac3-524fdb81ae58 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:06.946652 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9ee225-cbfd-48c8-aac3-524fdb81ae58 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:06.956098 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5cb35f-9975-473d-91bb-54251eaae8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:06.956814 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5cb35f-9975-473d-91bb-54251eaae8f2 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:06.957092 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5cb35f-9975-473d-91bb-54251eaae8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:06.957364 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5cb35f-9975-473d-91bb-54251eaae8f2 admin admin] PATH_INFO: `/v3/users` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:06.958220 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5cb35f-9975-473d-91bb-54251eaae8f2 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:06.958619 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5cb35f-9975-473d-91bb-54251eaae8f2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:06.960580 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5cb35f-9975-473d-91bb-54251eaae8f2 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:06.992766 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 295/586] 10.222.0.18 () {56 vars in 1154 bytes} [Tue Oct 12 18:05:06 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:06.998552 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06824536-6b8e-4c1c-a188-4f3e64981e57 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:07.018977 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06824536-6b8e-4c1c-a188-4f3e64981e57 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:07.028764 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9becce5e-74c5-4a98-88ed-a8385c21fca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:07.029415 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9becce5e-74c5-4a98-88ed-a8385c21fca8 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:07.029693 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9becce5e-74c5-4a98-88ed-a8385c21fca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:07.029963 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9becce5e-74c5-4a98-88ed-a8385c21fca8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:07.048758 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9becce5e-74c5-4a98-88ed-a8385c21fca8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:07.050545 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9becce5e-74c5-4a98-88ed-a8385c21fca8 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:07.066381 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 292/587] 10.222.0.18 () {58 vars in 1324 bytes} [Tue Oct 12 18:05:06 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:05:07.073380 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5cb35f-9975-473d-91bb-54251eaae8f2 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:07.089827 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5cb35f-9975-473d-91bb-54251eaae8f2 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:07.106285 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fea6dd-2c53-41f7-8f2e-b0980bcd3a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:07.107114 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fea6dd-2c53-41f7-8f2e-b0980bcd3a2e admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:07.107397 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fea6dd-2c53-41f7-8f2e-b0980bcd3a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:07.107676 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fea6dd-2c53-41f7-8f2e-b0980bcd3a2e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:07.128766 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fea6dd-2c53-41f7-8f2e-b0980bcd3a2e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:07.131254 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fea6dd-2c53-41f7-8f2e-b0980bcd3a2e admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:07.159294 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-54fea6dd-2c53-41f7-8f2e-b0980bcd3a2e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 18:05:07.160786 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 296/588] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:05:07 2021] GET /identity/v3/domains/Default => generated 87 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:07.166684 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9becce5e-74c5-4a98-88ed-a8385c21fca8 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:07.182310 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9becce5e-74c5-4a98-88ed-a8385c21fca8 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:07.199496 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fd7208-4a25-4754-8322-7b87c571f2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:07.200576 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd7208-4a25-4754-8322-7b87c571f2d8 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:07.200902 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd7208-4a25-4754-8322-7b87c571f2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:07.201198 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd7208-4a25-4754-8322-7b87c571f2d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:07.201933 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fd7208-4a25-4754-8322-7b87c571f2d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:07.202238 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fd7208-4a25-4754-8322-7b87c571f2d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:07.203826 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fd7208-4a25-4754-8322-7b87c571f2d8 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:07.225626 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 293/589] 10.222.0.18 () {56 vars in 1130 bytes} [Tue Oct 12 18:05:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:07.231610 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fea6dd-2c53-41f7-8f2e-b0980bcd3a2e admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:07.245502 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fea6dd-2c53-41f7-8f2e-b0980bcd3a2e admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:07.252672 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033fa3b8-26ef-4ab2-9ec3-fca2a3530cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:07.253460 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033fa3b8-26ef-4ab2-9ec3-fca2a3530cf4 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:07.253744 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033fa3b8-26ef-4ab2-9ec3-fca2a3530cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:07.254019 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033fa3b8-26ef-4ab2-9ec3-fca2a3530cf4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:07.263390 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033fa3b8-26ef-4ab2-9ec3-fca2a3530cf4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:07.265781 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033fa3b8-26ef-4ab2-9ec3-fca2a3530cf4 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:07.279948 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-033fa3b8-26ef-4ab2-9ec3-fca2a3530cf4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 18:05:07.282033 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 297/590] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Oct 12 18:05:07 2021] GET /identity/v3/projects/service => generated 88 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:07.289696 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fd7208-4a25-4754-8322-7b87c571f2d8 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:07.300743 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fd7208-4a25-4754-8322-7b87c571f2d8 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:07.306111 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceed9f7-a672-4048-9675-7ed4ec4a2563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:07.307036 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceed9f7-a672-4048-9675-7ed4ec4a2563 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:07.307585 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceed9f7-a672-4048-9675-7ed4ec4a2563 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:07.308051 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceed9f7-a672-4048-9675-7ed4ec4a2563 admin admin] PATH_INFO: `/v3/projects` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:07.309139 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceed9f7-a672-4048-9675-7ed4ec4a2563 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:07.309641 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceed9f7-a672-4048-9675-7ed4ec4a2563 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:07.311788 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceed9f7-a672-4048-9675-7ed4ec4a2563 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:07.324678 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 294/591] 10.222.0.18 () {56 vars in 1169 bytes} [Tue Oct 12 18:05:07 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:07.331963 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033fa3b8-26ef-4ab2-9ec3-fca2a3530cf4 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:07.343464 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033fa3b8-26ef-4ab2-9ec3-fca2a3530cf4 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:07.348314 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e97ad43-5460-45dc-b2ca-cd1afad68895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:07.349277 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e97ad43-5460-45dc-b2ca-cd1afad68895 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:07.349712 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e97ad43-5460-45dc-b2ca-cd1afad68895 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:07.350150 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e97ad43-5460-45dc-b2ca-cd1afad68895 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:07.351169 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e97ad43-5460-45dc-b2ca-cd1afad68895 admin admin] RBAC: Adding query filter params (role.id=6c54f239944d46e3b027ccce97eb8b49, scope.project.id=e843aaa9e5e44a8e98f7cc7412d9697b, user.id=3417097a280b499086b36df9a2548239) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:07.351615 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e97ad43-5460-45dc-b2ca-cd1afad68895 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:07.353700 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e97ad43-5460-45dc-b2ca-cd1afad68895 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:07.360001 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 298/592] 10.222.0.18 () {56 vars in 1395 bytes} [Tue Oct 12 18:05:07 2021] GET /identity/v3/role_assignments?user.id=3417097a280b499086b36df9a2548239&scope.project.id=e843aaa9e5e44a8e98f7cc7412d9697b&role.id=6c54f239944d46e3b027ccce97eb8b49 => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:07.639361 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60662b20-6ed4-4b96-8757-c967861e0922 None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:07.640302 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60662b20-6ed4-4b96-8757-c967861e0922 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:07.641061 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60662b20-6ed4-4b96-8757-c967861e0922 None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:07.643276 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 295/593] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:05:07 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:05:07.649421 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b26069c-57f6-49b0-be89-ccf61e85b8ce None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:07.650377 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b26069c-57f6-49b0-be89-ccf61e85b8ce None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:07.650843 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b26069c-57f6-49b0-be89-ccf61e85b8ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:07.673872 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-8b26069c-57f6-49b0-be89-ccf61e85b8ce None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:05:07.675377 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-8b26069c-57f6-49b0-be89-ccf61e85b8ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:05:07.686688 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d9a8d-4af3-40e0-8e1f-8edda8845160 None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:07.687015 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d9a8d-4af3-40e0-8e1f-8edda8845160 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:07.687242 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d9a8d-4af3-40e0-8e1f-8edda8845160 None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:07.688699 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 299/594] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:05:07 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:05:07.689192 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 296/595] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:05:07 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:05:07.695373 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d8c6f-b211-4acf-97ae-1bd71c4e43cf None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:07.695889 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d8c6f-b211-4acf-97ae-1bd71c4e43cf None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:07.696359 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d8c6f-b211-4acf-97ae-1bd71c4e43cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:07.715338 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17d9a8d-4af3-40e0-8e1f-8edda8845160 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:07.721260 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-b74d8c6f-b211-4acf-97ae-1bd71c4e43cf None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:05:07.722743 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-b74d8c6f-b211-4acf-97ae-1bd71c4e43cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:05:07.732033 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 300/596] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:05:07 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:05:07.742150 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17d9a8d-4af3-40e0-8e1f-8edda8845160 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:07.754811 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d8c6f-b211-4acf-97ae-1bd71c4e43cf None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:07.755844 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc74c2-51b8-4e4c-8c35-ee75245e52c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:07.756736 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc74c2-51b8-4e4c-8c35-ee75245e52c0 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:07.757020 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc74c2-51b8-4e4c-8c35-ee75245e52c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:07.757293 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc74c2-51b8-4e4c-8c35-ee75245e52c0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:07.764441 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d8c6f-b211-4acf-97ae-1bd71c4e43cf None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:07.769840 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88374265-90b7-45f2-bd30-43230e73de16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:07.770624 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88374265-90b7-45f2-bd30-43230e73de16 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:07.770963 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88374265-90b7-45f2-bd30-43230e73de16 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:07.771244 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88374265-90b7-45f2-bd30-43230e73de16 admin admin] PATH_INFO: `/v3/services/network` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:07.771919 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88374265-90b7-45f2-bd30-43230e73de16 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:07.773055 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING py.warnings [None req-88374265-90b7-45f2-bd30-43230e73de16 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:05:07.773055 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: warnings.warn(msg) Oct 12 18:05:07.773055 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: Oct 12 18:05:07.773952 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88374265-90b7-45f2-bd30-43230e73de16 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:07.789084 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-88374265-90b7-45f2-bd30-43230e73de16 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 12 18:05:07.789309 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccc74c2-51b8-4e4c-8c35-ee75245e52c0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:07.790570 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 301/597] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Oct 12 18:05:07 2021] GET /identity/v3/services/network => generated 88 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 18:05:07.791239 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccc74c2-51b8-4e4c-8c35-ee75245e52c0 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:07.797570 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88374265-90b7-45f2-bd30-43230e73de16 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:07.807650 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88374265-90b7-45f2-bd30-43230e73de16 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:07.812799 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf2e104-8e90-49a9-9cf9-feb83feab4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:07.813448 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf2e104-8e90-49a9-9cf9-feb83feab4fd admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:07.813734 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf2e104-8e90-49a9-9cf9-feb83feab4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:07.814011 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf2e104-8e90-49a9-9cf9-feb83feab4fd admin admin] PATH_INFO: `/v3/services` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:07.814730 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf2e104-8e90-49a9-9cf9-feb83feab4fd admin admin] RBAC: Adding query filter params (name=network) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:07.815035 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf2e104-8e90-49a9-9cf9-feb83feab4fd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:07.816338 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING py.warnings [None req-4cf2e104-8e90-49a9-9cf9-feb83feab4fd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:05:07.816338 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: warnings.warn(msg) Oct 12 18:05:07.816338 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: Oct 12 18:05:07.817263 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf2e104-8e90-49a9-9cf9-feb83feab4fd admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:07.822777 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 302/598] 10.222.0.18 () {56 vars in 1133 bytes} [Tue Oct 12 18:05:07 2021] GET /identity/v3/services?name=network => generated 124 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:05:07.828746 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf2e104-8e90-49a9-9cf9-feb83feab4fd admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:07.830182 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-5ccc74c2-51b8-4e4c-8c35-ee75245e52c0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 18:05:07.832609 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 297/599] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:05:07 2021] GET /identity/v3/domains/Default => generated 87 bytes in 117 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 18:05:07.837919 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc74c2-51b8-4e4c-8c35-ee75245e52c0 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:07.838622 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf2e104-8e90-49a9-9cf9-feb83feab4fd admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:07.843423 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f1a078-2ab5-40e7-a16b-1f11ea4c553c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:07.844348 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1a078-2ab5-40e7-a16b-1f11ea4c553c admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:07.844665 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1a078-2ab5-40e7-a16b-1f11ea4c553c admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:07.844946 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1a078-2ab5-40e7-a16b-1f11ea4c553c admin admin] PATH_INFO: `/v3/services` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:07.845721 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f1a078-2ab5-40e7-a16b-1f11ea4c553c admin admin] RBAC: Adding query filter params (type=network) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:07.846029 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f1a078-2ab5-40e7-a16b-1f11ea4c553c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:07.847782 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f1a078-2ab5-40e7-a16b-1f11ea4c553c admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:07.855670 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc74c2-51b8-4e4c-8c35-ee75245e52c0 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:07.857407 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 303/600] 10.222.0.18 () {56 vars in 1133 bytes} [Tue Oct 12 18:05:07 2021] GET /identity/v3/services?type=network => generated 124 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:05:07.869799 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8eb6f4-1582-40d2-ab70-26da8427b680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:07.870778 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8eb6f4-1582-40d2-ab70-26da8427b680 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:07.871132 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8eb6f4-1582-40d2-ab70-26da8427b680 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:07.871407 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8eb6f4-1582-40d2-ab70-26da8427b680 admin admin] PATH_INFO: `/v3/domains` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:07.872197 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8eb6f4-1582-40d2-ab70-26da8427b680 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:07.872533 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8eb6f4-1582-40d2-ab70-26da8427b680 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:07.874173 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8eb6f4-1582-40d2-ab70-26da8427b680 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:07.900021 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 298/601] 10.222.0.18 () {56 vars in 1130 bytes} [Tue Oct 12 18:05:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:07.906177 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f1a078-2ab5-40e7-a16b-1f11ea4c553c admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:07.921568 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f1a078-2ab5-40e7-a16b-1f11ea4c553c admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:07.932992 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ed82fb-b92a-44d5-b508-6c17ff3afb71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:07.933708 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ed82fb-b92a-44d5-b508-6c17ff3afb71 admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:07.934099 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ed82fb-b92a-44d5-b508-6c17ff3afb71 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:07.934428 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ed82fb-b92a-44d5-b508-6c17ff3afb71 admin admin] PATH_INFO: `/v3/users` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:07.935158 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ed82fb-b92a-44d5-b508-6c17ff3afb71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:07.937232 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ed82fb-b92a-44d5-b508-6c17ff3afb71 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:08.025817 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 304/602] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Oct 12 18:05:07 2021] POST /identity/v3/users => generated 254 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:05:08.207543 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b7bff-401f-4689-8aea-6fedb9023427 None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:08.207839 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b7bff-401f-4689-8aea-6fedb9023427 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:08.208035 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b7bff-401f-4689-8aea-6fedb9023427 None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:08.210681 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 299/603] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:05:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:05:08.217194 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e0025d-78da-4b60-a65d-bc82ba6ee142 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:08.217495 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e0025d-78da-4b60-a65d-bc82ba6ee142 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:08.217759 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e0025d-78da-4b60-a65d-bc82ba6ee142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:08.238067 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-33e0025d-78da-4b60-a65d-bc82ba6ee142 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:05:08.240198 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-33e0025d-78da-4b60-a65d-bc82ba6ee142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:05:08.248530 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 305/604] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:05:08 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:05:08.273615 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865b7bff-401f-4689-8aea-6fedb9023427 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:08.291445 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865b7bff-401f-4689-8aea-6fedb9023427 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:08.296657 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c2974-bf93-4bb4-bbe8-fce65b3f8e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:08.297457 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c2974-bf93-4bb4-bbe8-fce65b3f8e17 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:08.297736 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c2974-bf93-4bb4-bbe8-fce65b3f8e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:08.298006 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c2974-bf93-4bb4-bbe8-fce65b3f8e17 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:08.310109 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6c2974-bf93-4bb4-bbe8-fce65b3f8e17 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 18:05:08.318756 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-ed6c2974-bf93-4bb4-bbe8-fce65b3f8e17 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 18:05:08.319961 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 300/605] 10.222.0.18 () {56 vars in 1123 bytes} [Tue Oct 12 18:05:08 2021] GET /identity/v3/roles/service => generated 85 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:08.326697 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e0025d-78da-4b60-a65d-bc82ba6ee142 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:08.336733 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e0025d-78da-4b60-a65d-bc82ba6ee142 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:08.341542 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c7ed5b-e646-4e98-a697-bfb18b5876cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:08.342334 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c7ed5b-e646-4e98-a697-bfb18b5876cf admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:08.342674 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c7ed5b-e646-4e98-a697-bfb18b5876cf admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:08.343018 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c7ed5b-e646-4e98-a697-bfb18b5876cf admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:08.343954 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c7ed5b-e646-4e98-a697-bfb18b5876cf admin admin] RBAC: Adding query filter params (name=service) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:08.344331 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c7ed5b-e646-4e98-a697-bfb18b5876cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:08.346131 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c7ed5b-e646-4e98-a697-bfb18b5876cf admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:08.360534 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 306/606] 10.222.0.18 () {56 vars in 1124 bytes} [Tue Oct 12 18:05:08 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:08.363088 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c2974-bf93-4bb4-bbe8-fce65b3f8e17 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:08.373664 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c2974-bf93-4bb4-bbe8-fce65b3f8e17 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:08.378515 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb70cbea-ca5f-4b2f-9dcb-10a146343751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:08.379416 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70cbea-ca5f-4b2f-9dcb-10a146343751 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:08.379763 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70cbea-ca5f-4b2f-9dcb-10a146343751 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:08.380661 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70cbea-ca5f-4b2f-9dcb-10a146343751 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:08.393051 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb70cbea-ca5f-4b2f-9dcb-10a146343751 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:08.395022 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb70cbea-ca5f-4b2f-9dcb-10a146343751 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:08.412987 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-fb70cbea-ca5f-4b2f-9dcb-10a146343751 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 18:05:08.419432 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 301/607] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:05:08 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:08.420812 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c7ed5b-e646-4e98-a697-bfb18b5876cf admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:08.430696 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c7ed5b-e646-4e98-a697-bfb18b5876cf admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:08.435310 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c0cc89-aa5c-4995-bcef-3f85ad772050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:08.435970 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0cc89-aa5c-4995-bcef-3f85ad772050 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:08.436250 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0cc89-aa5c-4995-bcef-3f85ad772050 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:08.436568 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0cc89-aa5c-4995-bcef-3f85ad772050 admin admin] PATH_INFO: `/v3/domains` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:08.437299 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c0cc89-aa5c-4995-bcef-3f85ad772050 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:08.437602 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c0cc89-aa5c-4995-bcef-3f85ad772050 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:08.439199 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c0cc89-aa5c-4995-bcef-3f85ad772050 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:08.462496 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 307/608] 10.222.0.18 () {56 vars in 1130 bytes} [Tue Oct 12 18:05:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:05:08.463883 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb70cbea-ca5f-4b2f-9dcb-10a146343751 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:08.474589 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb70cbea-ca5f-4b2f-9dcb-10a146343751 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:08.479272 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fe0f33-0f7e-4cf7-a983-7c083d4c6d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:08.480112 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fe0f33-0f7e-4cf7-a983-7c083d4c6d96 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:08.480456 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fe0f33-0f7e-4cf7-a983-7c083d4c6d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:08.480742 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fe0f33-0f7e-4cf7-a983-7c083d4c6d96 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:08.489369 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fe0f33-0f7e-4cf7-a983-7c083d4c6d96 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:08.491542 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fe0f33-0f7e-4cf7-a983-7c083d4c6d96 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:08.506203 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-d7fe0f33-0f7e-4cf7-a983-7c083d4c6d96 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 12 18:05:08.508740 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 302/609] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Oct 12 18:05:08 2021] GET /identity/v3/users/swift => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 18:05:08.514134 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c0cc89-aa5c-4995-bcef-3f85ad772050 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:08.524709 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c0cc89-aa5c-4995-bcef-3f85ad772050 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:08.529543 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c286d545-f30d-4d16-badb-af2533b2662d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:08.530288 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c286d545-f30d-4d16-badb-af2533b2662d admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:08.530627 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c286d545-f30d-4d16-badb-af2533b2662d admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:08.530906 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c286d545-f30d-4d16-badb-af2533b2662d admin admin] PATH_INFO: `/v3/users` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:08.531836 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c286d545-f30d-4d16-badb-af2533b2662d admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:08.532154 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c286d545-f30d-4d16-badb-af2533b2662d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:08.534292 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c286d545-f30d-4d16-badb-af2533b2662d admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:08.559812 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 308/610] 10.222.0.18 () {56 vars in 1156 bytes} [Tue Oct 12 18:05:08 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:08.561159 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fe0f33-0f7e-4cf7-a983-7c083d4c6d96 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:08.571748 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fe0f33-0f7e-4cf7-a983-7c083d4c6d96 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:08.576361 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba58329-4bd6-4e74-92a9-22525ed76c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:08.577065 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba58329-4bd6-4e74-92a9-22525ed76c93 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:08.577355 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba58329-4bd6-4e74-92a9-22525ed76c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:08.577626 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba58329-4bd6-4e74-92a9-22525ed76c93 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:08.586032 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba58329-4bd6-4e74-92a9-22525ed76c93 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:08.587847 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba58329-4bd6-4e74-92a9-22525ed76c93 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:08.600520 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 303/611] 10.222.0.18 () {58 vars in 1324 bytes} [Tue Oct 12 18:05:08 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:05:08.604133 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c286d545-f30d-4d16-badb-af2533b2662d admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:08.614343 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c286d545-f30d-4d16-badb-af2533b2662d admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:08.626115 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0b75d3-066e-463d-b2b6-e6c3be5b35bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:08.626982 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b75d3-066e-463d-b2b6-e6c3be5b35bb admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:08.627264 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b75d3-066e-463d-b2b6-e6c3be5b35bb admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:08.627540 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b75d3-066e-463d-b2b6-e6c3be5b35bb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:08.640694 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0b75d3-066e-463d-b2b6-e6c3be5b35bb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:08.642892 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0b75d3-066e-463d-b2b6-e6c3be5b35bb admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:08.669482 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-0b0b75d3-066e-463d-b2b6-e6c3be5b35bb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 18:05:08.671126 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 309/612] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:05:08 2021] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:08.677967 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba58329-4bd6-4e74-92a9-22525ed76c93 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:08.687567 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba58329-4bd6-4e74-92a9-22525ed76c93 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:08.694713 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aa64b0-4f55-4aa8-95bc-fbde94aebee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:08.695409 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aa64b0-4f55-4aa8-95bc-fbde94aebee2 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:08.695926 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aa64b0-4f55-4aa8-95bc-fbde94aebee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:08.696091 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aa64b0-4f55-4aa8-95bc-fbde94aebee2 admin admin] PATH_INFO: `/v3/domains` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:08.696722 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aa64b0-4f55-4aa8-95bc-fbde94aebee2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:08.697024 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aa64b0-4f55-4aa8-95bc-fbde94aebee2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:08.698612 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aa64b0-4f55-4aa8-95bc-fbde94aebee2 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:08.718757 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 304/613] 10.222.0.18 () {56 vars in 1130 bytes} [Tue Oct 12 18:05:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:08.725054 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0b75d3-066e-463d-b2b6-e6c3be5b35bb admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:08.735592 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0b75d3-066e-463d-b2b6-e6c3be5b35bb admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:08.742476 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bca1bb7-9afe-4b21-9c99-a9c3191fd659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:08.743256 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca1bb7-9afe-4b21-9c99-a9c3191fd659 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:08.743628 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca1bb7-9afe-4b21-9c99-a9c3191fd659 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:08.743906 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca1bb7-9afe-4b21-9c99-a9c3191fd659 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:08.757630 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bca1bb7-9afe-4b21-9c99-a9c3191fd659 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:08.759667 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bca1bb7-9afe-4b21-9c99-a9c3191fd659 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:08.775729 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-3bca1bb7-9afe-4b21-9c99-a9c3191fd659 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 18:05:08.778319 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 310/614] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Oct 12 18:05:08 2021] GET /identity/v3/projects/service => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:08.783800 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aa64b0-4f55-4aa8-95bc-fbde94aebee2 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:08.794310 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aa64b0-4f55-4aa8-95bc-fbde94aebee2 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:08.799268 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdc9e11-1bd1-4f71-9c08-57c9665af003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:08.799928 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc9e11-1bd1-4f71-9c08-57c9665af003 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:08.800261 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc9e11-1bd1-4f71-9c08-57c9665af003 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:08.800564 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc9e11-1bd1-4f71-9c08-57c9665af003 admin admin] PATH_INFO: `/v3/projects` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:08.801421 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdc9e11-1bd1-4f71-9c08-57c9665af003 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:08.801728 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdc9e11-1bd1-4f71-9c08-57c9665af003 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:08.804236 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdc9e11-1bd1-4f71-9c08-57c9665af003 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:08.820551 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 305/615] 10.222.0.18 () {56 vars in 1169 bytes} [Tue Oct 12 18:05:08 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:08.823760 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bca1bb7-9afe-4b21-9c99-a9c3191fd659 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:08.834986 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bca1bb7-9afe-4b21-9c99-a9c3191fd659 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:08.839722 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5a2f70-28ce-4a28-8746-9332267c04bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:08.840359 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a2f70-28ce-4a28-8746-9332267c04bc admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:08.840721 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a2f70-28ce-4a28-8746-9332267c04bc admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:08.841047 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a2f70-28ce-4a28-8746-9332267c04bc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:08.841943 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5a2f70-28ce-4a28-8746-9332267c04bc admin admin] RBAC: Adding query filter params (role.id=24b43b2260b1455e832abdff63df40bd, scope.project.id=e843aaa9e5e44a8e98f7cc7412d9697b, user.id=7f527f925af24eba8cabffe457fceb09) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:08.842253 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5a2f70-28ce-4a28-8746-9332267c04bc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:08.844222 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5a2f70-28ce-4a28-8746-9332267c04bc admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:08.856566 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 311/616] 10.222.0.18 () {56 vars in 1395 bytes} [Tue Oct 12 18:05:08 2021] GET /identity/v3/role_assignments?user.id=7f527f925af24eba8cabffe457fceb09&scope.project.id=e843aaa9e5e44a8e98f7cc7412d9697b&role.id=24b43b2260b1455e832abdff63df40bd => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:09.700651 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4765c7f3-5dd2-401e-8e90-81b65e1c085c None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:09.701288 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4765c7f3-5dd2-401e-8e90-81b65e1c085c None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:09.701288 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4765c7f3-5dd2-401e-8e90-81b65e1c085c None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:09.702952 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 306/617] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:05:09 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:05:09.710180 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1470b8c4-8241-4588-95bd-ab604dfba224 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:09.710742 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1470b8c4-8241-4588-95bd-ab604dfba224 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:09.710742 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1470b8c4-8241-4588-95bd-ab604dfba224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:09.736546 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-1470b8c4-8241-4588-95bd-ab604dfba224 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:05:09.737743 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-1470b8c4-8241-4588-95bd-ab604dfba224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:05:09.748806 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 312/618] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:05:09 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:05:09.785704 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4765c7f3-5dd2-401e-8e90-81b65e1c085c None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:09.802294 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4765c7f3-5dd2-401e-8e90-81b65e1c085c None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:09.809552 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465a0333-a6da-4b8b-a4a4-b3e18a042565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:09.810222 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a0333-a6da-4b8b-a4a4-b3e18a042565 admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:09.810506 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a0333-a6da-4b8b-a4a4-b3e18a042565 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:09.810783 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a0333-a6da-4b8b-a4a4-b3e18a042565 admin admin] PATH_INFO: `/v3/services` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:09.811541 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465a0333-a6da-4b8b-a4a4-b3e18a042565 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:09.812579 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING py.warnings [None req-465a0333-a6da-4b8b-a4a4-b3e18a042565 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:05:09.812579 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: warnings.warn(msg) Oct 12 18:05:09.812579 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: Oct 12 18:05:09.813459 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465a0333-a6da-4b8b-a4a4-b3e18a042565 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:09.905525 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 307/619] 10.222.0.18 () {60 vars in 1162 bytes} [Tue Oct 12 18:05:09 2021] POST /identity/v3/services => generated 251 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:05:10.121533 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66202559-75ea-4b5d-9206-b83c16090d39 None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:10.121916 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66202559-75ea-4b5d-9206-b83c16090d39 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:10.122113 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66202559-75ea-4b5d-9206-b83c16090d39 None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:10.124271 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 313/620] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:05:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:05:10.130905 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2540b4-afd0-4216-a6bd-64d81044dd8b None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:10.131199 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2540b4-afd0-4216-a6bd-64d81044dd8b None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:10.131465 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2540b4-afd0-4216-a6bd-64d81044dd8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:10.158371 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-4f2540b4-afd0-4216-a6bd-64d81044dd8b None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:05:10.159509 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-4f2540b4-afd0-4216-a6bd-64d81044dd8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:05:10.197976 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 308/621] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:05:10 2021] POST /identity/v3/auth/tokens => generated 1171 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:05:10.233963 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66202559-75ea-4b5d-9206-b83c16090d39 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:10.246657 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66202559-75ea-4b5d-9206-b83c16090d39 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:10.251059 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8035317e-92e1-4246-8d1a-17cfa52be690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:10.251838 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8035317e-92e1-4246-8d1a-17cfa52be690 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:10.252118 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8035317e-92e1-4246-8d1a-17cfa52be690 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:10.252391 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8035317e-92e1-4246-8d1a-17cfa52be690 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:10.262927 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8035317e-92e1-4246-8d1a-17cfa52be690 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 18:05:10.270172 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-8035317e-92e1-4246-8d1a-17cfa52be690 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 18:05:10.272239 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 314/622] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Oct 12 18:05:10 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:10.278747 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2540b4-afd0-4216-a6bd-64d81044dd8b None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:10.288751 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2540b4-afd0-4216-a6bd-64d81044dd8b None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:10.293402 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f423be21-80d3-40fd-96d1-5e58bde56af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:10.294122 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423be21-80d3-40fd-96d1-5e58bde56af8 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:10.294406 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423be21-80d3-40fd-96d1-5e58bde56af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:10.294682 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423be21-80d3-40fd-96d1-5e58bde56af8 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:10.295507 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f423be21-80d3-40fd-96d1-5e58bde56af8 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:10.295818 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f423be21-80d3-40fd-96d1-5e58bde56af8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:10.297463 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f423be21-80d3-40fd-96d1-5e58bde56af8 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:10.307385 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 309/623] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Oct 12 18:05:10 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:10.313647 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8035317e-92e1-4246-8d1a-17cfa52be690 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:10.324548 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8035317e-92e1-4246-8d1a-17cfa52be690 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:10.329400 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c790c75-c035-45b9-ae98-692451d73e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:10.330193 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c790c75-c035-45b9-ae98-692451d73e04 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:10.330523 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c790c75-c035-45b9-ae98-692451d73e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:10.330799 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c790c75-c035-45b9-ae98-692451d73e04 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:10.342913 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c790c75-c035-45b9-ae98-692451d73e04 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:10.344888 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c790c75-c035-45b9-ae98-692451d73e04 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:10.361468 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-4c790c75-c035-45b9-ae98-692451d73e04 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 18:05:10.362941 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 315/624] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:05:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:10.369744 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f423be21-80d3-40fd-96d1-5e58bde56af8 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:10.379681 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f423be21-80d3-40fd-96d1-5e58bde56af8 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:10.384455 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba435b-4d11-4ec0-a614-b82bc6271a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:10.385259 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba435b-4d11-4ec0-a614-b82bc6271a5c admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:10.385446 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba435b-4d11-4ec0-a614-b82bc6271a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:10.385772 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba435b-4d11-4ec0-a614-b82bc6271a5c admin admin] PATH_INFO: `/v3/domains` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:10.386519 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ba435b-4d11-4ec0-a614-b82bc6271a5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:10.386828 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ba435b-4d11-4ec0-a614-b82bc6271a5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:10.388560 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ba435b-4d11-4ec0-a614-b82bc6271a5c admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:10.402786 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 310/625] 10.222.0.18 () {56 vars in 1130 bytes} [Tue Oct 12 18:05:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:10.408988 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c790c75-c035-45b9-ae98-692451d73e04 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:10.419382 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c790c75-c035-45b9-ae98-692451d73e04 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:10.424174 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c092dd8-ffa5-4dae-89e1-efe77ecff1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:10.425088 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c092dd8-ffa5-4dae-89e1-efe77ecff1e3 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:10.425370 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c092dd8-ffa5-4dae-89e1-efe77ecff1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:10.425642 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c092dd8-ffa5-4dae-89e1-efe77ecff1e3 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:10.437659 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c092dd8-ffa5-4dae-89e1-efe77ecff1e3 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:10.439780 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c092dd8-ffa5-4dae-89e1-efe77ecff1e3 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:10.454910 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-2c092dd8-ffa5-4dae-89e1-efe77ecff1e3 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 12 18:05:10.456530 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 316/626] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Oct 12 18:05:10 2021] GET /identity/v3/users/nova => generated 82 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:10.463551 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba435b-4d11-4ec0-a614-b82bc6271a5c admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:10.473798 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba435b-4d11-4ec0-a614-b82bc6271a5c admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:10.482240 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e36518e-c5f9-4593-ab9a-9b611c9d55d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:10.482970 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e36518e-c5f9-4593-ab9a-9b611c9d55d6 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:10.483386 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e36518e-c5f9-4593-ab9a-9b611c9d55d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:10.483666 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e36518e-c5f9-4593-ab9a-9b611c9d55d6 admin admin] PATH_INFO: `/v3/users` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:10.484604 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e36518e-c5f9-4593-ab9a-9b611c9d55d6 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:10.484912 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e36518e-c5f9-4593-ab9a-9b611c9d55d6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:10.486844 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e36518e-c5f9-4593-ab9a-9b611c9d55d6 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:10.507860 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 311/627] 10.222.0.18 () {56 vars in 1154 bytes} [Tue Oct 12 18:05:10 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:10.514070 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c092dd8-ffa5-4dae-89e1-efe77ecff1e3 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:10.524288 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c092dd8-ffa5-4dae-89e1-efe77ecff1e3 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:10.529016 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3cdf7d-c9a9-4f37-a145-0f6974f0d0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:10.529853 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3cdf7d-c9a9-4f37-a145-0f6974f0d0b4 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:10.530135 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3cdf7d-c9a9-4f37-a145-0f6974f0d0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:10.530456 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3cdf7d-c9a9-4f37-a145-0f6974f0d0b4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:10.542331 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3cdf7d-c9a9-4f37-a145-0f6974f0d0b4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:10.544242 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3cdf7d-c9a9-4f37-a145-0f6974f0d0b4 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:10.561686 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-fd3cdf7d-c9a9-4f37-a145-0f6974f0d0b4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 18:05:10.563208 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 317/628] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:05:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:10.569427 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e36518e-c5f9-4593-ab9a-9b611c9d55d6 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:10.581018 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e36518e-c5f9-4593-ab9a-9b611c9d55d6 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:10.585865 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f906b8b4-0314-4863-b8fb-353e6f196243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:10.586524 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f906b8b4-0314-4863-b8fb-353e6f196243 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:10.586855 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f906b8b4-0314-4863-b8fb-353e6f196243 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:10.587135 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f906b8b4-0314-4863-b8fb-353e6f196243 admin admin] PATH_INFO: `/v3/domains` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:10.587935 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f906b8b4-0314-4863-b8fb-353e6f196243 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:10.588298 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f906b8b4-0314-4863-b8fb-353e6f196243 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:10.589973 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f906b8b4-0314-4863-b8fb-353e6f196243 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:10.609504 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 312/629] 10.222.0.18 () {56 vars in 1130 bytes} [Tue Oct 12 18:05:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:10.617009 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3cdf7d-c9a9-4f37-a145-0f6974f0d0b4 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:10.629509 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3cdf7d-c9a9-4f37-a145-0f6974f0d0b4 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:10.634741 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b404f86-8e9e-4742-a2a7-016d98286e44 None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:10.635275 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b404f86-8e9e-4742-a2a7-016d98286e44 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:10.635816 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b404f86-8e9e-4742-a2a7-016d98286e44 None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:10.638191 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 313/630] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:05:10 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 18:05:10.642913 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166fb419-0c91-4210-b9a4-c1331f861ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:10.644079 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166fb419-0c91-4210-b9a4-c1331f861ee0 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:10.644364 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166fb419-0c91-4210-b9a4-c1331f861ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:10.644667 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166fb419-0c91-4210-b9a4-c1331f861ee0 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:10.645914 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d08c2b-3e6a-4a49-9f69-42b50e9628e4 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:10.646416 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d08c2b-3e6a-4a49-9f69-42b50e9628e4 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:10.647160 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d08c2b-3e6a-4a49-9f69-42b50e9628e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:10.659591 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166fb419-0c91-4210-b9a4-c1331f861ee0 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:10.663666 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166fb419-0c91-4210-b9a4-c1331f861ee0 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:10.687019 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-56d08c2b-3e6a-4a49-9f69-42b50e9628e4 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:05:10.688227 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-56d08c2b-3e6a-4a49-9f69-42b50e9628e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:05:10.691411 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-166fb419-0c91-4210-b9a4-c1331f861ee0 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 18:05:10.701393 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 318/631] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Oct 12 18:05:10 2021] GET /identity/v3/projects/service => generated 88 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:10.705090 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 314/632] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:05:10 2021] POST /identity/v3/auth/tokens => generated 1171 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:05:10.707514 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166fb419-0c91-4210-b9a4-c1331f861ee0 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:10.720932 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166fb419-0c91-4210-b9a4-c1331f861ee0 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:10.727540 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9720b2-f0fc-40bc-9643-8669fb0e645a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:10.728207 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9720b2-f0fc-40bc-9643-8669fb0e645a admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:10.728544 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9720b2-f0fc-40bc-9643-8669fb0e645a admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:10.728821 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9720b2-f0fc-40bc-9643-8669fb0e645a admin admin] PATH_INFO: `/v3/projects` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:10.729626 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9720b2-f0fc-40bc-9643-8669fb0e645a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:10.729975 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9720b2-f0fc-40bc-9643-8669fb0e645a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:10.731900 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9720b2-f0fc-40bc-9643-8669fb0e645a admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:10.736380 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d08c2b-3e6a-4a49-9f69-42b50e9628e4 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:10.749143 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d08c2b-3e6a-4a49-9f69-42b50e9628e4 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:10.756076 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a6ea71-127c-4689-b913-b4f53a1264c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:10.758721 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a6ea71-127c-4689-b913-b4f53a1264c4 admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:10.759065 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a6ea71-127c-4689-b913-b4f53a1264c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:10.759353 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a6ea71-127c-4689-b913-b4f53a1264c4 admin admin] PATH_INFO: `/v3/services` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:10.760105 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a6ea71-127c-4689-b913-b4f53a1264c4 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:10.763524 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 319/633] 10.222.0.18 () {56 vars in 1169 bytes} [Tue Oct 12 18:05:10 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:05:10.764182 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a6ea71-127c-4689-b913-b4f53a1264c4 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:10.774628 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9720b2-f0fc-40bc-9643-8669fb0e645a admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:10.785212 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9720b2-f0fc-40bc-9643-8669fb0e645a admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:10.790708 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d533bdad-c39b-4158-b77a-998fc23029d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:10.791674 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d533bdad-c39b-4158-b77a-998fc23029d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:10.792007 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d533bdad-c39b-4158-b77a-998fc23029d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:10.792282 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d533bdad-c39b-4158-b77a-998fc23029d0 admin admin] PATH_INFO: `/v3/projects/e843aaa9e5e44a8e98f7cc7412d9697b/users/3417097a280b499086b36df9a2548239/roles/6c54f239944d46e3b027ccce97eb8b49` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:10.794526 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d533bdad-c39b-4158-b77a-998fc23029d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e843aaa9e5e44a8e98f7cc7412d9697b, user_id=3417097a280b499086b36df9a2548239, role_id=6c54f239944d46e3b027ccce97eb8b49)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:10.797366 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d533bdad-c39b-4158-b77a-998fc23029d0 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:10.855604 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 315/634] 10.222.0.18 () {60 vars in 1162 bytes} [Tue Oct 12 18:05:10 2021] POST /identity/v3/services => generated 240 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 18:05:10.877505 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 320/635] 10.222.0.18 () {58 vars in 1460 bytes} [Tue Oct 12 18:05:10 2021] PUT /identity/v3/projects/e843aaa9e5e44a8e98f7cc7412d9697b/users/3417097a280b499086b36df9a2548239/roles/6c54f239944d46e3b027ccce97eb8b49 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 18:05:11.182050 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ccce46-7013-4399-97ed-2f78e4c0d653 None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:11.182443 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ccce46-7013-4399-97ed-2f78e4c0d653 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:11.182615 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ccce46-7013-4399-97ed-2f78e4c0d653 None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:11.184756 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 316/636] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:05:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:05:11.191477 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29cf1b0-8568-4543-bc90-968c208e83d0 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:11.191757 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29cf1b0-8568-4543-bc90-968c208e83d0 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:11.192018 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29cf1b0-8568-4543-bc90-968c208e83d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:11.212231 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-d29cf1b0-8568-4543-bc90-968c208e83d0 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:05:11.213524 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-d29cf1b0-8568-4543-bc90-968c208e83d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:05:11.286324 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 321/637] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:05:11 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:05:11.309787 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ccce46-7013-4399-97ed-2f78e4c0d653 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:11.323852 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ccce46-7013-4399-97ed-2f78e4c0d653 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:11.329049 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6476936b-c7a9-40cd-a54c-e7952fc775e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:11.329851 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6476936b-c7a9-40cd-a54c-e7952fc775e3 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:11.330133 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6476936b-c7a9-40cd-a54c-e7952fc775e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:11.330399 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6476936b-c7a9-40cd-a54c-e7952fc775e3 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:11.341269 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6476936b-c7a9-40cd-a54c-e7952fc775e3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 18:05:11.348181 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-6476936b-c7a9-40cd-a54c-e7952fc775e3 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 18:05:11.350263 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 317/638] 10.222.0.18 () {56 vars in 1123 bytes} [Tue Oct 12 18:05:11 2021] GET /identity/v3/roles/service => generated 85 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:11.356574 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29cf1b0-8568-4543-bc90-968c208e83d0 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:11.365608 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29cf1b0-8568-4543-bc90-968c208e83d0 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:11.377099 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f186cb5-bfbf-464a-b7b2-9383a70a0dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:11.377786 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f186cb5-bfbf-464a-b7b2-9383a70a0dba admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:11.378068 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f186cb5-bfbf-464a-b7b2-9383a70a0dba admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:11.378346 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f186cb5-bfbf-464a-b7b2-9383a70a0dba admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:11.379116 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f186cb5-bfbf-464a-b7b2-9383a70a0dba admin admin] RBAC: Adding query filter params (name=service) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:11.379428 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f186cb5-bfbf-464a-b7b2-9383a70a0dba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:11.381601 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f186cb5-bfbf-464a-b7b2-9383a70a0dba admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:11.390742 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 322/639] 10.222.0.18 () {56 vars in 1124 bytes} [Tue Oct 12 18:05:11 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:11.396678 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6476936b-c7a9-40cd-a54c-e7952fc775e3 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:11.411147 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6476936b-c7a9-40cd-a54c-e7952fc775e3 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:11.420079 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca769c7e-0c7f-434a-bd88-66bbba3c3267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:11.420890 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca769c7e-0c7f-434a-bd88-66bbba3c3267 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:11.421165 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca769c7e-0c7f-434a-bd88-66bbba3c3267 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:11.421434 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca769c7e-0c7f-434a-bd88-66bbba3c3267 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:11.434953 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca769c7e-0c7f-434a-bd88-66bbba3c3267 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:11.440830 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca769c7e-0c7f-434a-bd88-66bbba3c3267 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:11.466710 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-ca769c7e-0c7f-434a-bd88-66bbba3c3267 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 18:05:11.467939 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 318/640] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:05:11 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:11.474674 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f186cb5-bfbf-464a-b7b2-9383a70a0dba admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:11.487719 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f186cb5-bfbf-464a-b7b2-9383a70a0dba admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:11.502107 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8114a023-aa5e-4c7a-b55c-4bd25066e6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:11.502795 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8114a023-aa5e-4c7a-b55c-4bd25066e6c4 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:11.503082 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8114a023-aa5e-4c7a-b55c-4bd25066e6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:11.503362 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8114a023-aa5e-4c7a-b55c-4bd25066e6c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:11.504112 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8114a023-aa5e-4c7a-b55c-4bd25066e6c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:11.504437 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8114a023-aa5e-4c7a-b55c-4bd25066e6c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:11.506582 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8114a023-aa5e-4c7a-b55c-4bd25066e6c4 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:11.522523 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 323/641] 10.222.0.18 () {56 vars in 1130 bytes} [Tue Oct 12 18:05:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:11.528183 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca769c7e-0c7f-434a-bd88-66bbba3c3267 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:11.538579 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca769c7e-0c7f-434a-bd88-66bbba3c3267 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:11.548157 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90071785-4e23-40d9-876d-2145aca782a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:11.548983 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90071785-4e23-40d9-876d-2145aca782a5 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:11.549261 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90071785-4e23-40d9-876d-2145aca782a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:11.549530 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90071785-4e23-40d9-876d-2145aca782a5 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:11.559864 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90071785-4e23-40d9-876d-2145aca782a5 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:11.561935 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90071785-4e23-40d9-876d-2145aca782a5 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:11.584383 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-90071785-4e23-40d9-876d-2145aca782a5 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 12 18:05:11.589646 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 319/642] 10.222.0.18 () {56 vars in 1138 bytes} [Tue Oct 12 18:05:11 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:11.595801 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8114a023-aa5e-4c7a-b55c-4bd25066e6c4 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:11.609816 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8114a023-aa5e-4c7a-b55c-4bd25066e6c4 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:11.625089 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e444ce-ccb6-4618-9817-37534e59c830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:11.625778 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e444ce-ccb6-4618-9817-37534e59c830 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:11.626061 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e444ce-ccb6-4618-9817-37534e59c830 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:11.626341 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e444ce-ccb6-4618-9817-37534e59c830 admin admin] PATH_INFO: `/v3/users` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:11.627194 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e444ce-ccb6-4618-9817-37534e59c830 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:11.627506 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e444ce-ccb6-4618-9817-37534e59c830 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:11.629518 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e444ce-ccb6-4618-9817-37534e59c830 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:11.664458 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 324/643] 10.222.0.18 () {56 vars in 1170 bytes} [Tue Oct 12 18:05:11 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:11.670153 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90071785-4e23-40d9-876d-2145aca782a5 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:11.686074 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90071785-4e23-40d9-876d-2145aca782a5 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:11.695400 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e61ee7e-ba12-4aba-a714-8268775e3d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:11.696031 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e61ee7e-ba12-4aba-a714-8268775e3d70 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:11.696303 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e61ee7e-ba12-4aba-a714-8268775e3d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:11.696601 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e61ee7e-ba12-4aba-a714-8268775e3d70 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:11.707990 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e61ee7e-ba12-4aba-a714-8268775e3d70 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:11.710294 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e61ee7e-ba12-4aba-a714-8268775e3d70 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:11.724946 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 320/644] 10.222.0.18 () {58 vars in 1324 bytes} [Tue Oct 12 18:05:11 2021] GET /identity/v3/auth/tokens => generated 1270 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:05:11.731078 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e444ce-ccb6-4618-9817-37534e59c830 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:11.745968 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e444ce-ccb6-4618-9817-37534e59c830 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:11.756181 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3f205f-cb1c-4b9c-be05-83acea79580b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:11.757001 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f205f-cb1c-4b9c-be05-83acea79580b admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:11.757278 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f205f-cb1c-4b9c-be05-83acea79580b admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:11.757550 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f205f-cb1c-4b9c-be05-83acea79580b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:11.776009 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3f205f-cb1c-4b9c-be05-83acea79580b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:11.777888 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3f205f-cb1c-4b9c-be05-83acea79580b admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:11.803036 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-7a3f205f-cb1c-4b9c-be05-83acea79580b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 18:05:11.808506 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 325/645] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:05:11 2021] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:11.810274 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e61ee7e-ba12-4aba-a714-8268775e3d70 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:11.826919 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e61ee7e-ba12-4aba-a714-8268775e3d70 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:11.834864 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d991ac36-2e7c-4f8b-9147-0f3e55b08f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:11.835518 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d991ac36-2e7c-4f8b-9147-0f3e55b08f35 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:11.835792 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d991ac36-2e7c-4f8b-9147-0f3e55b08f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:11.836061 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d991ac36-2e7c-4f8b-9147-0f3e55b08f35 admin admin] PATH_INFO: `/v3/domains` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:11.836819 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d991ac36-2e7c-4f8b-9147-0f3e55b08f35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:11.837119 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d991ac36-2e7c-4f8b-9147-0f3e55b08f35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:11.838691 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d991ac36-2e7c-4f8b-9147-0f3e55b08f35 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:11.858146 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 321/646] 10.222.0.18 () {56 vars in 1130 bytes} [Tue Oct 12 18:05:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:11.864124 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3f205f-cb1c-4b9c-be05-83acea79580b admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:11.877391 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3f205f-cb1c-4b9c-be05-83acea79580b admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:11.886576 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6253ddb8-b45e-4266-8128-ae7a73a75d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:11.887353 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253ddb8-b45e-4266-8128-ae7a73a75d30 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:11.887633 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253ddb8-b45e-4266-8128-ae7a73a75d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:11.887905 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253ddb8-b45e-4266-8128-ae7a73a75d30 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:11.905553 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6253ddb8-b45e-4266-8128-ae7a73a75d30 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:11.907547 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6253ddb8-b45e-4266-8128-ae7a73a75d30 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:11.928650 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-6253ddb8-b45e-4266-8128-ae7a73a75d30 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 18:05:11.934708 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 326/647] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Oct 12 18:05:11 2021] GET /identity/v3/projects/service => generated 88 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:11.935916 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d991ac36-2e7c-4f8b-9147-0f3e55b08f35 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:11.949408 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d991ac36-2e7c-4f8b-9147-0f3e55b08f35 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:11.965030 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28e35fb-3720-407b-a223-f17a681c6603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:11.965685 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e35fb-3720-407b-a223-f17a681c6603 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:11.965961 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e35fb-3720-407b-a223-f17a681c6603 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:11.966232 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e35fb-3720-407b-a223-f17a681c6603 admin admin] PATH_INFO: `/v3/projects` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:11.967050 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28e35fb-3720-407b-a223-f17a681c6603 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:11.967357 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28e35fb-3720-407b-a223-f17a681c6603 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:11.969284 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28e35fb-3720-407b-a223-f17a681c6603 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:11.983348 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 322/648] 10.222.0.18 () {56 vars in 1169 bytes} [Tue Oct 12 18:05:11 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:11.990619 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6253ddb8-b45e-4266-8128-ae7a73a75d30 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:12.006485 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6253ddb8-b45e-4266-8128-ae7a73a75d30 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:12.016650 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47789244-bed4-4beb-809e-51a1070946cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:12.017321 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47789244-bed4-4beb-809e-51a1070946cb admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:12.017602 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47789244-bed4-4beb-809e-51a1070946cb admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:12.017876 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47789244-bed4-4beb-809e-51a1070946cb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:12.018726 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47789244-bed4-4beb-809e-51a1070946cb admin admin] RBAC: Adding query filter params (role.id=24b43b2260b1455e832abdff63df40bd, scope.project.id=e843aaa9e5e44a8e98f7cc7412d9697b, user.id=8f6a3a7064754fb79a0a06b3ad4a7d05) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:12.019035 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47789244-bed4-4beb-809e-51a1070946cb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:12.021475 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47789244-bed4-4beb-809e-51a1070946cb admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:12.031696 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 327/649] 10.222.0.18 () {56 vars in 1395 bytes} [Tue Oct 12 18:05:11 2021] GET /identity/v3/role_assignments?user.id=8f6a3a7064754fb79a0a06b3ad4a7d05&scope.project.id=e843aaa9e5e44a8e98f7cc7412d9697b&role.id=24b43b2260b1455e832abdff63df40bd => generated 259 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:12.149400 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a8107-e704-46b4-b95b-196b2c50de69 None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:12.149731 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a8107-e704-46b4-b95b-196b2c50de69 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:12.150439 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a8107-e704-46b4-b95b-196b2c50de69 None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:12.152801 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 323/650] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:05:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:05:12.159172 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba99d544-29ab-44a6-95a8-0fdf2737493a None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:12.159510 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba99d544-29ab-44a6-95a8-0fdf2737493a None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:12.159706 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba99d544-29ab-44a6-95a8-0fdf2737493a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:12.190035 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-ba99d544-29ab-44a6-95a8-0fdf2737493a None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:05:12.191888 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-ba99d544-29ab-44a6-95a8-0fdf2737493a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:05:12.202053 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 328/651] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:05:12 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:05:12.242082 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128a8107-e704-46b4-b95b-196b2c50de69 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:12.265249 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128a8107-e704-46b4-b95b-196b2c50de69 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:12.270070 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9287e0d-87c3-458c-b635-3c8cad7dd177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:12.270925 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9287e0d-87c3-458c-b635-3c8cad7dd177 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:12.271201 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9287e0d-87c3-458c-b635-3c8cad7dd177 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:12.271470 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9287e0d-87c3-458c-b635-3c8cad7dd177 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:12.287690 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9287e0d-87c3-458c-b635-3c8cad7dd177 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 18:05:12.295070 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-a9287e0d-87c3-458c-b635-3c8cad7dd177 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 18:05:12.296707 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 324/652] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Oct 12 18:05:12 2021] GET /identity/v3/roles/admin => generated 83 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:12.302986 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba99d544-29ab-44a6-95a8-0fdf2737493a None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:12.312631 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba99d544-29ab-44a6-95a8-0fdf2737493a None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:12.321844 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db46c824-c607-4fcf-ae10-f4cd98541501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:12.322577 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46c824-c607-4fcf-ae10-f4cd98541501 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:12.322854 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46c824-c607-4fcf-ae10-f4cd98541501 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:12.323176 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46c824-c607-4fcf-ae10-f4cd98541501 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:12.323951 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db46c824-c607-4fcf-ae10-f4cd98541501 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:12.324306 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db46c824-c607-4fcf-ae10-f4cd98541501 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:12.326108 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db46c824-c607-4fcf-ae10-f4cd98541501 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:12.335989 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 329/653] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Oct 12 18:05:12 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:12.342160 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9287e0d-87c3-458c-b635-3c8cad7dd177 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:12.355125 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9287e0d-87c3-458c-b635-3c8cad7dd177 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:12.361943 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0475ea51-28c2-4c0e-b830-330ca04fd45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:12.362787 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0475ea51-28c2-4c0e-b830-330ca04fd45b admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:12.363069 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0475ea51-28c2-4c0e-b830-330ca04fd45b admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:12.363344 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0475ea51-28c2-4c0e-b830-330ca04fd45b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:12.375409 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0475ea51-28c2-4c0e-b830-330ca04fd45b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:12.378788 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0475ea51-28c2-4c0e-b830-330ca04fd45b admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:12.397022 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-0475ea51-28c2-4c0e-b830-330ca04fd45b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 18:05:12.398513 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 325/654] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:05:12 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:12.404741 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db46c824-c607-4fcf-ae10-f4cd98541501 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:12.415776 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db46c824-c607-4fcf-ae10-f4cd98541501 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:12.422693 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9431d8a-5430-4fa1-be70-ef4a8f6c361a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:12.423375 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9431d8a-5430-4fa1-be70-ef4a8f6c361a admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:12.423651 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9431d8a-5430-4fa1-be70-ef4a8f6c361a admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:12.423920 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9431d8a-5430-4fa1-be70-ef4a8f6c361a admin admin] PATH_INFO: `/v3/domains` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:12.424714 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9431d8a-5430-4fa1-be70-ef4a8f6c361a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:12.425019 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9431d8a-5430-4fa1-be70-ef4a8f6c361a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:12.427983 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9431d8a-5430-4fa1-be70-ef4a8f6c361a admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:12.448060 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 330/655] 10.222.0.18 () {56 vars in 1130 bytes} [Tue Oct 12 18:05:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:12.454448 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0475ea51-28c2-4c0e-b830-330ca04fd45b admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:12.464967 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0475ea51-28c2-4c0e-b830-330ca04fd45b admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:12.477060 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb38c792-3fe1-4fad-be15-76e8a28969fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:12.477895 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38c792-3fe1-4fad-be15-76e8a28969fa admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:12.478172 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38c792-3fe1-4fad-be15-76e8a28969fa admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:12.478444 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38c792-3fe1-4fad-be15-76e8a28969fa admin admin] PATH_INFO: `/v3/users/swift` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:12.501723 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb38c792-3fe1-4fad-be15-76e8a28969fa admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:12.501723 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb38c792-3fe1-4fad-be15-76e8a28969fa admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:12.518900 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-eb38c792-3fe1-4fad-be15-76e8a28969fa admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 12 18:05:12.520113 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 326/656] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Oct 12 18:05:12 2021] GET /identity/v3/users/swift => generated 83 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:12.527388 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9431d8a-5430-4fa1-be70-ef4a8f6c361a admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:12.541493 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9431d8a-5430-4fa1-be70-ef4a8f6c361a admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:12.554992 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f8972-3dfe-4a9a-8eee-33d6f1fd8ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:12.555668 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f8972-3dfe-4a9a-8eee-33d6f1fd8ee4 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:12.555940 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f8972-3dfe-4a9a-8eee-33d6f1fd8ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:12.556214 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f8972-3dfe-4a9a-8eee-33d6f1fd8ee4 admin admin] PATH_INFO: `/v3/users` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:12.557099 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2f8972-3dfe-4a9a-8eee-33d6f1fd8ee4 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:12.557403 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2f8972-3dfe-4a9a-8eee-33d6f1fd8ee4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:12.559257 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2f8972-3dfe-4a9a-8eee-33d6f1fd8ee4 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:12.586306 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 331/657] 10.222.0.18 () {56 vars in 1156 bytes} [Tue Oct 12 18:05:12 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:12.592790 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb38c792-3fe1-4fad-be15-76e8a28969fa admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:12.603828 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb38c792-3fe1-4fad-be15-76e8a28969fa admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:12.618483 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba676ac4-6dfb-4c47-b0e0-3c3526793a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:12.619479 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba676ac4-6dfb-4c47-b0e0-3c3526793a6d admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:12.619479 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba676ac4-6dfb-4c47-b0e0-3c3526793a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:12.619479 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba676ac4-6dfb-4c47-b0e0-3c3526793a6d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:12.639444 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba676ac4-6dfb-4c47-b0e0-3c3526793a6d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:12.641592 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba676ac4-6dfb-4c47-b0e0-3c3526793a6d admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:12.660535 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 327/658] 10.222.0.18 () {58 vars in 1324 bytes} [Tue Oct 12 18:05:12 2021] GET /identity/v3/auth/tokens => generated 1270 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:05:12.673577 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f8972-3dfe-4a9a-8eee-33d6f1fd8ee4 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:12.690077 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f8972-3dfe-4a9a-8eee-33d6f1fd8ee4 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:12.721211 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e2f61c-3da8-4053-809f-162ef92184ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:12.721947 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2f61c-3da8-4053-809f-162ef92184ea admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:12.722225 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2f61c-3da8-4053-809f-162ef92184ea admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:12.722499 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2f61c-3da8-4053-809f-162ef92184ea admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:12.742845 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e2f61c-3da8-4053-809f-162ef92184ea admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:12.744808 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e2f61c-3da8-4053-809f-162ef92184ea admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:12.779926 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-25e2f61c-3da8-4053-809f-162ef92184ea admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 18:05:12.789582 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 332/659] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:05:12 2021] GET /identity/v3/domains/Default => generated 87 bytes in 116 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:12.800926 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba676ac4-6dfb-4c47-b0e0-3c3526793a6d admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:12.810165 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba676ac4-6dfb-4c47-b0e0-3c3526793a6d admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:12.815107 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d6eba6-079c-4ab6-8c8d-803e962689d3 None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:12.815388 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d6eba6-079c-4ab6-8c8d-803e962689d3 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:12.816080 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d6eba6-079c-4ab6-8c8d-803e962689d3 None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:12.818345 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 333/660] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:05:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:05:12.825975 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a526fe-c54d-4a44-b2a1-1f5786d674fb None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:12.826285 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a526fe-c54d-4a44-b2a1-1f5786d674fb None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:12.826525 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a526fe-c54d-4a44-b2a1-1f5786d674fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:12.826954 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aee07df-3f6d-4f0c-add5-b8402e484016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:12.828048 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee07df-3f6d-4f0c-add5-b8402e484016 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:12.828635 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee07df-3f6d-4f0c-add5-b8402e484016 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:12.829159 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee07df-3f6d-4f0c-add5-b8402e484016 admin admin] PATH_INFO: `/v3/domains` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:12.830118 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aee07df-3f6d-4f0c-add5-b8402e484016 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:12.830630 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aee07df-3f6d-4f0c-add5-b8402e484016 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:12.832561 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aee07df-3f6d-4f0c-add5-b8402e484016 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:12.867894 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 328/661] 10.222.0.18 () {56 vars in 1130 bytes} [Tue Oct 12 18:05:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:12.875362 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aee07df-3f6d-4f0c-add5-b8402e484016 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:12.877060 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-89a526fe-c54d-4a44-b2a1-1f5786d674fb None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:05:12.878476 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-89a526fe-c54d-4a44-b2a1-1f5786d674fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:05:12.888743 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 334/662] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:05:12 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:05:12.910605 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aee07df-3f6d-4f0c-add5-b8402e484016 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:12.941672 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d82e2db-deaa-45c7-925d-aa241a4255bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:12.943009 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d82e2db-deaa-45c7-925d-aa241a4255bc admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:12.943295 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d82e2db-deaa-45c7-925d-aa241a4255bc admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:12.943567 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d82e2db-deaa-45c7-925d-aa241a4255bc admin admin] PATH_INFO: `/v3/projects/service` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:12.956448 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a526fe-c54d-4a44-b2a1-1f5786d674fb None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:12.959311 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d82e2db-deaa-45c7-925d-aa241a4255bc admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:12.961384 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d82e2db-deaa-45c7-925d-aa241a4255bc admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:12.975220 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a526fe-c54d-4a44-b2a1-1f5786d674fb None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:12.983240 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d4621d-13e6-4a45-af05-11bcd388f698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:12.987184 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4621d-13e6-4a45-af05-11bcd388f698 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:12.987469 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4621d-13e6-4a45-af05-11bcd388f698 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:12.987743 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4621d-13e6-4a45-af05-11bcd388f698 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:12.992815 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d4621d-13e6-4a45-af05-11bcd388f698 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:12.994653 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d4621d-13e6-4a45-af05-11bcd388f698 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:13.003272 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-0d82e2db-deaa-45c7-925d-aa241a4255bc admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 18:05:13.004528 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 329/663] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Oct 12 18:05:12 2021] GET /identity/v3/projects/service => generated 88 bytes in 131 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:13.016347 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d82e2db-deaa-45c7-925d-aa241a4255bc admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:13.032421 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-b7d4621d-13e6-4a45-af05-11bcd388f698 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 12 18:05:13.041139 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 335/664] 10.222.0.18 () {56 vars in 1150 bytes} [Tue Oct 12 18:05:12 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 18:05:13.048424 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d82e2db-deaa-45c7-925d-aa241a4255bc admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:13.053650 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d4621d-13e6-4a45-af05-11bcd388f698 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:13.057482 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6574fc60-e9d5-406a-99d6-8e4293b53a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:13.059338 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6574fc60-e9d5-406a-99d6-8e4293b53a61 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:13.059624 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6574fc60-e9d5-406a-99d6-8e4293b53a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:13.059898 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6574fc60-e9d5-406a-99d6-8e4293b53a61 admin admin] PATH_INFO: `/v3/projects` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:13.063014 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6574fc60-e9d5-406a-99d6-8e4293b53a61 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:13.063319 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6574fc60-e9d5-406a-99d6-8e4293b53a61 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:13.067571 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6574fc60-e9d5-406a-99d6-8e4293b53a61 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:13.072574 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d4621d-13e6-4a45-af05-11bcd388f698 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:13.080815 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6418ea-7d49-4bdf-9413-848304de2260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:13.085214 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6418ea-7d49-4bdf-9413-848304de2260 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:13.085547 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6418ea-7d49-4bdf-9413-848304de2260 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:13.085820 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6418ea-7d49-4bdf-9413-848304de2260 admin admin] PATH_INFO: `/v3/services` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:13.090866 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6418ea-7d49-4bdf-9413-848304de2260 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:13.090866 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6418ea-7d49-4bdf-9413-848304de2260 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:13.090866 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6418ea-7d49-4bdf-9413-848304de2260 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:13.099513 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 330/665] 10.222.0.18 () {56 vars in 1169 bytes} [Tue Oct 12 18:05:13 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:13.100393 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 336/666] 10.222.0.18 () {56 vars in 1145 bytes} [Tue Oct 12 18:05:13 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:05:13.106149 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6574fc60-e9d5-406a-99d6-8e4293b53a61 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:13.111374 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6418ea-7d49-4bdf-9413-848304de2260 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:13.133479 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6574fc60-e9d5-406a-99d6-8e4293b53a61 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:13.140175 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6418ea-7d49-4bdf-9413-848304de2260 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:13.146787 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa9380e-95ac-48dc-b793-2ca12ef70c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:13.147580 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa9380e-95ac-48dc-b793-2ca12ef70c4e admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:13.150605 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa9380e-95ac-48dc-b793-2ca12ef70c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:13.150891 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa9380e-95ac-48dc-b793-2ca12ef70c4e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:13.154517 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa9380e-95ac-48dc-b793-2ca12ef70c4e admin admin] RBAC: Adding query filter params (role.id=6c54f239944d46e3b027ccce97eb8b49, scope.project.id=e843aaa9e5e44a8e98f7cc7412d9697b, user.id=7f527f925af24eba8cabffe457fceb09) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:13.154840 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa9380e-95ac-48dc-b793-2ca12ef70c4e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:13.155892 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4672bf2-028e-4a3c-92e6-fe4597130636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:13.157824 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4672bf2-028e-4a3c-92e6-fe4597130636 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:13.158097 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4672bf2-028e-4a3c-92e6-fe4597130636 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:13.158364 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4672bf2-028e-4a3c-92e6-fe4597130636 admin admin] PATH_INFO: `/v3/services` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:13.159500 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4672bf2-028e-4a3c-92e6-fe4597130636 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:13.159801 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4672bf2-028e-4a3c-92e6-fe4597130636 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:13.161959 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa9380e-95ac-48dc-b793-2ca12ef70c4e admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:13.165278 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4672bf2-028e-4a3c-92e6-fe4597130636 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:13.175733 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 337/667] 10.222.0.18 () {56 vars in 1145 bytes} [Tue Oct 12 18:05:13 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:13.183796 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 331/668] 10.222.0.18 () {56 vars in 1395 bytes} [Tue Oct 12 18:05:13 2021] GET /identity/v3/role_assignments?user.id=7f527f925af24eba8cabffe457fceb09&scope.project.id=e843aaa9e5e44a8e98f7cc7412d9697b&role.id=6c54f239944d46e3b027ccce97eb8b49 => generated 259 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:13.186067 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4672bf2-028e-4a3c-92e6-fe4597130636 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:13.200095 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4672bf2-028e-4a3c-92e6-fe4597130636 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:13.208568 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d478e769-9b82-4a3a-ab98-3c0acd55f746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:13.209300 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478e769-9b82-4a3a-ab98-3c0acd55f746 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:13.209575 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478e769-9b82-4a3a-ab98-3c0acd55f746 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:13.212444 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478e769-9b82-4a3a-ab98-3c0acd55f746 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:13.212444 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d478e769-9b82-4a3a-ab98-3c0acd55f746 admin admin] RBAC: Adding query filter params (interface=public, service_id=9687808e497f452da321997f7bff544a, region_id=RegionOne) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:13.212444 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d478e769-9b82-4a3a-ab98-3c0acd55f746 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:13.212444 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING py.warnings [None req-d478e769-9b82-4a3a-ab98-3c0acd55f746 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:05:13.212444 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: warnings.warn(msg) Oct 12 18:05:13.212444 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: Oct 12 18:05:13.215145 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d478e769-9b82-4a3a-ab98-3c0acd55f746 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:13.233191 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 338/669] 10.222.0.18 () {56 vars in 1272 bytes} [Tue Oct 12 18:05:13 2021] GET /identity/v3/endpoints?service_id=9687808e497f452da321997f7bff544a&interface=public®ion_id=RegionOne => generated 194 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:13.240579 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa9380e-95ac-48dc-b793-2ca12ef70c4e admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:13.261853 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa9380e-95ac-48dc-b793-2ca12ef70c4e admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:13.270014 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5afb412-1e4a-45dc-af6d-c00fa3f31833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:13.271339 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5afb412-1e4a-45dc-af6d-c00fa3f31833 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:13.271660 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5afb412-1e4a-45dc-af6d-c00fa3f31833 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:13.271933 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5afb412-1e4a-45dc-af6d-c00fa3f31833 admin admin] PATH_INFO: `/v3/services` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:13.272908 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5afb412-1e4a-45dc-af6d-c00fa3f31833 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:13.275694 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5afb412-1e4a-45dc-af6d-c00fa3f31833 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:13.293135 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 332/670] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 12 18:05:13 2021] GET /identity/v3/services => generated 772 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:13.664265 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97100cc6-15fd-45e3-bc60-599ce8f8124a None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:13.664639 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97100cc6-15fd-45e3-bc60-599ce8f8124a None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:13.664837 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97100cc6-15fd-45e3-bc60-599ce8f8124a None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:13.666869 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 339/671] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:05:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:05:13.673089 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f01964-8767-44ce-a44d-be9c31f1891c None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:13.673393 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f01964-8767-44ce-a44d-be9c31f1891c None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:13.673636 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f01964-8767-44ce-a44d-be9c31f1891c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:13.694931 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-f0f01964-8767-44ce-a44d-be9c31f1891c None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:05:13.696188 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-f0f01964-8767-44ce-a44d-be9c31f1891c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:05:13.705388 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 333/672] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:05:13 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:05:13.729237 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97100cc6-15fd-45e3-bc60-599ce8f8124a None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:13.741648 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97100cc6-15fd-45e3-bc60-599ce8f8124a None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:13.746027 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0281da78-9155-464c-bcf8-0db71e48eda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:13.746803 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281da78-9155-464c-bcf8-0db71e48eda3 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:13.747083 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281da78-9155-464c-bcf8-0db71e48eda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:13.747352 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281da78-9155-464c-bcf8-0db71e48eda3 admin admin] PATH_INFO: `/v3/services/network` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:13.748006 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0281da78-9155-464c-bcf8-0db71e48eda3 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:13.749629 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0281da78-9155-464c-bcf8-0db71e48eda3 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:13.761794 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-0281da78-9155-464c-bcf8-0db71e48eda3 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 12 18:05:13.768508 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 340/673] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Oct 12 18:05:13 2021] GET /identity/v3/services/network => generated 88 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:13.770122 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f01964-8767-44ce-a44d-be9c31f1891c None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:13.779397 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f01964-8767-44ce-a44d-be9c31f1891c None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:13.785157 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa5c47e-2113-4d57-9a52-2b846d42edbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:13.785816 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5c47e-2113-4d57-9a52-2b846d42edbc admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:13.786595 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5c47e-2113-4d57-9a52-2b846d42edbc admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:13.786871 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5c47e-2113-4d57-9a52-2b846d42edbc admin admin] PATH_INFO: `/v3/services` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:13.787590 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa5c47e-2113-4d57-9a52-2b846d42edbc admin admin] RBAC: Adding query filter params (name=network) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:13.787890 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa5c47e-2113-4d57-9a52-2b846d42edbc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:13.789513 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa5c47e-2113-4d57-9a52-2b846d42edbc admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:13.800197 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 334/674] 10.222.0.18 () {56 vars in 1133 bytes} [Tue Oct 12 18:05:13 2021] GET /identity/v3/services?name=network => generated 124 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:13.801573 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0281da78-9155-464c-bcf8-0db71e48eda3 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:13.811325 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0281da78-9155-464c-bcf8-0db71e48eda3 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:13.815811 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1966099-d1ef-4981-9d6c-56a38b5ca8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:13.816477 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1966099-d1ef-4981-9d6c-56a38b5ca8b2 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:13.816757 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1966099-d1ef-4981-9d6c-56a38b5ca8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:13.817020 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1966099-d1ef-4981-9d6c-56a38b5ca8b2 admin admin] PATH_INFO: `/v3/services` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:13.818259 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1966099-d1ef-4981-9d6c-56a38b5ca8b2 admin admin] RBAC: Adding query filter params (type=network) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:13.818557 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1966099-d1ef-4981-9d6c-56a38b5ca8b2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:13.820164 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1966099-d1ef-4981-9d6c-56a38b5ca8b2 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:13.830619 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 341/675] 10.222.0.18 () {56 vars in 1133 bytes} [Tue Oct 12 18:05:13 2021] GET /identity/v3/services?type=network => generated 350 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:05:13.831962 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa5c47e-2113-4d57-9a52-2b846d42edbc admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:13.842153 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa5c47e-2113-4d57-9a52-2b846d42edbc admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:13.851968 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b488c19-fe3b-4b93-bdfc-06182d64d348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:13.852660 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b488c19-fe3b-4b93-bdfc-06182d64d348 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:13.852930 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b488c19-fe3b-4b93-bdfc-06182d64d348 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:13.853170 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b488c19-fe3b-4b93-bdfc-06182d64d348 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:13.854183 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b488c19-fe3b-4b93-bdfc-06182d64d348 admin admin] RBAC: Adding query filter params (interface=public, service_id=e419f660cd9c43c781764b245c2b0eb9, region_id=RegionOne) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:13.854728 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b488c19-fe3b-4b93-bdfc-06182d64d348 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:13.855738 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING py.warnings [None req-5b488c19-fe3b-4b93-bdfc-06182d64d348 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:05:13.855738 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: warnings.warn(msg) Oct 12 18:05:13.855738 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: Oct 12 18:05:13.856640 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b488c19-fe3b-4b93-bdfc-06182d64d348 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:13.870764 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 335/676] 10.222.0.18 () {56 vars in 1272 bytes} [Tue Oct 12 18:05:13 2021] GET /identity/v3/endpoints?service_id=e419f660cd9c43c781764b245c2b0eb9&interface=public®ion_id=RegionOne => generated 194 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:13.876921 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1966099-d1ef-4981-9d6c-56a38b5ca8b2 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:13.888525 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1966099-d1ef-4981-9d6c-56a38b5ca8b2 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:13.893511 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08dd270-9f6e-4ae5-8afc-861179f8ea4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:13.894225 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08dd270-9f6e-4ae5-8afc-861179f8ea4c admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:13.894503 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08dd270-9f6e-4ae5-8afc-861179f8ea4c admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:13.894818 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08dd270-9f6e-4ae5-8afc-861179f8ea4c admin admin] PATH_INFO: `/v3/services` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:13.895552 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08dd270-9f6e-4ae5-8afc-861179f8ea4c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:13.898018 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08dd270-9f6e-4ae5-8afc-861179f8ea4c admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:13.908989 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 342/677] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 12 18:05:13 2021] GET /identity/v3/services => generated 772 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:14.081246 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c3807b-aa66-449a-b867-626189058c30 None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:14.081636 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c3807b-aa66-449a-b867-626189058c30 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:14.081805 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c3807b-aa66-449a-b867-626189058c30 None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:14.084455 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 336/678] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:05:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:05:14.092653 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c858166c-4263-4596-a334-31a651cdf279 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:14.093063 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c858166c-4263-4596-a334-31a651cdf279 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:14.093347 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c858166c-4263-4596-a334-31a651cdf279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:14.122155 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-c858166c-4263-4596-a334-31a651cdf279 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:05:14.123299 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-c858166c-4263-4596-a334-31a651cdf279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:05:14.135310 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 343/679] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:05:14 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:05:14.164023 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c3807b-aa66-449a-b867-626189058c30 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:14.177734 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c3807b-aa66-449a-b867-626189058c30 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:14.184254 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0aa9b6-16f8-4637-96b1-45cffd25ccce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:14.185145 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0aa9b6-16f8-4637-96b1-45cffd25ccce admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:14.185431 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0aa9b6-16f8-4637-96b1-45cffd25ccce admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:14.185704 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0aa9b6-16f8-4637-96b1-45cffd25ccce admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:14.201350 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0aa9b6-16f8-4637-96b1-45cffd25ccce admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 18:05:14.210398 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-3d0aa9b6-16f8-4637-96b1-45cffd25ccce admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 18:05:14.212015 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 337/680] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Oct 12 18:05:14 2021] GET /identity/v3/roles/admin => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:14.221938 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c858166c-4263-4596-a334-31a651cdf279 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:14.231096 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c858166c-4263-4596-a334-31a651cdf279 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:14.235779 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a21865-0ca9-4ade-97ea-b26fd2d2d135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:14.236583 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a21865-0ca9-4ade-97ea-b26fd2d2d135 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:14.236910 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a21865-0ca9-4ade-97ea-b26fd2d2d135 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:14.237255 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a21865-0ca9-4ade-97ea-b26fd2d2d135 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:14.238570 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a21865-0ca9-4ade-97ea-b26fd2d2d135 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:14.239012 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a21865-0ca9-4ade-97ea-b26fd2d2d135 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:14.241265 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a21865-0ca9-4ade-97ea-b26fd2d2d135 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:14.254345 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 344/681] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Oct 12 18:05:14 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:14.260762 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0aa9b6-16f8-4637-96b1-45cffd25ccce admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:14.275877 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0aa9b6-16f8-4637-96b1-45cffd25ccce admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:14.280580 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b3cf80-2b51-4d93-8166-ce479ca31a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:14.281439 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b3cf80-2b51-4d93-8166-ce479ca31a55 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:14.281703 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b3cf80-2b51-4d93-8166-ce479ca31a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:14.281959 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b3cf80-2b51-4d93-8166-ce479ca31a55 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:14.294182 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b3cf80-2b51-4d93-8166-ce479ca31a55 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:14.296710 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b3cf80-2b51-4d93-8166-ce479ca31a55 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:14.319880 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-f3b3cf80-2b51-4d93-8166-ce479ca31a55 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 18:05:14.321449 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 338/682] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:05:14 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:14.328721 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a21865-0ca9-4ade-97ea-b26fd2d2d135 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:14.342420 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a21865-0ca9-4ade-97ea-b26fd2d2d135 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:14.347176 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6111ff-6b79-4cd4-8594-afb55af6762e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:14.347884 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6111ff-6b79-4cd4-8594-afb55af6762e admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:14.348168 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6111ff-6b79-4cd4-8594-afb55af6762e admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:14.348497 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6111ff-6b79-4cd4-8594-afb55af6762e admin admin] PATH_INFO: `/v3/domains` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:14.349820 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6111ff-6b79-4cd4-8594-afb55af6762e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:14.350129 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6111ff-6b79-4cd4-8594-afb55af6762e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:14.351800 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6111ff-6b79-4cd4-8594-afb55af6762e admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:14.369203 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 345/683] 10.222.0.18 () {56 vars in 1130 bytes} [Tue Oct 12 18:05:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:14.375392 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b3cf80-2b51-4d93-8166-ce479ca31a55 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:14.386721 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b3cf80-2b51-4d93-8166-ce479ca31a55 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:14.395098 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef3ee23-0b81-4044-82e8-50dff2e04f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:14.395993 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef3ee23-0b81-4044-82e8-50dff2e04f9e admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:14.396329 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef3ee23-0b81-4044-82e8-50dff2e04f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:14.396699 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef3ee23-0b81-4044-82e8-50dff2e04f9e admin admin] PATH_INFO: `/v3/users/nova` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:14.404742 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef3ee23-0b81-4044-82e8-50dff2e04f9e admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:14.406883 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef3ee23-0b81-4044-82e8-50dff2e04f9e admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:14.427433 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-1ef3ee23-0b81-4044-82e8-50dff2e04f9e admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 12 18:05:14.429033 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 339/684] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Oct 12 18:05:14 2021] GET /identity/v3/users/nova => generated 82 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:14.435311 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6111ff-6b79-4cd4-8594-afb55af6762e admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:14.449797 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6111ff-6b79-4cd4-8594-afb55af6762e admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:14.454626 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00c4ad1-10c5-4658-881d-fe918d32b388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:14.455295 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c4ad1-10c5-4658-881d-fe918d32b388 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:14.455628 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c4ad1-10c5-4658-881d-fe918d32b388 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:14.455910 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c4ad1-10c5-4658-881d-fe918d32b388 admin admin] PATH_INFO: `/v3/users` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:14.456846 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00c4ad1-10c5-4658-881d-fe918d32b388 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:14.457160 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00c4ad1-10c5-4658-881d-fe918d32b388 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:14.459241 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00c4ad1-10c5-4658-881d-fe918d32b388 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:14.483106 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 346/685] 10.222.0.18 () {56 vars in 1154 bytes} [Tue Oct 12 18:05:14 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:14.489305 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef3ee23-0b81-4044-82e8-50dff2e04f9e admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:14.505549 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef3ee23-0b81-4044-82e8-50dff2e04f9e admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:14.510274 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc82424-23c1-4a7e-bef3-edbd4b31b7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:14.510923 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc82424-23c1-4a7e-bef3-edbd4b31b7e7 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:14.511202 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc82424-23c1-4a7e-bef3-edbd4b31b7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:14.511472 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc82424-23c1-4a7e-bef3-edbd4b31b7e7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:14.520482 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc82424-23c1-4a7e-bef3-edbd4b31b7e7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:14.523311 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc82424-23c1-4a7e-bef3-edbd4b31b7e7 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:14.537036 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 340/686] 10.222.0.18 () {58 vars in 1324 bytes} [Tue Oct 12 18:05:14 2021] GET /identity/v3/auth/tokens => generated 1270 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:05:14.543276 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00c4ad1-10c5-4658-881d-fe918d32b388 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:14.555960 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00c4ad1-10c5-4658-881d-fe918d32b388 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:14.561415 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c8fcb4-9de8-46d3-8d61-1bf4f5717ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:14.562220 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c8fcb4-9de8-46d3-8d61-1bf4f5717ab5 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:14.562502 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c8fcb4-9de8-46d3-8d61-1bf4f5717ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:14.562780 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c8fcb4-9de8-46d3-8d61-1bf4f5717ab5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:14.574139 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c8fcb4-9de8-46d3-8d61-1bf4f5717ab5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:14.575998 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c8fcb4-9de8-46d3-8d61-1bf4f5717ab5 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:14.594857 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-58c8fcb4-9de8-46d3-8d61-1bf4f5717ab5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 18:05:14.596473 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 347/687] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:05:14 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:14.602852 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc82424-23c1-4a7e-bef3-edbd4b31b7e7 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:14.619797 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc82424-23c1-4a7e-bef3-edbd4b31b7e7 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:14.631133 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d676ef7-4a3f-4723-99ef-3a71008118c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:14.631745 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d676ef7-4a3f-4723-99ef-3a71008118c0 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:14.632025 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d676ef7-4a3f-4723-99ef-3a71008118c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:14.632297 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d676ef7-4a3f-4723-99ef-3a71008118c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:14.633073 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d676ef7-4a3f-4723-99ef-3a71008118c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:14.633378 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d676ef7-4a3f-4723-99ef-3a71008118c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:14.634976 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d676ef7-4a3f-4723-99ef-3a71008118c0 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:14.649134 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 341/688] 10.222.0.18 () {56 vars in 1130 bytes} [Tue Oct 12 18:05:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:14.655229 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c8fcb4-9de8-46d3-8d61-1bf4f5717ab5 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:14.665242 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c8fcb4-9de8-46d3-8d61-1bf4f5717ab5 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:14.669827 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1cb2ba-8a7d-4c1b-9dae-bceae458df19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:14.670712 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1cb2ba-8a7d-4c1b-9dae-bceae458df19 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:14.671114 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1cb2ba-8a7d-4c1b-9dae-bceae458df19 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:14.671595 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1cb2ba-8a7d-4c1b-9dae-bceae458df19 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:14.680597 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1cb2ba-8a7d-4c1b-9dae-bceae458df19 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:14.682595 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1cb2ba-8a7d-4c1b-9dae-bceae458df19 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:14.699965 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-0c1cb2ba-8a7d-4c1b-9dae-bceae458df19 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 18:05:14.701193 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 348/689] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Oct 12 18:05:14 2021] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:14.709127 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d676ef7-4a3f-4723-99ef-3a71008118c0 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:14.721351 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d676ef7-4a3f-4723-99ef-3a71008118c0 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:14.731158 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2fe180-746f-4af6-b851-d5b884ec6d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:14.731837 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2fe180-746f-4af6-b851-d5b884ec6d93 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:14.732114 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2fe180-746f-4af6-b851-d5b884ec6d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:14.732393 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2fe180-746f-4af6-b851-d5b884ec6d93 admin admin] PATH_INFO: `/v3/projects` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:14.733347 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2fe180-746f-4af6-b851-d5b884ec6d93 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:14.733684 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2fe180-746f-4af6-b851-d5b884ec6d93 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:14.736583 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2fe180-746f-4af6-b851-d5b884ec6d93 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:14.753356 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 342/690] 10.222.0.18 () {56 vars in 1169 bytes} [Tue Oct 12 18:05:14 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:14.759895 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1cb2ba-8a7d-4c1b-9dae-bceae458df19 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:14.772426 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1cb2ba-8a7d-4c1b-9dae-bceae458df19 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:14.777059 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a3b987-89de-4c41-aecc-cbfaff3da51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:14.777718 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a3b987-89de-4c41-aecc-cbfaff3da51f admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:14.778000 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a3b987-89de-4c41-aecc-cbfaff3da51f admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:14.778278 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a3b987-89de-4c41-aecc-cbfaff3da51f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:14.779129 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a3b987-89de-4c41-aecc-cbfaff3da51f admin admin] RBAC: Adding query filter params (role.id=6c54f239944d46e3b027ccce97eb8b49, scope.project.id=e843aaa9e5e44a8e98f7cc7412d9697b, user.id=3417097a280b499086b36df9a2548239) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:14.779441 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a3b987-89de-4c41-aecc-cbfaff3da51f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:14.781329 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a3b987-89de-4c41-aecc-cbfaff3da51f admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:14.787906 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 349/691] 10.222.0.18 () {56 vars in 1395 bytes} [Tue Oct 12 18:05:14 2021] GET /identity/v3/role_assignments?user.id=3417097a280b499086b36df9a2548239&scope.project.id=e843aaa9e5e44a8e98f7cc7412d9697b&role.id=6c54f239944d46e3b027ccce97eb8b49 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:14.980630 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe1731-ca1c-40d4-9091-587f99da4f31 None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:14.981319 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe1731-ca1c-40d4-9091-587f99da4f31 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:14.981319 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe1731-ca1c-40d4-9091-587f99da4f31 None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:14.984505 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 343/692] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:05:14 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 18:05:14.992022 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f080e-ab62-4aa9-b024-3ae29036253a None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:14.992335 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f080e-ab62-4aa9-b024-3ae29036253a None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:14.992604 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f080e-ab62-4aa9-b024-3ae29036253a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:15.011514 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-268f080e-ab62-4aa9-b024-3ae29036253a None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:05:15.012764 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-268f080e-ab62-4aa9-b024-3ae29036253a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:05:15.021565 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 350/693] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:05:14 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:05:15.045656 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfe1731-ca1c-40d4-9091-587f99da4f31 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:15.058326 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfe1731-ca1c-40d4-9091-587f99da4f31 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:15.062830 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7d60f1-ce51-4751-8733-47d8a22fd5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:15.063613 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d60f1-ce51-4751-8733-47d8a22fd5a8 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:15.063887 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d60f1-ce51-4751-8733-47d8a22fd5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:15.064157 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d60f1-ce51-4751-8733-47d8a22fd5a8 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:15.075452 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7d60f1-ce51-4751-8733-47d8a22fd5a8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 18:05:15.082636 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-ee7d60f1-ce51-4751-8733-47d8a22fd5a8 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 18:05:15.084738 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 344/694] 10.222.0.18 () {56 vars in 1123 bytes} [Tue Oct 12 18:05:15 2021] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:15.093215 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268f080e-ab62-4aa9-b024-3ae29036253a None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:15.102656 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268f080e-ab62-4aa9-b024-3ae29036253a None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:15.107428 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42047143-9feb-408f-b594-cd67b3a0d7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:15.108087 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42047143-9feb-408f-b594-cd67b3a0d7e3 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:15.108369 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42047143-9feb-408f-b594-cd67b3a0d7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:15.108672 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42047143-9feb-408f-b594-cd67b3a0d7e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:15.109433 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42047143-9feb-408f-b594-cd67b3a0d7e3 admin admin] RBAC: Adding query filter params (name=service) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:15.109766 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42047143-9feb-408f-b594-cd67b3a0d7e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:15.111340 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42047143-9feb-408f-b594-cd67b3a0d7e3 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:15.120597 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 351/695] 10.222.0.18 () {56 vars in 1124 bytes} [Tue Oct 12 18:05:15 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:15.126857 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7d60f1-ce51-4751-8733-47d8a22fd5a8 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:15.138072 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7d60f1-ce51-4751-8733-47d8a22fd5a8 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:15.142861 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28189a0-12a0-4b62-8ad2-fa5dffd0bdd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:15.143652 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28189a0-12a0-4b62-8ad2-fa5dffd0bdd2 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:15.143930 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28189a0-12a0-4b62-8ad2-fa5dffd0bdd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:15.144203 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28189a0-12a0-4b62-8ad2-fa5dffd0bdd2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:15.157381 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28189a0-12a0-4b62-8ad2-fa5dffd0bdd2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:15.159238 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28189a0-12a0-4b62-8ad2-fa5dffd0bdd2 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:15.177094 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-a28189a0-12a0-4b62-8ad2-fa5dffd0bdd2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 18:05:15.178601 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 345/696] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:05:15 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:15.184769 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42047143-9feb-408f-b594-cd67b3a0d7e3 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:15.195813 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42047143-9feb-408f-b594-cd67b3a0d7e3 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:15.200346 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf94194-df43-48d8-8418-5644543f402b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:15.201029 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf94194-df43-48d8-8418-5644543f402b admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:15.201307 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf94194-df43-48d8-8418-5644543f402b admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:15.201581 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf94194-df43-48d8-8418-5644543f402b admin admin] PATH_INFO: `/v3/domains` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:15.202314 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf94194-df43-48d8-8418-5644543f402b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:15.202615 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf94194-df43-48d8-8418-5644543f402b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:15.204206 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf94194-df43-48d8-8418-5644543f402b admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:15.218793 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 352/697] 10.222.0.18 () {56 vars in 1130 bytes} [Tue Oct 12 18:05:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:15.225370 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28189a0-12a0-4b62-8ad2-fa5dffd0bdd2 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:15.235460 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28189a0-12a0-4b62-8ad2-fa5dffd0bdd2 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:15.241379 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb95c909-9d2e-45d0-9ba2-c4a57a13aa0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:15.242278 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb95c909-9d2e-45d0-9ba2-c4a57a13aa0e admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:15.242553 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb95c909-9d2e-45d0-9ba2-c4a57a13aa0e admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:15.242823 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb95c909-9d2e-45d0-9ba2-c4a57a13aa0e admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:15.252691 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb95c909-9d2e-45d0-9ba2-c4a57a13aa0e admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:15.255860 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb95c909-9d2e-45d0-9ba2-c4a57a13aa0e admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:15.272348 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-eb95c909-9d2e-45d0-9ba2-c4a57a13aa0e admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 12 18:05:15.274021 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 346/698] 10.222.0.18 () {56 vars in 1138 bytes} [Tue Oct 12 18:05:15 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:15.280480 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf94194-df43-48d8-8418-5644543f402b admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:15.291129 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf94194-df43-48d8-8418-5644543f402b admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:15.295726 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0878225-cdcd-403b-be16-c9031dce710d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:15.296386 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0878225-cdcd-403b-be16-c9031dce710d admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:15.296694 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0878225-cdcd-403b-be16-c9031dce710d admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:15.296969 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0878225-cdcd-403b-be16-c9031dce710d admin admin] PATH_INFO: `/v3/users` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:15.297810 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0878225-cdcd-403b-be16-c9031dce710d admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:15.298116 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0878225-cdcd-403b-be16-c9031dce710d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:15.299979 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0878225-cdcd-403b-be16-c9031dce710d admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:15.321812 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 353/699] 10.222.0.18 () {56 vars in 1170 bytes} [Tue Oct 12 18:05:15 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:15.327786 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb95c909-9d2e-45d0-9ba2-c4a57a13aa0e admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:15.337985 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb95c909-9d2e-45d0-9ba2-c4a57a13aa0e admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:15.342407 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4d2609-1cce-47aa-b282-e443e24a9590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:15.343195 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d2609-1cce-47aa-b282-e443e24a9590 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:15.343469 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d2609-1cce-47aa-b282-e443e24a9590 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:15.343740 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d2609-1cce-47aa-b282-e443e24a9590 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:15.356065 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4d2609-1cce-47aa-b282-e443e24a9590 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:15.357934 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4d2609-1cce-47aa-b282-e443e24a9590 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:15.375190 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-ef4d2609-1cce-47aa-b282-e443e24a9590 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 18:05:15.376738 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 347/700] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:05:15 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:15.383347 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0878225-cdcd-403b-be16-c9031dce710d admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:15.393612 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0878225-cdcd-403b-be16-c9031dce710d admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:15.398345 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e30a88-2df0-4a94-a98c-e2309cf373d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:15.399047 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e30a88-2df0-4a94-a98c-e2309cf373d0 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:15.399326 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e30a88-2df0-4a94-a98c-e2309cf373d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:15.399596 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e30a88-2df0-4a94-a98c-e2309cf373d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:15.400431 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e30a88-2df0-4a94-a98c-e2309cf373d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:15.401006 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e30a88-2df0-4a94-a98c-e2309cf373d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:15.403750 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e30a88-2df0-4a94-a98c-e2309cf373d0 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:15.416789 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 354/701] 10.222.0.18 () {56 vars in 1130 bytes} [Tue Oct 12 18:05:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:15.422833 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4d2609-1cce-47aa-b282-e443e24a9590 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:15.433470 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4d2609-1cce-47aa-b282-e443e24a9590 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:15.438103 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb03c682-74c7-4293-8c33-4cd75700f87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:15.438939 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb03c682-74c7-4293-8c33-4cd75700f87f admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:15.439215 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb03c682-74c7-4293-8c33-4cd75700f87f admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:15.439535 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb03c682-74c7-4293-8c33-4cd75700f87f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:15.447772 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb03c682-74c7-4293-8c33-4cd75700f87f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:15.449897 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb03c682-74c7-4293-8c33-4cd75700f87f admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:15.466022 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-eb03c682-74c7-4293-8c33-4cd75700f87f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 18:05:15.467619 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 348/702] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Oct 12 18:05:15 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:15.474073 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e30a88-2df0-4a94-a98c-e2309cf373d0 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:15.484200 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e30a88-2df0-4a94-a98c-e2309cf373d0 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:15.488930 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717584b1-aec3-43c7-86d8-f6a11579a232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:15.490145 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717584b1-aec3-43c7-86d8-f6a11579a232 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:15.490464 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717584b1-aec3-43c7-86d8-f6a11579a232 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:15.490738 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717584b1-aec3-43c7-86d8-f6a11579a232 admin admin] PATH_INFO: `/v3/projects` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:15.491568 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717584b1-aec3-43c7-86d8-f6a11579a232 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:15.491878 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717584b1-aec3-43c7-86d8-f6a11579a232 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:15.494048 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717584b1-aec3-43c7-86d8-f6a11579a232 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:15.507953 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 355/703] 10.222.0.18 () {56 vars in 1169 bytes} [Tue Oct 12 18:05:15 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:15.514399 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb03c682-74c7-4293-8c33-4cd75700f87f admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:15.525508 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb03c682-74c7-4293-8c33-4cd75700f87f admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:15.531503 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4006d051-dcdf-444e-94dd-94e0bf7095c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:15.533230 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4006d051-dcdf-444e-94dd-94e0bf7095c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:15.533230 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4006d051-dcdf-444e-94dd-94e0bf7095c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:15.533230 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4006d051-dcdf-444e-94dd-94e0bf7095c1 admin admin] PATH_INFO: `/v3/projects/e843aaa9e5e44a8e98f7cc7412d9697b/users/8f6a3a7064754fb79a0a06b3ad4a7d05/roles/24b43b2260b1455e832abdff63df40bd` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:15.548610 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4006d051-dcdf-444e-94dd-94e0bf7095c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e843aaa9e5e44a8e98f7cc7412d9697b, user_id=8f6a3a7064754fb79a0a06b3ad4a7d05, role_id=24b43b2260b1455e832abdff63df40bd)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:15.551342 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4006d051-dcdf-444e-94dd-94e0bf7095c1 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:15.649159 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 349/704] 10.222.0.18 () {58 vars in 1460 bytes} [Tue Oct 12 18:05:15 2021] PUT /identity/v3/projects/e843aaa9e5e44a8e98f7cc7412d9697b/users/8f6a3a7064754fb79a0a06b3ad4a7d05/roles/24b43b2260b1455e832abdff63df40bd => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:05:16.186051 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c7ad8-6741-43b6-ae84-1d93135218f0 None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:16.186847 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c7ad8-6741-43b6-ae84-1d93135218f0 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:16.186847 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c7ad8-6741-43b6-ae84-1d93135218f0 None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:16.190025 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 356/705] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:05:16 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:05:16.202931 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46311049-e553-40dc-b9e8-3279310dd493 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:16.203532 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46311049-e553-40dc-b9e8-3279310dd493 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:16.203807 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46311049-e553-40dc-b9e8-3279310dd493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:16.223324 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-46311049-e553-40dc-b9e8-3279310dd493 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:05:16.229021 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-46311049-e553-40dc-b9e8-3279310dd493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:05:16.309611 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 350/706] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:05:16 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:05:16.345905 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991c7ad8-6741-43b6-ae84-1d93135218f0 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:16.365128 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991c7ad8-6741-43b6-ae84-1d93135218f0 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:16.369865 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7459151c-0aec-4197-b36b-67ca7f794432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:16.370660 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459151c-0aec-4197-b36b-67ca7f794432 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:16.370944 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459151c-0aec-4197-b36b-67ca7f794432 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:16.371223 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459151c-0aec-4197-b36b-67ca7f794432 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:16.385718 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7459151c-0aec-4197-b36b-67ca7f794432 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 18:05:16.393067 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-7459151c-0aec-4197-b36b-67ca7f794432 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 18:05:16.394301 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 357/707] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Oct 12 18:05:16 2021] GET /identity/v3/roles/admin => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:16.401351 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46311049-e553-40dc-b9e8-3279310dd493 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:16.410581 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46311049-e553-40dc-b9e8-3279310dd493 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:16.420780 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39718b88-a10d-4724-a6f7-aa38717b1ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:16.421462 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39718b88-a10d-4724-a6f7-aa38717b1ba0 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:16.421742 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39718b88-a10d-4724-a6f7-aa38717b1ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:16.422021 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39718b88-a10d-4724-a6f7-aa38717b1ba0 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:16.422907 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39718b88-a10d-4724-a6f7-aa38717b1ba0 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:16.423222 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39718b88-a10d-4724-a6f7-aa38717b1ba0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:16.424864 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39718b88-a10d-4724-a6f7-aa38717b1ba0 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:16.435171 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 351/708] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Oct 12 18:05:16 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:16.441166 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7459151c-0aec-4197-b36b-67ca7f794432 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:16.451526 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7459151c-0aec-4197-b36b-67ca7f794432 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:16.460125 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af48448b-a2df-40ee-acc7-85c9a236c421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:16.460978 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af48448b-a2df-40ee-acc7-85c9a236c421 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:16.461314 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af48448b-a2df-40ee-acc7-85c9a236c421 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:16.461588 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af48448b-a2df-40ee-acc7-85c9a236c421 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:16.478428 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af48448b-a2df-40ee-acc7-85c9a236c421 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:16.480344 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af48448b-a2df-40ee-acc7-85c9a236c421 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:16.505876 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-af48448b-a2df-40ee-acc7-85c9a236c421 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 18:05:16.507137 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 358/709] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:05:16 2021] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:16.513410 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39718b88-a10d-4724-a6f7-aa38717b1ba0 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:16.524312 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39718b88-a10d-4724-a6f7-aa38717b1ba0 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:16.532754 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21698def-6842-4941-9731-54accaa3ba99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:16.533477 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21698def-6842-4941-9731-54accaa3ba99 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:16.533761 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21698def-6842-4941-9731-54accaa3ba99 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:16.534036 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21698def-6842-4941-9731-54accaa3ba99 admin admin] PATH_INFO: `/v3/domains` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:16.534832 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21698def-6842-4941-9731-54accaa3ba99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:16.535139 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21698def-6842-4941-9731-54accaa3ba99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:16.537474 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21698def-6842-4941-9731-54accaa3ba99 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:16.559808 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 352/710] 10.222.0.18 () {56 vars in 1130 bytes} [Tue Oct 12 18:05:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:16.566957 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af48448b-a2df-40ee-acc7-85c9a236c421 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:16.580906 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af48448b-a2df-40ee-acc7-85c9a236c421 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:16.591589 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1240693c-36a6-4fae-8678-de467640b78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:16.592459 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240693c-36a6-4fae-8678-de467640b78e admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:16.592759 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240693c-36a6-4fae-8678-de467640b78e admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:16.593065 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240693c-36a6-4fae-8678-de467640b78e admin admin] PATH_INFO: `/v3/users/swift` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:16.603577 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1240693c-36a6-4fae-8678-de467640b78e admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:16.605814 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1240693c-36a6-4fae-8678-de467640b78e admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:16.633897 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-1240693c-36a6-4fae-8678-de467640b78e admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 12 18:05:16.635239 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 359/711] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Oct 12 18:05:16 2021] GET /identity/v3/users/swift => generated 83 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:16.642009 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21698def-6842-4941-9731-54accaa3ba99 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:16.670992 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21698def-6842-4941-9731-54accaa3ba99 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:16.679419 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514f3d4a-4845-475e-b284-38aef5cdacb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:16.683191 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514f3d4a-4845-475e-b284-38aef5cdacb0 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:16.683683 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514f3d4a-4845-475e-b284-38aef5cdacb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:16.684072 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514f3d4a-4845-475e-b284-38aef5cdacb0 admin admin] PATH_INFO: `/v3/users` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:16.685560 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514f3d4a-4845-475e-b284-38aef5cdacb0 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:16.685872 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514f3d4a-4845-475e-b284-38aef5cdacb0 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:16.689067 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514f3d4a-4845-475e-b284-38aef5cdacb0 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:16.724755 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 353/712] 10.222.0.18 () {56 vars in 1156 bytes} [Tue Oct 12 18:05:16 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:16.734097 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1240693c-36a6-4fae-8678-de467640b78e admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:16.752569 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1240693c-36a6-4fae-8678-de467640b78e admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:16.757997 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f39e1a2-fe96-4c49-a654-7bb83f49b3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:16.758842 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f39e1a2-fe96-4c49-a654-7bb83f49b3be admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:16.759182 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f39e1a2-fe96-4c49-a654-7bb83f49b3be admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:16.759455 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f39e1a2-fe96-4c49-a654-7bb83f49b3be admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:16.773178 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f39e1a2-fe96-4c49-a654-7bb83f49b3be admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:16.780546 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f39e1a2-fe96-4c49-a654-7bb83f49b3be admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:16.787835 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ab4e3-1826-4737-81e3-ec9b9ebd6b25 None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:16.788115 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ab4e3-1826-4737-81e3-ec9b9ebd6b25 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:16.788385 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ab4e3-1826-4737-81e3-ec9b9ebd6b25 None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:16.790393 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 354/713] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:05:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:05:16.797650 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dfeefa-9f10-45d8-8af4-c35e781264a4 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:16.797991 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dfeefa-9f10-45d8-8af4-c35e781264a4 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:16.798206 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dfeefa-9f10-45d8-8af4-c35e781264a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:16.798730 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-4f39e1a2-fe96-4c49-a654-7bb83f49b3be admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 18:05:16.800279 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 360/714] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:05:16 2021] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:16.805997 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f39e1a2-fe96-4c49-a654-7bb83f49b3be admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:16.816789 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f39e1a2-fe96-4c49-a654-7bb83f49b3be admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:16.825329 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3464e10d-21b7-413f-84fb-8d22d1f1262a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:16.827229 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464e10d-21b7-413f-84fb-8d22d1f1262a admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:16.827517 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464e10d-21b7-413f-84fb-8d22d1f1262a admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:16.827788 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464e10d-21b7-413f-84fb-8d22d1f1262a admin admin] PATH_INFO: `/v3/domains` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:16.829896 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3464e10d-21b7-413f-84fb-8d22d1f1262a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:16.830937 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-90dfeefa-9f10-45d8-8af4-c35e781264a4 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:05:16.831949 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3464e10d-21b7-413f-84fb-8d22d1f1262a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:16.834088 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-90dfeefa-9f10-45d8-8af4-c35e781264a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:05:16.835708 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3464e10d-21b7-413f-84fb-8d22d1f1262a admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:16.853224 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 355/715] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:05:16 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:05:16.857056 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 361/716] 10.222.0.18 () {56 vars in 1130 bytes} [Tue Oct 12 18:05:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:05:16.863298 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dfeefa-9f10-45d8-8af4-c35e781264a4 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:16.875787 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dfeefa-9f10-45d8-8af4-c35e781264a4 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:16.889041 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ad855c-256a-43ed-8487-396b1b73bad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:16.890172 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad855c-256a-43ed-8487-396b1b73bad4 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:16.890689 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad855c-256a-43ed-8487-396b1b73bad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:16.891436 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad855c-256a-43ed-8487-396b1b73bad4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:16.895445 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3464e10d-21b7-413f-84fb-8d22d1f1262a admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:16.905554 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ad855c-256a-43ed-8487-396b1b73bad4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:16.906646 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3464e10d-21b7-413f-84fb-8d22d1f1262a admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:16.908055 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ad855c-256a-43ed-8487-396b1b73bad4 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:16.911498 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e292e43f-b0f7-4d75-a5bd-8bb9c403a0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:16.912488 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e292e43f-b0f7-4d75-a5bd-8bb9c403a0d7 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:16.912776 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e292e43f-b0f7-4d75-a5bd-8bb9c403a0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:16.913100 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e292e43f-b0f7-4d75-a5bd-8bb9c403a0d7 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:16.913765 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e292e43f-b0f7-4d75-a5bd-8bb9c403a0d7 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:16.916046 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e292e43f-b0f7-4d75-a5bd-8bb9c403a0d7 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:16.928827 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-e292e43f-b0f7-4d75-a5bd-8bb9c403a0d7 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 12 18:05:16.932892 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-02ad855c-256a-43ed-8487-396b1b73bad4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 18:05:16.933919 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 362/717] 10.222.0.18 () {56 vars in 1150 bytes} [Tue Oct 12 18:05:16 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:16.934814 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 356/718] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Oct 12 18:05:16 2021] GET /identity/v3/projects/service => generated 88 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:16.941236 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e292e43f-b0f7-4d75-a5bd-8bb9c403a0d7 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:16.941588 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ad855c-256a-43ed-8487-396b1b73bad4 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:16.952753 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ad855c-256a-43ed-8487-396b1b73bad4 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:16.958254 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0898c108-3157-4dfd-a255-82903a7df868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:16.959376 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0898c108-3157-4dfd-a255-82903a7df868 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:16.959880 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0898c108-3157-4dfd-a255-82903a7df868 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:16.960368 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0898c108-3157-4dfd-a255-82903a7df868 admin admin] PATH_INFO: `/v3/services` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:16.961358 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0898c108-3157-4dfd-a255-82903a7df868 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:16.961872 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0898c108-3157-4dfd-a255-82903a7df868 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:16.963668 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0898c108-3157-4dfd-a255-82903a7df868 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:16.966879 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e292e43f-b0f7-4d75-a5bd-8bb9c403a0d7 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:16.970575 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 357/719] 10.222.0.18 () {56 vars in 1145 bytes} [Tue Oct 12 18:05:16 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:05:16.979600 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e39035-9746-491b-8188-9dc204ec9f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:16.980687 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e39035-9746-491b-8188-9dc204ec9f72 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:16.981183 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e39035-9746-491b-8188-9dc204ec9f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:16.981666 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e39035-9746-491b-8188-9dc204ec9f72 admin admin] PATH_INFO: `/v3/projects` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:16.982726 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e39035-9746-491b-8188-9dc204ec9f72 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:16.983274 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e39035-9746-491b-8188-9dc204ec9f72 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:16.985457 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e39035-9746-491b-8188-9dc204ec9f72 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:16.997988 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0898c108-3157-4dfd-a255-82903a7df868 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:17.009948 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 363/720] 10.222.0.18 () {56 vars in 1169 bytes} [Tue Oct 12 18:05:16 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:17.012628 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0898c108-3157-4dfd-a255-82903a7df868 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:17.017349 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e39035-9746-491b-8188-9dc204ec9f72 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:17.021280 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5173ce81-8a24-40ad-9059-fb0a066eed27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:17.022317 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5173ce81-8a24-40ad-9059-fb0a066eed27 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:17.023810 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5173ce81-8a24-40ad-9059-fb0a066eed27 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:17.024316 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5173ce81-8a24-40ad-9059-fb0a066eed27 admin admin] PATH_INFO: `/v3/services` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:17.027121 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5173ce81-8a24-40ad-9059-fb0a066eed27 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:17.027656 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5173ce81-8a24-40ad-9059-fb0a066eed27 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:17.029624 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5173ce81-8a24-40ad-9059-fb0a066eed27 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:17.040745 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 358/721] 10.222.0.18 () {56 vars in 1145 bytes} [Tue Oct 12 18:05:16 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:05:17.041239 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e39035-9746-491b-8188-9dc204ec9f72 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:17.046352 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf96e156-e0c1-4909-bb4b-cf5525efa6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:17.047510 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf96e156-e0c1-4909-bb4b-cf5525efa6d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:17.048098 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf96e156-e0c1-4909-bb4b-cf5525efa6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:17.048603 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf96e156-e0c1-4909-bb4b-cf5525efa6d9 admin admin] PATH_INFO: `/v3/projects/e843aaa9e5e44a8e98f7cc7412d9697b/users/7f527f925af24eba8cabffe457fceb09/roles/6c54f239944d46e3b027ccce97eb8b49` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:17.050002 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5173ce81-8a24-40ad-9059-fb0a066eed27 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:17.059694 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf96e156-e0c1-4909-bb4b-cf5525efa6d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e843aaa9e5e44a8e98f7cc7412d9697b, user_id=7f527f925af24eba8cabffe457fceb09, role_id=6c54f239944d46e3b027ccce97eb8b49)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:17.062863 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf96e156-e0c1-4909-bb4b-cf5525efa6d9 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:17.067107 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5173ce81-8a24-40ad-9059-fb0a066eed27 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:17.072220 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e2bf8-e9d9-4209-8cac-a76098569d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:17.073241 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e2bf8-e9d9-4209-8cac-a76098569d0f admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:17.073743 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e2bf8-e9d9-4209-8cac-a76098569d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:17.074273 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e2bf8-e9d9-4209-8cac-a76098569d0f admin admin] PATH_INFO: `/v3/endpoints` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:17.075273 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1e2bf8-e9d9-4209-8cac-a76098569d0f admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:17.076755 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING py.warnings [None req-cf1e2bf8-e9d9-4209-8cac-a76098569d0f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:05:17.076755 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: warnings.warn(msg) Oct 12 18:05:17.076755 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: Oct 12 18:05:17.085602 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1e2bf8-e9d9-4209-8cac-a76098569d0f admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:17.141688 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 364/722] 10.222.0.18 () {58 vars in 1460 bytes} [Tue Oct 12 18:05:17 2021] PUT /identity/v3/projects/e843aaa9e5e44a8e98f7cc7412d9697b/users/7f527f925af24eba8cabffe457fceb09/roles/6c54f239944d46e3b027ccce97eb8b49 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:05:17.146628 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5fed74-5016-454c-a914-363a8b5f3e9d None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:17.146942 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5fed74-5016-454c-a914-363a8b5f3e9d None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:17.147256 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5fed74-5016-454c-a914-363a8b5f3e9d None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:17.149492 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 365/723] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:05:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 18:05:17.156267 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5dbbfb-f527-424d-9ab7-862bd5120c89 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:17.156652 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5dbbfb-f527-424d-9ab7-862bd5120c89 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:17.156934 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5dbbfb-f527-424d-9ab7-862bd5120c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:17.170971 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 359/724] 10.222.0.18 () {60 vars in 1165 bytes} [Tue Oct 12 18:05:17 2021] POST /identity/v3/endpoints => generated 346 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 18:05:17.187621 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-4c5dbbfb-f527-424d-9ab7-862bd5120c89 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:05:17.188178 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-4c5dbbfb-f527-424d-9ab7-862bd5120c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:05:17.267133 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 366/725] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:05:17 2021] POST /identity/v3/auth/tokens => generated 1456 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:05:17.293143 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e2bf8-e9d9-4209-8cac-a76098569d0f admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:17.302968 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e2bf8-e9d9-4209-8cac-a76098569d0f admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:17.307661 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7157d7bd-518a-4b98-a2e0-361d0cd25b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:17.308565 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7157d7bd-518a-4b98-a2e0-361d0cd25b44 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:17.308849 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7157d7bd-518a-4b98-a2e0-361d0cd25b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:17.309179 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7157d7bd-518a-4b98-a2e0-361d0cd25b44 admin admin] PATH_INFO: `/v3/services/network` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:17.309908 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7157d7bd-518a-4b98-a2e0-361d0cd25b44 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:17.311531 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7157d7bd-518a-4b98-a2e0-361d0cd25b44 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:17.324170 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-7157d7bd-518a-4b98-a2e0-361d0cd25b44 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 12 18:05:17.326235 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 360/726] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Oct 12 18:05:17 2021] GET /identity/v3/services/network => generated 88 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:17.333020 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5dbbfb-f527-424d-9ab7-862bd5120c89 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:17.343445 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5dbbfb-f527-424d-9ab7-862bd5120c89 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:17.349083 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedfa1b5-4cd9-468e-89fb-c7bbcb7d74c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:17.349777 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedfa1b5-4cd9-468e-89fb-c7bbcb7d74c1 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:17.350060 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedfa1b5-4cd9-468e-89fb-c7bbcb7d74c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:17.350333 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedfa1b5-4cd9-468e-89fb-c7bbcb7d74c1 admin admin] PATH_INFO: `/v3/services` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:17.351097 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedfa1b5-4cd9-468e-89fb-c7bbcb7d74c1 admin admin] RBAC: Adding query filter params (name=network) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:17.351404 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedfa1b5-4cd9-468e-89fb-c7bbcb7d74c1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:17.353175 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedfa1b5-4cd9-468e-89fb-c7bbcb7d74c1 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:17.358954 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 367/727] 10.222.0.18 () {56 vars in 1133 bytes} [Tue Oct 12 18:05:17 2021] GET /identity/v3/services?name=network => generated 124 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:17.365569 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7157d7bd-518a-4b98-a2e0-361d0cd25b44 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:17.377708 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7157d7bd-518a-4b98-a2e0-361d0cd25b44 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:17.383328 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f899c66-a912-4fd2-af08-4322ea2fe6c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:17.384679 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f899c66-a912-4fd2-af08-4322ea2fe6c7 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:17.384679 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f899c66-a912-4fd2-af08-4322ea2fe6c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:17.384679 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f899c66-a912-4fd2-af08-4322ea2fe6c7 admin admin] PATH_INFO: `/v3/services` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:17.385158 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f899c66-a912-4fd2-af08-4322ea2fe6c7 admin admin] RBAC: Adding query filter params (type=network) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:17.387697 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f899c66-a912-4fd2-af08-4322ea2fe6c7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:17.387697 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f899c66-a912-4fd2-af08-4322ea2fe6c7 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:17.393959 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 361/728] 10.222.0.18 () {56 vars in 1133 bytes} [Tue Oct 12 18:05:17 2021] GET /identity/v3/services?type=network => generated 350 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:17.400472 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedfa1b5-4cd9-468e-89fb-c7bbcb7d74c1 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:17.411887 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedfa1b5-4cd9-468e-89fb-c7bbcb7d74c1 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:17.417266 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ebc8c7-de1a-4612-86f0-63292d5d90be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:17.417595 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ebc8c7-de1a-4612-86f0-63292d5d90be admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:17.417756 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ebc8c7-de1a-4612-86f0-63292d5d90be admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:17.417993 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ebc8c7-de1a-4612-86f0-63292d5d90be admin admin] PATH_INFO: `/v3/endpoints` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:17.418774 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ebc8c7-de1a-4612-86f0-63292d5d90be admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:17.419848 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING py.warnings [None req-26ebc8c7-de1a-4612-86f0-63292d5d90be admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:05:17.419848 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: warnings.warn(msg) Oct 12 18:05:17.419848 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: Oct 12 18:05:17.420799 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ebc8c7-de1a-4612-86f0-63292d5d90be admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:17.553920 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 368/729] 10.222.0.18 () {60 vars in 1165 bytes} [Tue Oct 12 18:05:17 2021] POST /identity/v3/endpoints => generated 327 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:05:17.737203 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e2633f-03d7-4377-bd81-114d1089dc7f None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:17.737541 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e2633f-03d7-4377-bd81-114d1089dc7f None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:17.737784 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e2633f-03d7-4377-bd81-114d1089dc7f None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:17.740470 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 362/730] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:05:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:05:17.746710 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdef273-3192-4ceb-921c-1f20cd62e29e None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:17.747027 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdef273-3192-4ceb-921c-1f20cd62e29e None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:17.747272 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdef273-3192-4ceb-921c-1f20cd62e29e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:17.771924 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-0fdef273-3192-4ceb-921c-1f20cd62e29e None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:05:17.773333 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-0fdef273-3192-4ceb-921c-1f20cd62e29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:05:17.792184 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 369/731] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:05:17 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:05:17.814923 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e2633f-03d7-4377-bd81-114d1089dc7f None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:17.828696 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e2633f-03d7-4377-bd81-114d1089dc7f None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:17.834995 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a3f624-f467-419c-9128-915c300571f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:17.835806 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a3f624-f467-419c-9128-915c300571f6 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:17.836088 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a3f624-f467-419c-9128-915c300571f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:17.836363 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a3f624-f467-419c-9128-915c300571f6 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:17.837069 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a3f624-f467-419c-9128-915c300571f6 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:17.838662 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a3f624-f467-419c-9128-915c300571f6 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:17.850527 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-76a3f624-f467-419c-9128-915c300571f6 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 12 18:05:17.856515 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 363/732] 10.222.0.18 () {56 vars in 1153 bytes} [Tue Oct 12 18:05:17 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:17.858729 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdef273-3192-4ceb-921c-1f20cd62e29e None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:17.869183 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdef273-3192-4ceb-921c-1f20cd62e29e None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:17.874029 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a2ec7b-7464-4699-a8c3-2ac64bef1317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:17.874871 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2ec7b-7464-4699-a8c3-2ac64bef1317 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:17.875160 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2ec7b-7464-4699-a8c3-2ac64bef1317 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:17.875432 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2ec7b-7464-4699-a8c3-2ac64bef1317 admin admin] PATH_INFO: `/v3/services` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:17.876150 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a2ec7b-7464-4699-a8c3-2ac64bef1317 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:17.876483 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a2ec7b-7464-4699-a8c3-2ac64bef1317 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:17.878088 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a2ec7b-7464-4699-a8c3-2ac64bef1317 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:17.882920 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 370/733] 10.222.0.18 () {56 vars in 1147 bytes} [Tue Oct 12 18:05:17 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:05:17.889283 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a3f624-f467-419c-9128-915c300571f6 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:17.900799 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a3f624-f467-419c-9128-915c300571f6 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:17.906635 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29ebca6-ca0a-472b-99bd-6e2e342cf94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:17.907360 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ebca6-ca0a-472b-99bd-6e2e342cf94c admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:17.907657 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ebca6-ca0a-472b-99bd-6e2e342cf94c admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:17.907966 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ebca6-ca0a-472b-99bd-6e2e342cf94c admin admin] PATH_INFO: `/v3/services` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:17.908772 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29ebca6-ca0a-472b-99bd-6e2e342cf94c admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:17.909072 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29ebca6-ca0a-472b-99bd-6e2e342cf94c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:17.910728 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29ebca6-ca0a-472b-99bd-6e2e342cf94c admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:17.920572 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 364/734] 10.222.0.18 () {56 vars in 1147 bytes} [Tue Oct 12 18:05:17 2021] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:18.471659 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34866cef-5a30-47d7-893e-419679f9dcca None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:18.472361 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34866cef-5a30-47d7-893e-419679f9dcca None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:18.472361 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34866cef-5a30-47d7-893e-419679f9dcca None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:18.474830 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 371/735] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:05:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:05:18.481037 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ed1bf5-2d79-4c0e-8cb9-087d6ea3f352 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:18.481529 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ed1bf5-2d79-4c0e-8cb9-087d6ea3f352 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:18.481710 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ed1bf5-2d79-4c0e-8cb9-087d6ea3f352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:18.499521 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-30ed1bf5-2d79-4c0e-8cb9-087d6ea3f352 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:05:18.500784 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-30ed1bf5-2d79-4c0e-8cb9-087d6ea3f352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:05:18.509368 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 365/736] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:05:18 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:05:18.534539 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34866cef-5a30-47d7-893e-419679f9dcca None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:18.547491 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34866cef-5a30-47d7-893e-419679f9dcca None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:18.551957 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c308f9-3fb5-4012-8dbf-b36f593ea18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:18.552773 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c308f9-3fb5-4012-8dbf-b36f593ea18b admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:18.553053 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c308f9-3fb5-4012-8dbf-b36f593ea18b admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:18.553329 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c308f9-3fb5-4012-8dbf-b36f593ea18b admin admin] PATH_INFO: `/v3/roles/service` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:18.569480 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c308f9-3fb5-4012-8dbf-b36f593ea18b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 18:05:18.574644 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-10c308f9-3fb5-4012-8dbf-b36f593ea18b admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 18:05:18.582582 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 372/737] 10.222.0.18 () {56 vars in 1123 bytes} [Tue Oct 12 18:05:18 2021] GET /identity/v3/roles/service => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:18.583726 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ed1bf5-2d79-4c0e-8cb9-087d6ea3f352 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:18.593045 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ed1bf5-2d79-4c0e-8cb9-087d6ea3f352 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:18.597635 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84d21e8-df5c-4ee3-8110-be44d852e10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:18.598306 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d21e8-df5c-4ee3-8110-be44d852e10b admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:18.599136 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d21e8-df5c-4ee3-8110-be44d852e10b admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:18.599415 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d21e8-df5c-4ee3-8110-be44d852e10b admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:18.600183 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84d21e8-df5c-4ee3-8110-be44d852e10b admin admin] RBAC: Adding query filter params (name=service) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:18.600530 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84d21e8-df5c-4ee3-8110-be44d852e10b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:18.602195 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84d21e8-df5c-4ee3-8110-be44d852e10b admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:18.610672 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 366/738] 10.222.0.18 () {56 vars in 1124 bytes} [Tue Oct 12 18:05:18 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:18.616849 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c308f9-3fb5-4012-8dbf-b36f593ea18b admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:18.631847 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c308f9-3fb5-4012-8dbf-b36f593ea18b admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:18.636477 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea59be1e-6aa9-417e-a297-159d37171300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:18.637270 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea59be1e-6aa9-417e-a297-159d37171300 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:18.637553 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea59be1e-6aa9-417e-a297-159d37171300 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:18.637832 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea59be1e-6aa9-417e-a297-159d37171300 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:18.649347 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea59be1e-6aa9-417e-a297-159d37171300 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:18.651218 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea59be1e-6aa9-417e-a297-159d37171300 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:18.668885 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-ea59be1e-6aa9-417e-a297-159d37171300 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 18:05:18.670374 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 373/739] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:05:18 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:18.676581 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84d21e8-df5c-4ee3-8110-be44d852e10b admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:18.686391 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84d21e8-df5c-4ee3-8110-be44d852e10b admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:18.691014 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3d9788-161f-410e-8bb2-729179743c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:18.691675 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d9788-161f-410e-8bb2-729179743c4e admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:18.691955 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d9788-161f-410e-8bb2-729179743c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:18.692290 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d9788-161f-410e-8bb2-729179743c4e admin admin] PATH_INFO: `/v3/domains` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:18.693067 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3d9788-161f-410e-8bb2-729179743c4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:18.693373 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3d9788-161f-410e-8bb2-729179743c4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:18.694988 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3d9788-161f-410e-8bb2-729179743c4e admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:18.710492 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 367/740] 10.222.0.18 () {56 vars in 1130 bytes} [Tue Oct 12 18:05:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:18.716333 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea59be1e-6aa9-417e-a297-159d37171300 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:18.727134 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea59be1e-6aa9-417e-a297-159d37171300 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:18.731683 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0f30c7-f896-47b9-a29a-7047a087e36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:18.732554 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f30c7-f896-47b9-a29a-7047a087e36a admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:18.732861 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f30c7-f896-47b9-a29a-7047a087e36a admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:18.733136 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f30c7-f896-47b9-a29a-7047a087e36a admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:18.740916 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0f30c7-f896-47b9-a29a-7047a087e36a admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:18.743010 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0f30c7-f896-47b9-a29a-7047a087e36a admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:18.757618 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-6e0f30c7-f896-47b9-a29a-7047a087e36a admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 12 18:05:18.759081 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 374/741] 10.222.0.18 () {56 vars in 1138 bytes} [Tue Oct 12 18:05:18 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:18.765348 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3d9788-161f-410e-8bb2-729179743c4e admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:18.776103 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3d9788-161f-410e-8bb2-729179743c4e admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:18.780752 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061e9e91-3b49-480a-b62d-a3c4f3a7e855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:18.781408 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e9e91-3b49-480a-b62d-a3c4f3a7e855 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:18.781746 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e9e91-3b49-480a-b62d-a3c4f3a7e855 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:18.782022 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e9e91-3b49-480a-b62d-a3c4f3a7e855 admin admin] PATH_INFO: `/v3/users` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:18.782918 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061e9e91-3b49-480a-b62d-a3c4f3a7e855 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:18.783225 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061e9e91-3b49-480a-b62d-a3c4f3a7e855 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:18.785167 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061e9e91-3b49-480a-b62d-a3c4f3a7e855 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:18.808723 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 368/742] 10.222.0.18 () {56 vars in 1170 bytes} [Tue Oct 12 18:05:18 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:18.814902 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0f30c7-f896-47b9-a29a-7047a087e36a admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:18.825397 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0f30c7-f896-47b9-a29a-7047a087e36a admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:18.830023 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791581db-5b40-4bf5-a6cc-bb1e3392aaf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:18.830662 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791581db-5b40-4bf5-a6cc-bb1e3392aaf1 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:18.830945 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791581db-5b40-4bf5-a6cc-bb1e3392aaf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:18.831219 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791581db-5b40-4bf5-a6cc-bb1e3392aaf1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:18.839690 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791581db-5b40-4bf5-a6cc-bb1e3392aaf1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:18.841570 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791581db-5b40-4bf5-a6cc-bb1e3392aaf1 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:18.850969 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 375/743] 10.222.0.18 () {58 vars in 1324 bytes} [Tue Oct 12 18:05:18 2021] GET /identity/v3/auth/tokens => generated 1605 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:05:18.857200 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061e9e91-3b49-480a-b62d-a3c4f3a7e855 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:18.867061 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061e9e91-3b49-480a-b62d-a3c4f3a7e855 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:18.871694 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e895812-1b05-4485-91d5-20bc72c5f1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:18.872597 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e895812-1b05-4485-91d5-20bc72c5f1e5 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:18.872942 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e895812-1b05-4485-91d5-20bc72c5f1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:18.873161 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e895812-1b05-4485-91d5-20bc72c5f1e5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:18.884379 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e895812-1b05-4485-91d5-20bc72c5f1e5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:18.886230 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e895812-1b05-4485-91d5-20bc72c5f1e5 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:18.903997 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-3e895812-1b05-4485-91d5-20bc72c5f1e5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 18:05:18.905496 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 369/744] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:05:18 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:18.911699 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791581db-5b40-4bf5-a6cc-bb1e3392aaf1 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:18.920751 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791581db-5b40-4bf5-a6cc-bb1e3392aaf1 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:18.925415 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da07a061-1842-4517-b5df-9e19a444788c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:18.926071 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da07a061-1842-4517-b5df-9e19a444788c admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:18.926351 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da07a061-1842-4517-b5df-9e19a444788c admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:18.926663 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da07a061-1842-4517-b5df-9e19a444788c admin admin] PATH_INFO: `/v3/domains` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:18.927399 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da07a061-1842-4517-b5df-9e19a444788c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:18.927705 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da07a061-1842-4517-b5df-9e19a444788c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:18.929456 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da07a061-1842-4517-b5df-9e19a444788c admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:18.941429 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 376/745] 10.222.0.18 () {56 vars in 1130 bytes} [Tue Oct 12 18:05:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:18.948059 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e895812-1b05-4485-91d5-20bc72c5f1e5 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:18.958470 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e895812-1b05-4485-91d5-20bc72c5f1e5 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:18.963106 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f67b613-50b7-4dc6-bd42-1d928ed7bcb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:18.963886 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f67b613-50b7-4dc6-bd42-1d928ed7bcb2 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:18.964167 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f67b613-50b7-4dc6-bd42-1d928ed7bcb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:18.964474 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f67b613-50b7-4dc6-bd42-1d928ed7bcb2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:18.971708 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f67b613-50b7-4dc6-bd42-1d928ed7bcb2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:18.973851 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f67b613-50b7-4dc6-bd42-1d928ed7bcb2 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:18.989101 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-1f67b613-50b7-4dc6-bd42-1d928ed7bcb2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 18:05:18.990589 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 370/746] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Oct 12 18:05:18 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:18.999493 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da07a061-1842-4517-b5df-9e19a444788c admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:19.008640 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da07a061-1842-4517-b5df-9e19a444788c admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:19.013250 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cbbe38-5725-42ad-89b9-aa433b4176db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:19.013955 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cbbe38-5725-42ad-89b9-aa433b4176db admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:19.014235 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cbbe38-5725-42ad-89b9-aa433b4176db admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:19.014568 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cbbe38-5725-42ad-89b9-aa433b4176db admin admin] PATH_INFO: `/v3/projects` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:19.015401 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cbbe38-5725-42ad-89b9-aa433b4176db admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:19.015722 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cbbe38-5725-42ad-89b9-aa433b4176db admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:19.017973 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cbbe38-5725-42ad-89b9-aa433b4176db admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:19.031336 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 377/747] 10.222.0.18 () {56 vars in 1169 bytes} [Tue Oct 12 18:05:18 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:19.037864 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f67b613-50b7-4dc6-bd42-1d928ed7bcb2 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:19.048681 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f67b613-50b7-4dc6-bd42-1d928ed7bcb2 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:19.053468 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c8f2cb-d78e-43b5-a542-29400b9038c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:19.054169 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8f2cb-d78e-43b5-a542-29400b9038c9 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:19.054449 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8f2cb-d78e-43b5-a542-29400b9038c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:19.054758 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8f2cb-d78e-43b5-a542-29400b9038c9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:19.055613 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c8f2cb-d78e-43b5-a542-29400b9038c9 admin admin] RBAC: Adding query filter params (role.id=24b43b2260b1455e832abdff63df40bd, scope.project.id=e843aaa9e5e44a8e98f7cc7412d9697b, user.id=8f6a3a7064754fb79a0a06b3ad4a7d05) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:19.055936 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c8f2cb-d78e-43b5-a542-29400b9038c9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:19.057981 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c8f2cb-d78e-43b5-a542-29400b9038c9 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:19.064775 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 371/748] 10.222.0.18 () {56 vars in 1395 bytes} [Tue Oct 12 18:05:19 2021] GET /identity/v3/role_assignments?user.id=8f6a3a7064754fb79a0a06b3ad4a7d05&scope.project.id=e843aaa9e5e44a8e98f7cc7412d9697b&role.id=24b43b2260b1455e832abdff63df40bd => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:19.737617 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd7aaa5-7006-443a-9273-8bd02e43a012 None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:19.737617 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd7aaa5-7006-443a-9273-8bd02e43a012 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:19.737617 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd7aaa5-7006-443a-9273-8bd02e43a012 None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:19.738866 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 378/749] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:05:19 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:05:19.745434 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98646bb1-4c03-4524-9379-5f735a85b2fa None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:19.745940 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98646bb1-4c03-4524-9379-5f735a85b2fa None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:19.746097 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98646bb1-4c03-4524-9379-5f735a85b2fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:19.765551 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-98646bb1-4c03-4524-9379-5f735a85b2fa None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:05:19.767058 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-98646bb1-4c03-4524-9379-5f735a85b2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:05:19.775571 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 372/750] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:05:19 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:05:19.800308 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd7aaa5-7006-443a-9273-8bd02e43a012 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:19.812847 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd7aaa5-7006-443a-9273-8bd02e43a012 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:19.818044 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8458555-0092-4587-8d62-b838dadac739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:19.818831 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8458555-0092-4587-8d62-b838dadac739 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:19.819112 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8458555-0092-4587-8d62-b838dadac739 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:19.819390 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8458555-0092-4587-8d62-b838dadac739 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:19.829637 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8458555-0092-4587-8d62-b838dadac739 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 18:05:19.836617 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-e8458555-0092-4587-8d62-b838dadac739 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 18:05:19.838116 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 379/751] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Oct 12 18:05:19 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:19.851430 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98646bb1-4c03-4524-9379-5f735a85b2fa None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:19.858158 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98646bb1-4c03-4524-9379-5f735a85b2fa None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:19.862993 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6712edb0-0bdf-4814-a29a-155c0eafe291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:19.863831 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712edb0-0bdf-4814-a29a-155c0eafe291 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:19.864331 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712edb0-0bdf-4814-a29a-155c0eafe291 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:19.864765 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712edb0-0bdf-4814-a29a-155c0eafe291 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:19.865671 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6712edb0-0bdf-4814-a29a-155c0eafe291 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:19.866129 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6712edb0-0bdf-4814-a29a-155c0eafe291 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:19.867891 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6712edb0-0bdf-4814-a29a-155c0eafe291 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:19.877120 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 373/752] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Oct 12 18:05:19 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:19.887734 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8458555-0092-4587-8d62-b838dadac739 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:19.898048 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8458555-0092-4587-8d62-b838dadac739 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:19.902879 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c534f2-8e14-4c0e-b654-36c738525636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:19.903841 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c534f2-8e14-4c0e-b654-36c738525636 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:19.904272 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c534f2-8e14-4c0e-b654-36c738525636 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:19.904717 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c534f2-8e14-4c0e-b654-36c738525636 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:19.911244 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d323b-b99a-450e-a166-36eee5e71497 None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:19.911708 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d323b-b99a-450e-a166-36eee5e71497 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:19.912218 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d323b-b99a-450e-a166-36eee5e71497 None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:19.914633 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 374/753] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:05:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 18:05:19.921991 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c534f2-8e14-4c0e-b654-36c738525636 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:19.923526 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c534f2-8e14-4c0e-b654-36c738525636 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:19.924713 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad61a33-0822-412f-9196-96f67fa5a371 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:19.925397 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad61a33-0822-412f-9196-96f67fa5a371 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:19.926214 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad61a33-0822-412f-9196-96f67fa5a371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:19.941374 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-c6c534f2-8e14-4c0e-b654-36c738525636 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 18:05:19.942954 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 380/754] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:05:19 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:19.948432 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-4ad61a33-0822-412f-9196-96f67fa5a371 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:05:19.948432 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-4ad61a33-0822-412f-9196-96f67fa5a371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:05:19.950970 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c534f2-8e14-4c0e-b654-36c738525636 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:19.956587 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 375/755] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:05:19 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:05:19.961683 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c534f2-8e14-4c0e-b654-36c738525636 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:19.967626 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dff65c-e3a0-4015-a0a0-f429e97e9f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:19.968561 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dff65c-e3a0-4015-a0a0-f429e97e9f82 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:19.969082 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dff65c-e3a0-4015-a0a0-f429e97e9f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:19.969557 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dff65c-e3a0-4015-a0a0-f429e97e9f82 admin admin] PATH_INFO: `/v3/domains` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:19.970480 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dff65c-e3a0-4015-a0a0-f429e97e9f82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:19.970995 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dff65c-e3a0-4015-a0a0-f429e97e9f82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:19.975378 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dff65c-e3a0-4015-a0a0-f429e97e9f82 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:19.980674 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad61a33-0822-412f-9196-96f67fa5a371 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:19.990065 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad61a33-0822-412f-9196-96f67fa5a371 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:19.990550 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 381/756] 10.222.0.18 () {56 vars in 1130 bytes} [Tue Oct 12 18:05:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:05:19.996439 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6129c6-b1f8-4b5c-9c6e-72841649b6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:19.997017 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dff65c-e3a0-4015-a0a0-f429e97e9f82 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:19.997301 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6129c6-b1f8-4b5c-9c6e-72841649b6c6 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:19.997584 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6129c6-b1f8-4b5c-9c6e-72841649b6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:19.997908 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6129c6-b1f8-4b5c-9c6e-72841649b6c6 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:19.999855 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6129c6-b1f8-4b5c-9c6e-72841649b6c6 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:20.001916 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6129c6-b1f8-4b5c-9c6e-72841649b6c6 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:20.012897 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-2d6129c6-b1f8-4b5c-9c6e-72841649b6c6 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 12 18:05:20.014451 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 376/757] 10.222.0.18 () {56 vars in 1135 bytes} [Tue Oct 12 18:05:19 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:20.014803 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dff65c-e3a0-4015-a0a0-f429e97e9f82 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:20.022892 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6129c6-b1f8-4b5c-9c6e-72841649b6c6 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:20.027469 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb58a3f3-9216-42d8-8097-00b6c7143663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:20.028613 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb58a3f3-9216-42d8-8097-00b6c7143663 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:20.029134 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb58a3f3-9216-42d8-8097-00b6c7143663 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:20.029605 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb58a3f3-9216-42d8-8097-00b6c7143663 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:20.031947 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6129c6-b1f8-4b5c-9c6e-72841649b6c6 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:20.036952 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d91ceec-079b-43e9-87ed-efb2cf132514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:20.037600 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91ceec-079b-43e9-87ed-efb2cf132514 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:20.037879 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91ceec-079b-43e9-87ed-efb2cf132514 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:20.038173 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91ceec-079b-43e9-87ed-efb2cf132514 admin admin] PATH_INFO: `/v3/services` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:20.038875 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d91ceec-079b-43e9-87ed-efb2cf132514 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:20.039173 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d91ceec-079b-43e9-87ed-efb2cf132514 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:20.040036 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb58a3f3-9216-42d8-8097-00b6c7143663 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:20.040822 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d91ceec-079b-43e9-87ed-efb2cf132514 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:20.042600 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb58a3f3-9216-42d8-8097-00b6c7143663 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:20.050797 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 377/758] 10.222.0.18 () {56 vars in 1135 bytes} [Tue Oct 12 18:05:20 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:05:20.051945 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d91ceec-079b-43e9-87ed-efb2cf132514 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:20.058082 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-eb58a3f3-9216-42d8-8097-00b6c7143663 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 12 18:05:20.059777 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 382/759] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Oct 12 18:05:19 2021] GET /identity/v3/users/swift => generated 83 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 18:05:20.065732 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d91ceec-079b-43e9-87ed-efb2cf132514 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:20.067749 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126fbd79-9502-42a6-9d57-74fccffab641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:20.067749 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126fbd79-9502-42a6-9d57-74fccffab641 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:20.067749 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126fbd79-9502-42a6-9d57-74fccffab641 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:20.067749 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126fbd79-9502-42a6-9d57-74fccffab641 admin admin] PATH_INFO: `/v3/services` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:20.068410 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126fbd79-9502-42a6-9d57-74fccffab641 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:20.068579 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126fbd79-9502-42a6-9d57-74fccffab641 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:20.070163 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126fbd79-9502-42a6-9d57-74fccffab641 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:20.072033 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb58a3f3-9216-42d8-8097-00b6c7143663 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:20.077009 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 378/760] 10.222.0.18 () {56 vars in 1135 bytes} [Tue Oct 12 18:05:20 2021] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:20.084468 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb58a3f3-9216-42d8-8097-00b6c7143663 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:20.090025 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c608cb2-5ad3-4ead-9410-099116b8a68d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:20.091127 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c608cb2-5ad3-4ead-9410-099116b8a68d admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:20.095488 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c608cb2-5ad3-4ead-9410-099116b8a68d admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:20.095488 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c608cb2-5ad3-4ead-9410-099116b8a68d admin admin] PATH_INFO: `/v3/users` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:20.095488 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c608cb2-5ad3-4ead-9410-099116b8a68d admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:20.095488 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c608cb2-5ad3-4ead-9410-099116b8a68d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:20.099931 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c608cb2-5ad3-4ead-9410-099116b8a68d admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:20.123827 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 383/761] 10.222.0.18 () {56 vars in 1156 bytes} [Tue Oct 12 18:05:20 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:05:20.133575 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126fbd79-9502-42a6-9d57-74fccffab641 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:20.145069 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126fbd79-9502-42a6-9d57-74fccffab641 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:20.150998 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6242eb-5166-40bd-9726-d99bdec3094d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:20.152032 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6242eb-5166-40bd-9726-d99bdec3094d admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:20.152611 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6242eb-5166-40bd-9726-d99bdec3094d admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:20.153106 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6242eb-5166-40bd-9726-d99bdec3094d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:20.163253 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6242eb-5166-40bd-9726-d99bdec3094d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:20.165471 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6242eb-5166-40bd-9726-d99bdec3094d admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:20.176653 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 379/762] 10.222.0.18 () {58 vars in 1324 bytes} [Tue Oct 12 18:05:20 2021] GET /identity/v3/auth/tokens => generated 1605 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:05:20.183592 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c608cb2-5ad3-4ead-9410-099116b8a68d admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:20.194408 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c608cb2-5ad3-4ead-9410-099116b8a68d admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:20.199545 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31195e42-50d5-40e8-9f32-7f96a5ea9b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:20.200783 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31195e42-50d5-40e8-9f32-7f96a5ea9b72 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:20.201313 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31195e42-50d5-40e8-9f32-7f96a5ea9b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:20.201834 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31195e42-50d5-40e8-9f32-7f96a5ea9b72 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:20.214690 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31195e42-50d5-40e8-9f32-7f96a5ea9b72 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:20.217230 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31195e42-50d5-40e8-9f32-7f96a5ea9b72 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:20.236282 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-31195e42-50d5-40e8-9f32-7f96a5ea9b72 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 18:05:20.237112 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a06117-4ab9-4222-93d2-2e2f34f4011c None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:20.237387 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a06117-4ab9-4222-93d2-2e2f34f4011c None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:20.237666 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a06117-4ab9-4222-93d2-2e2f34f4011c None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:20.239486 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 384/763] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:05:20 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:20.244542 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 380/764] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:05:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 18:05:20.246406 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31195e42-50d5-40e8-9f32-7f96a5ea9b72 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:20.246867 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf2607-0f71-4453-b147-968ac45e1514 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:20.247158 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf2607-0f71-4453-b147-968ac45e1514 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:20.247429 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf2607-0f71-4453-b147-968ac45e1514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:20.257562 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31195e42-50d5-40e8-9f32-7f96a5ea9b72 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:20.262632 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d7f5e7-d39b-4ada-bdf0-d14bd3af843a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:20.263639 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7f5e7-d39b-4ada-bdf0-d14bd3af843a admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:20.264123 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7f5e7-d39b-4ada-bdf0-d14bd3af843a admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:20.264626 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7f5e7-d39b-4ada-bdf0-d14bd3af843a admin admin] PATH_INFO: `/v3/domains` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:20.265612 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d7f5e7-d39b-4ada-bdf0-d14bd3af843a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:20.266386 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-accf2607-0f71-4453-b147-968ac45e1514 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:05:20.266738 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d7f5e7-d39b-4ada-bdf0-d14bd3af843a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:20.267611 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-accf2607-0f71-4453-b147-968ac45e1514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:05:20.268905 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d7f5e7-d39b-4ada-bdf0-d14bd3af843a admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:20.278110 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 381/765] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:05:20 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:05:20.284657 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 385/766] 10.222.0.18 () {56 vars in 1130 bytes} [Tue Oct 12 18:05:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:20.291457 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accf2607-0f71-4453-b147-968ac45e1514 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:20.301310 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accf2607-0f71-4453-b147-968ac45e1514 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:20.303733 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d7f5e7-d39b-4ada-bdf0-d14bd3af843a admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:20.306531 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c69e66-a75c-461d-89b1-c34968e94a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:20.307655 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c69e66-a75c-461d-89b1-c34968e94a71 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:20.308202 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c69e66-a75c-461d-89b1-c34968e94a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:20.308954 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c69e66-a75c-461d-89b1-c34968e94a71 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:20.313693 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d7f5e7-d39b-4ada-bdf0-d14bd3af843a admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:20.318451 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c69e66-a75c-461d-89b1-c34968e94a71 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:20.319528 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af4212-1b3f-4980-bc8b-47c25dce3e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:20.320186 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af4212-1b3f-4980-bc8b-47c25dce3e0c admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:20.320506 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af4212-1b3f-4980-bc8b-47c25dce3e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:20.320787 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af4212-1b3f-4980-bc8b-47c25dce3e0c admin admin] PATH_INFO: `/v3/services` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:20.321526 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05af4212-1b3f-4980-bc8b-47c25dce3e0c admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:20.321859 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c69e66-a75c-461d-89b1-c34968e94a71 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:20.322538 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING py.warnings [None req-05af4212-1b3f-4980-bc8b-47c25dce3e0c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:05:20.322538 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: warnings.warn(msg) Oct 12 18:05:20.322538 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: Oct 12 18:05:20.323420 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05af4212-1b3f-4980-bc8b-47c25dce3e0c admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:20.337721 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-c0c69e66-a75c-461d-89b1-c34968e94a71 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 18:05:20.339039 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 382/767] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Oct 12 18:05:20 2021] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:20.345387 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c69e66-a75c-461d-89b1-c34968e94a71 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:20.355699 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c69e66-a75c-461d-89b1-c34968e94a71 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:20.360809 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f9e535-e7e2-40cb-875d-9bd70d5abf1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:20.361460 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9e535-e7e2-40cb-875d-9bd70d5abf1a admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:20.361746 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9e535-e7e2-40cb-875d-9bd70d5abf1a admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:20.362023 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9e535-e7e2-40cb-875d-9bd70d5abf1a admin admin] PATH_INFO: `/v3/projects` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:20.362831 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f9e535-e7e2-40cb-875d-9bd70d5abf1a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:20.363146 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f9e535-e7e2-40cb-875d-9bd70d5abf1a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:20.365079 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f9e535-e7e2-40cb-875d-9bd70d5abf1a admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:20.385290 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 383/768] 10.222.0.18 () {56 vars in 1169 bytes} [Tue Oct 12 18:05:20 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:05:20.392343 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f9e535-e7e2-40cb-875d-9bd70d5abf1a admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:20.403193 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 386/769] 10.222.0.18 () {60 vars in 1162 bytes} [Tue Oct 12 18:05:20 2021] POST /identity/v3/services => generated 269 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 18:05:20.410615 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f9e535-e7e2-40cb-875d-9bd70d5abf1a admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:20.428865 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab74610d-b3f7-446c-973f-49a1ce61cbc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:20.429941 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab74610d-b3f7-446c-973f-49a1ce61cbc8 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:20.430491 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab74610d-b3f7-446c-973f-49a1ce61cbc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:20.430979 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab74610d-b3f7-446c-973f-49a1ce61cbc8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:20.432305 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab74610d-b3f7-446c-973f-49a1ce61cbc8 admin admin] RBAC: Adding query filter params (role.id=6c54f239944d46e3b027ccce97eb8b49, scope.project.id=e843aaa9e5e44a8e98f7cc7412d9697b, user.id=7f527f925af24eba8cabffe457fceb09) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:20.432920 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab74610d-b3f7-446c-973f-49a1ce61cbc8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:20.435167 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab74610d-b3f7-446c-973f-49a1ce61cbc8 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:20.443490 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 384/770] 10.222.0.18 () {56 vars in 1395 bytes} [Tue Oct 12 18:05:20 2021] GET /identity/v3/role_assignments?user.id=7f527f925af24eba8cabffe457fceb09&scope.project.id=e843aaa9e5e44a8e98f7cc7412d9697b&role.id=6c54f239944d46e3b027ccce97eb8b49 => generated 608 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:05:21.487043 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f6501-858d-4d76-9b09-64e8249c7be2 None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:21.487565 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f6501-858d-4d76-9b09-64e8249c7be2 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:21.487674 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f6501-858d-4d76-9b09-64e8249c7be2 None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:21.490087 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 387/771] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:05:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:05:21.496249 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c9e169-5dc2-478a-aed5-57ff5b4087f8 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:21.497087 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c9e169-5dc2-478a-aed5-57ff5b4087f8 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:21.497605 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c9e169-5dc2-478a-aed5-57ff5b4087f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:21.516613 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-15c9e169-5dc2-478a-aed5-57ff5b4087f8 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:05:21.518248 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-15c9e169-5dc2-478a-aed5-57ff5b4087f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:05:21.526682 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 385/772] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:05:21 2021] POST /identity/v3/auth/tokens => generated 1715 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:05:21.551169 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35f6501-858d-4d76-9b09-64e8249c7be2 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:21.564312 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35f6501-858d-4d76-9b09-64e8249c7be2 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:21.569717 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbacd597-dd5f-47a8-a64b-d522a2d663c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:21.570783 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbacd597-dd5f-47a8-a64b-d522a2d663c6 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:21.571279 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbacd597-dd5f-47a8-a64b-d522a2d663c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:21.571781 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbacd597-dd5f-47a8-a64b-d522a2d663c6 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:21.585549 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbacd597-dd5f-47a8-a64b-d522a2d663c6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 18:05:21.593402 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-bbacd597-dd5f-47a8-a64b-d522a2d663c6 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 12 18:05:21.595116 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 388/773] 10.222.0.18 () {56 vars in 1141 bytes} [Tue Oct 12 18:05:21 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:21.602385 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c9e169-5dc2-478a-aed5-57ff5b4087f8 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:21.611788 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c9e169-5dc2-478a-aed5-57ff5b4087f8 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:21.622262 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bade2ddd-dbc8-456f-b801-66d6bce21222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:21.623153 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bade2ddd-dbc8-456f-b801-66d6bce21222 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:21.623559 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bade2ddd-dbc8-456f-b801-66d6bce21222 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:21.623966 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bade2ddd-dbc8-456f-b801-66d6bce21222 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:21.630243 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bade2ddd-dbc8-456f-b801-66d6bce21222 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:21.630759 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bade2ddd-dbc8-456f-b801-66d6bce21222 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:21.632595 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bade2ddd-dbc8-456f-b801-66d6bce21222 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:21.642167 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 386/774] 10.222.0.18 () {56 vars in 1136 bytes} [Tue Oct 12 18:05:21 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:21.648748 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbacd597-dd5f-47a8-a64b-d522a2d663c6 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:21.658806 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbacd597-dd5f-47a8-a64b-d522a2d663c6 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:21.663756 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa7f377-1da1-417f-9b47-6333a34463f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:21.664727 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa7f377-1da1-417f-9b47-6333a34463f9 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:21.665093 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa7f377-1da1-417f-9b47-6333a34463f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:21.665444 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa7f377-1da1-417f-9b47-6333a34463f9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:21.677700 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa7f377-1da1-417f-9b47-6333a34463f9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:21.679679 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa7f377-1da1-417f-9b47-6333a34463f9 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:21.698301 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-cfa7f377-1da1-417f-9b47-6333a34463f9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 18:05:21.700014 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 389/775] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:05:21 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:21.706570 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bade2ddd-dbc8-456f-b801-66d6bce21222 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:21.716635 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bade2ddd-dbc8-456f-b801-66d6bce21222 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:21.721293 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef237690-5ff9-416f-b569-18d280636197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:21.721943 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef237690-5ff9-416f-b569-18d280636197 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:21.722224 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef237690-5ff9-416f-b569-18d280636197 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:21.722498 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef237690-5ff9-416f-b569-18d280636197 admin admin] PATH_INFO: `/v3/domains` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:21.723228 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef237690-5ff9-416f-b569-18d280636197 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:21.723574 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef237690-5ff9-416f-b569-18d280636197 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:21.725198 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef237690-5ff9-416f-b569-18d280636197 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:21.737424 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 387/776] 10.222.0.18 () {56 vars in 1130 bytes} [Tue Oct 12 18:05:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:21.744040 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa7f377-1da1-417f-9b47-6333a34463f9 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:21.754188 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa7f377-1da1-417f-9b47-6333a34463f9 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:21.759564 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129eb131-14f9-4a46-9372-ee40b50e2a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:21.760370 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129eb131-14f9-4a46-9372-ee40b50e2a96 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:21.760681 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129eb131-14f9-4a46-9372-ee40b50e2a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:21.760992 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129eb131-14f9-4a46-9372-ee40b50e2a96 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:21.768946 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129eb131-14f9-4a46-9372-ee40b50e2a96 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:21.771099 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129eb131-14f9-4a46-9372-ee40b50e2a96 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:21.786808 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-129eb131-14f9-4a46-9372-ee40b50e2a96 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 12 18:05:21.788332 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 390/777] 10.222.0.18 () {56 vars in 1138 bytes} [Tue Oct 12 18:05:21 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:21.794696 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef237690-5ff9-416f-b569-18d280636197 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:21.805370 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef237690-5ff9-416f-b569-18d280636197 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:21.810143 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1616ddca-ef00-4eb8-b935-637d653b309c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:21.810808 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616ddca-ef00-4eb8-b935-637d653b309c admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:21.811091 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616ddca-ef00-4eb8-b935-637d653b309c admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:21.811370 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616ddca-ef00-4eb8-b935-637d653b309c admin admin] PATH_INFO: `/v3/users` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:21.812230 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1616ddca-ef00-4eb8-b935-637d653b309c admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:21.812577 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1616ddca-ef00-4eb8-b935-637d653b309c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:21.814652 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1616ddca-ef00-4eb8-b935-637d653b309c admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:21.833149 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 388/778] 10.222.0.18 () {56 vars in 1170 bytes} [Tue Oct 12 18:05:21 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:21.839145 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129eb131-14f9-4a46-9372-ee40b50e2a96 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:21.849729 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129eb131-14f9-4a46-9372-ee40b50e2a96 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:21.854472 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f19c629-7465-47d7-8f49-1447c5c677df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:21.855175 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f19c629-7465-47d7-8f49-1447c5c677df admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:21.855460 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f19c629-7465-47d7-8f49-1447c5c677df admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:21.855732 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f19c629-7465-47d7-8f49-1447c5c677df admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:21.864230 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f19c629-7465-47d7-8f49-1447c5c677df admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:21.866090 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f19c629-7465-47d7-8f49-1447c5c677df admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:21.875602 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 391/779] 10.222.0.18 () {58 vars in 1324 bytes} [Tue Oct 12 18:05:21 2021] GET /identity/v3/auth/tokens => generated 1715 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:05:21.882442 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1616ddca-ef00-4eb8-b935-637d653b309c admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:21.892713 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1616ddca-ef00-4eb8-b935-637d653b309c admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:21.897870 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6ac066-6fc0-4119-acdb-ed0cd7fefe6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:21.898658 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ac066-6fc0-4119-acdb-ed0cd7fefe6d admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:21.898940 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ac066-6fc0-4119-acdb-ed0cd7fefe6d admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:21.899217 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ac066-6fc0-4119-acdb-ed0cd7fefe6d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:21.909959 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6ac066-6fc0-4119-acdb-ed0cd7fefe6d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:21.911931 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6ac066-6fc0-4119-acdb-ed0cd7fefe6d admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:21.928956 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-4a6ac066-6fc0-4119-acdb-ed0cd7fefe6d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 18:05:21.930424 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 389/780] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:05:21 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:21.936661 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f19c629-7465-47d7-8f49-1447c5c677df admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:21.946219 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f19c629-7465-47d7-8f49-1447c5c677df admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:21.950870 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20962d0c-148a-4c2b-9a70-b182976da718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:21.951521 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20962d0c-148a-4c2b-9a70-b182976da718 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:21.951803 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20962d0c-148a-4c2b-9a70-b182976da718 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:21.952077 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20962d0c-148a-4c2b-9a70-b182976da718 admin admin] PATH_INFO: `/v3/domains` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:21.952840 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20962d0c-148a-4c2b-9a70-b182976da718 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:21.953147 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20962d0c-148a-4c2b-9a70-b182976da718 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:21.954736 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20962d0c-148a-4c2b-9a70-b182976da718 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:21.966668 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 392/781] 10.222.0.18 () {56 vars in 1130 bytes} [Tue Oct 12 18:05:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:21.972742 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6ac066-6fc0-4119-acdb-ed0cd7fefe6d admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:21.983308 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6ac066-6fc0-4119-acdb-ed0cd7fefe6d admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:21.987958 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db02fab-b8ce-4fcb-a546-b485b9ff0b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:21.988775 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db02fab-b8ce-4fcb-a546-b485b9ff0b81 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:21.989151 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db02fab-b8ce-4fcb-a546-b485b9ff0b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:21.989439 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db02fab-b8ce-4fcb-a546-b485b9ff0b81 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:21.996554 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db02fab-b8ce-4fcb-a546-b485b9ff0b81 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:21.998750 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db02fab-b8ce-4fcb-a546-b485b9ff0b81 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:22.012470 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-7db02fab-b8ce-4fcb-a546-b485b9ff0b81 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 18:05:22.013989 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 390/782] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Oct 12 18:05:21 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:22.021285 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20962d0c-148a-4c2b-9a70-b182976da718 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:22.031226 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20962d0c-148a-4c2b-9a70-b182976da718 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:22.036061 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fa6f9f-0eca-4df0-8353-0a63a749146f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:22.036757 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fa6f9f-0eca-4df0-8353-0a63a749146f admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:22.037038 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fa6f9f-0eca-4df0-8353-0a63a749146f admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:22.037314 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fa6f9f-0eca-4df0-8353-0a63a749146f admin admin] PATH_INFO: `/v3/projects` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:22.038165 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fa6f9f-0eca-4df0-8353-0a63a749146f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:22.038473 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fa6f9f-0eca-4df0-8353-0a63a749146f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:22.040466 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fa6f9f-0eca-4df0-8353-0a63a749146f admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:22.053474 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 393/783] 10.222.0.18 () {56 vars in 1169 bytes} [Tue Oct 12 18:05:22 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:22.060088 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db02fab-b8ce-4fcb-a546-b485b9ff0b81 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:22.072566 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db02fab-b8ce-4fcb-a546-b485b9ff0b81 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:22.077330 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2bce39-5cf6-400c-84de-9472c6c7b905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:22.077979 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2bce39-5cf6-400c-84de-9472c6c7b905 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:22.078261 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2bce39-5cf6-400c-84de-9472c6c7b905 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:22.078535 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2bce39-5cf6-400c-84de-9472c6c7b905 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:22.079443 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2bce39-5cf6-400c-84de-9472c6c7b905 admin admin] RBAC: Adding query filter params (role.id=d7656b67d66f4c2d81879698f36ca670, scope.project.id=e843aaa9e5e44a8e98f7cc7412d9697b, user.id=8f6a3a7064754fb79a0a06b3ad4a7d05) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:22.079755 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2bce39-5cf6-400c-84de-9472c6c7b905 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:22.081733 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2bce39-5cf6-400c-84de-9472c6c7b905 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:22.088627 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 391/784] 10.222.0.18 () {56 vars in 1395 bytes} [Tue Oct 12 18:05:22 2021] GET /identity/v3/role_assignments?user.id=8f6a3a7064754fb79a0a06b3ad4a7d05&scope.project.id=e843aaa9e5e44a8e98f7cc7412d9697b&role.id=d7656b67d66f4c2d81879698f36ca670 => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:22.381305 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026a200-58a8-4399-8973-0d85bfea32b4 None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:22.381587 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026a200-58a8-4399-8973-0d85bfea32b4 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:22.381861 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026a200-58a8-4399-8973-0d85bfea32b4 None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:22.383890 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 394/785] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:05:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:05:22.389855 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414be33-365a-443a-8bd4-5fcd43710761 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:22.390144 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414be33-365a-443a-8bd4-5fcd43710761 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:22.390428 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414be33-365a-443a-8bd4-5fcd43710761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:22.408768 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-f414be33-365a-443a-8bd4-5fcd43710761 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:05:22.410024 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-f414be33-365a-443a-8bd4-5fcd43710761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:05:22.418843 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 392/786] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:05:22 2021] POST /identity/v3/auth/tokens => generated 1715 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:05:22.441928 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e026a200-58a8-4399-8973-0d85bfea32b4 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:22.454518 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e026a200-58a8-4399-8973-0d85bfea32b4 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:22.459521 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beecb59-8d0a-408c-94c2-08098718f46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:22.460176 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beecb59-8d0a-408c-94c2-08098718f46b admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:22.460492 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beecb59-8d0a-408c-94c2-08098718f46b admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:22.460772 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beecb59-8d0a-408c-94c2-08098718f46b admin admin] PATH_INFO: `/v3/services` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:22.461521 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beecb59-8d0a-408c-94c2-08098718f46b admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:22.463118 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beecb59-8d0a-408c-94c2-08098718f46b admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:22.535040 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 395/787] 10.222.0.18 () {60 vars in 1162 bytes} [Tue Oct 12 18:05:22 2021] POST /identity/v3/services => generated 251 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:05:22.806044 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7787470f-aa79-4fa6-853c-0a71661178cd None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:22.806560 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7787470f-aa79-4fa6-853c-0a71661178cd None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:22.806560 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7787470f-aa79-4fa6-853c-0a71661178cd None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:22.808624 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 393/788] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:05:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:05:22.814980 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f5e170-c240-4d90-b895-d26826ac3e38 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:22.815271 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f5e170-c240-4d90-b895-d26826ac3e38 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:22.815549 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f5e170-c240-4d90-b895-d26826ac3e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:22.835044 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-39f5e170-c240-4d90-b895-d26826ac3e38 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:05:22.836236 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-39f5e170-c240-4d90-b895-d26826ac3e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:05:22.852693 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 396/789] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:05:22 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:05:22.856999 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a2898-2ed9-401f-a54c-6cd218d64f81 None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:22.857284 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a2898-2ed9-401f-a54c-6cd218d64f81 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:22.857559 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a2898-2ed9-401f-a54c-6cd218d64f81 None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:22.859544 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 394/790] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:05:22 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:05:22.865545 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7098f74e-02cf-41c8-a93b-477686246e49 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:22.865835 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7098f74e-02cf-41c8-a93b-477686246e49 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:22.866115 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7098f74e-02cf-41c8-a93b-477686246e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:22.875875 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a2898-2ed9-401f-a54c-6cd218d64f81 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:22.884607 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-7098f74e-02cf-41c8-a93b-477686246e49 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:05:22.885807 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-7098f74e-02cf-41c8-a93b-477686246e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:05:22.888973 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a2898-2ed9-401f-a54c-6cd218d64f81 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:22.893944 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23159d44-e6ac-480c-8979-18f4632b17f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:22.894075 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 397/791] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:05:22 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:05:22.895222 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23159d44-e6ac-480c-8979-18f4632b17f0 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:22.896217 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23159d44-e6ac-480c-8979-18f4632b17f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:22.896730 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23159d44-e6ac-480c-8979-18f4632b17f0 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:22.897627 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23159d44-e6ac-480c-8979-18f4632b17f0 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:22.899420 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23159d44-e6ac-480c-8979-18f4632b17f0 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:22.911655 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-23159d44-e6ac-480c-8979-18f4632b17f0 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 18:05:22.913437 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 395/792] 10.222.0.18 () {56 vars in 1147 bytes} [Tue Oct 12 18:05:22 2021] GET /identity/v3/services/object-store => generated 93 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:22.918218 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7098f74e-02cf-41c8-a93b-477686246e49 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:22.920596 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23159d44-e6ac-480c-8979-18f4632b17f0 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:22.928029 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7098f74e-02cf-41c8-a93b-477686246e49 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:22.931430 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23159d44-e6ac-480c-8979-18f4632b17f0 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:22.932650 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4addb7-770d-4de7-9da0-fc76a4b7dcb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:22.933452 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4addb7-770d-4de7-9da0-fc76a4b7dcb8 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:22.933731 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4addb7-770d-4de7-9da0-fc76a4b7dcb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:22.934005 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4addb7-770d-4de7-9da0-fc76a4b7dcb8 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:22.934668 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4addb7-770d-4de7-9da0-fc76a4b7dcb8 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:22.936265 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4addb7-770d-4de7-9da0-fc76a4b7dcb8 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:22.937639 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11cbe42-98f7-4660-aedf-8fe51815656a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:22.938562 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11cbe42-98f7-4660-aedf-8fe51815656a admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:22.939067 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11cbe42-98f7-4660-aedf-8fe51815656a admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:22.939566 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11cbe42-98f7-4660-aedf-8fe51815656a admin admin] PATH_INFO: `/v3/services` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:22.940576 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11cbe42-98f7-4660-aedf-8fe51815656a admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:22.941094 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11cbe42-98f7-4660-aedf-8fe51815656a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:22.943573 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11cbe42-98f7-4660-aedf-8fe51815656a admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:22.948596 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-9b4addb7-770d-4de7-9da0-fc76a4b7dcb8 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 12 18:05:22.948941 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 396/793] 10.222.0.18 () {56 vars in 1143 bytes} [Tue Oct 12 18:05:22 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:05:22.954369 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 398/794] 10.222.0.18 () {56 vars in 1153 bytes} [Tue Oct 12 18:05:22 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:22.955560 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11cbe42-98f7-4660-aedf-8fe51815656a admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:22.956342 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4addb7-770d-4de7-9da0-fc76a4b7dcb8 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:22.967136 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11cbe42-98f7-4660-aedf-8fe51815656a admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:22.967510 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4addb7-770d-4de7-9da0-fc76a4b7dcb8 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:22.972229 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e2f704-73af-44ac-b3b7-85a392c78d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:22.972845 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeee5b08-63bc-4f86-a6f3-68df99577242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:22.973088 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2f704-73af-44ac-b3b7-85a392c78d8a admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:22.973409 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2f704-73af-44ac-b3b7-85a392c78d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:22.973684 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2f704-73af-44ac-b3b7-85a392c78d8a admin admin] PATH_INFO: `/v3/services` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:22.974405 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e2f704-73af-44ac-b3b7-85a392c78d8a admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:22.974648 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee5b08-63bc-4f86-a6f3-68df99577242 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:22.974770 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e2f704-73af-44ac-b3b7-85a392c78d8a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:22.975298 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee5b08-63bc-4f86-a6f3-68df99577242 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:22.975787 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee5b08-63bc-4f86-a6f3-68df99577242 admin admin] PATH_INFO: `/v3/services` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:22.976284 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e2f704-73af-44ac-b3b7-85a392c78d8a admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:22.977005 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeee5b08-63bc-4f86-a6f3-68df99577242 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:22.977773 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeee5b08-63bc-4f86-a6f3-68df99577242 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:22.980219 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeee5b08-63bc-4f86-a6f3-68df99577242 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:22.981596 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 399/795] 10.222.0.18 () {56 vars in 1147 bytes} [Tue Oct 12 18:05:22 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:05:22.985804 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 397/796] 10.222.0.18 () {56 vars in 1143 bytes} [Tue Oct 12 18:05:22 2021] GET /identity/v3/services?type=object-store => generated 129 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:22.992438 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e2f704-73af-44ac-b3b7-85a392c78d8a admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:23.000250 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e2f704-73af-44ac-b3b7-85a392c78d8a admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:23.005355 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1714a33c-8ec1-4b72-acee-6918bca3b0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:23.006034 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714a33c-8ec1-4b72-acee-6918bca3b0f6 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:23.006314 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714a33c-8ec1-4b72-acee-6918bca3b0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:23.006589 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714a33c-8ec1-4b72-acee-6918bca3b0f6 admin admin] PATH_INFO: `/v3/services` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:23.007423 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1714a33c-8ec1-4b72-acee-6918bca3b0f6 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:23.007759 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1714a33c-8ec1-4b72-acee-6918bca3b0f6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:23.009500 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1714a33c-8ec1-4b72-acee-6918bca3b0f6 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:23.015548 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 400/797] 10.222.0.18 () {56 vars in 1147 bytes} [Tue Oct 12 18:05:22 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:23.023441 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeee5b08-63bc-4f86-a6f3-68df99577242 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:23.036482 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeee5b08-63bc-4f86-a6f3-68df99577242 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:23.041343 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2518915e-34cc-4caa-8da4-0442675be432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:23.042072 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518915e-34cc-4caa-8da4-0442675be432 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:23.042353 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518915e-34cc-4caa-8da4-0442675be432 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:23.042628 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518915e-34cc-4caa-8da4-0442675be432 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:23.043581 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2518915e-34cc-4caa-8da4-0442675be432 admin admin] RBAC: Adding query filter params (interface=public, service_id=5318bb3a5a924373ac832a28334fb858, region_id=RegionOne) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:23.043892 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2518915e-34cc-4caa-8da4-0442675be432 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:23.045665 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2518915e-34cc-4caa-8da4-0442675be432 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:23.051961 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 398/798] 10.222.0.18 () {56 vars in 1272 bytes} [Tue Oct 12 18:05:23 2021] GET /identity/v3/endpoints?service_id=5318bb3a5a924373ac832a28334fb858&interface=public®ion_id=RegionOne => generated 194 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:23.058665 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1714a33c-8ec1-4b72-acee-6918bca3b0f6 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:23.069027 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1714a33c-8ec1-4b72-acee-6918bca3b0f6 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:23.074353 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a96bbeb-a999-4732-ba65-5a9c7c23bdb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:23.075025 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96bbeb-a999-4732-ba65-5a9c7c23bdb9 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:23.075308 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96bbeb-a999-4732-ba65-5a9c7c23bdb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:23.075583 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96bbeb-a999-4732-ba65-5a9c7c23bdb9 admin admin] PATH_INFO: `/v3/services` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:23.076349 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a96bbeb-a999-4732-ba65-5a9c7c23bdb9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:23.078210 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a96bbeb-a999-4732-ba65-5a9c7c23bdb9 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:23.085589 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 401/799] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 12 18:05:23 2021] GET /identity/v3/services => generated 1268 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:05:24.394728 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece0ba7-4b19-4105-a1c2-3ba86efcab73 None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:24.395318 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece0ba7-4b19-4105-a1c2-3ba86efcab73 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:24.395318 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece0ba7-4b19-4105-a1c2-3ba86efcab73 None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:24.397423 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 399/800] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:05:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:05:24.403870 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974fc045-fd4d-465e-84e6-a7c6879bb966 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:24.404756 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974fc045-fd4d-465e-84e6-a7c6879bb966 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:24.405248 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974fc045-fd4d-465e-84e6-a7c6879bb966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:24.423261 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-974fc045-fd4d-465e-84e6-a7c6879bb966 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:05:24.424869 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-974fc045-fd4d-465e-84e6-a7c6879bb966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:05:24.440501 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 402/801] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:05:24 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:05:24.458365 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eece0ba7-4b19-4105-a1c2-3ba86efcab73 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:24.471040 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eece0ba7-4b19-4105-a1c2-3ba86efcab73 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:24.475779 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9807af-3368-4c6e-a9ae-b8cc678f424b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:24.476871 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9807af-3368-4c6e-a9ae-b8cc678f424b admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:24.477368 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9807af-3368-4c6e-a9ae-b8cc678f424b admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:24.477854 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9807af-3368-4c6e-a9ae-b8cc678f424b admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:24.489737 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9807af-3368-4c6e-a9ae-b8cc678f424b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 18:05:24.497422 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-7e9807af-3368-4c6e-a9ae-b8cc678f424b admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 12 18:05:24.504524 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 400/802] 10.222.0.18 () {56 vars in 1141 bytes} [Tue Oct 12 18:05:24 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:24.506049 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974fc045-fd4d-465e-84e6-a7c6879bb966 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:24.515228 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974fc045-fd4d-465e-84e6-a7c6879bb966 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:24.520860 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d18f79-ad63-4888-a4f7-a4f8f2bf1f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:24.521749 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d18f79-ad63-4888-a4f7-a4f8f2bf1f3a admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:24.522263 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d18f79-ad63-4888-a4f7-a4f8f2bf1f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:24.522741 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d18f79-ad63-4888-a4f7-a4f8f2bf1f3a admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:24.523720 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d18f79-ad63-4888-a4f7-a4f8f2bf1f3a admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:24.524236 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d18f79-ad63-4888-a4f7-a4f8f2bf1f3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:24.526082 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d18f79-ad63-4888-a4f7-a4f8f2bf1f3a admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:24.539971 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 403/803] 10.222.0.18 () {56 vars in 1136 bytes} [Tue Oct 12 18:05:24 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:24.541611 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9807af-3368-4c6e-a9ae-b8cc678f424b admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:24.552338 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9807af-3368-4c6e-a9ae-b8cc678f424b admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:24.557164 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e397081-ac56-422d-880f-d2e6a8c8b548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:24.558180 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e397081-ac56-422d-880f-d2e6a8c8b548 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:24.558715 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e397081-ac56-422d-880f-d2e6a8c8b548 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:24.559197 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e397081-ac56-422d-880f-d2e6a8c8b548 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:24.570569 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e397081-ac56-422d-880f-d2e6a8c8b548 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:24.572681 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e397081-ac56-422d-880f-d2e6a8c8b548 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:24.590425 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-0e397081-ac56-422d-880f-d2e6a8c8b548 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 18:05:24.596494 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 401/804] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:05:24 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 18:05:24.598997 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d18f79-ad63-4888-a4f7-a4f8f2bf1f3a admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:24.609032 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d18f79-ad63-4888-a4f7-a4f8f2bf1f3a admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:24.620349 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75bb438-abf3-41e5-9a91-9703b47392f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:24.621379 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75bb438-abf3-41e5-9a91-9703b47392f5 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:24.621909 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75bb438-abf3-41e5-9a91-9703b47392f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:24.622575 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75bb438-abf3-41e5-9a91-9703b47392f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:24.624157 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75bb438-abf3-41e5-9a91-9703b47392f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:24.624850 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75bb438-abf3-41e5-9a91-9703b47392f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:24.626827 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75bb438-abf3-41e5-9a91-9703b47392f5 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:24.648590 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 404/805] 10.222.0.18 () {56 vars in 1130 bytes} [Tue Oct 12 18:05:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:24.651516 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e397081-ac56-422d-880f-d2e6a8c8b548 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:24.662005 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e397081-ac56-422d-880f-d2e6a8c8b548 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:24.666978 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d0635e-d870-4460-ac6f-6a7d93f65cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:24.668034 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d0635e-d870-4460-ac6f-6a7d93f65cfc admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:24.668564 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d0635e-d870-4460-ac6f-6a7d93f65cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:24.669050 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d0635e-d870-4460-ac6f-6a7d93f65cfc admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:24.677734 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d0635e-d870-4460-ac6f-6a7d93f65cfc admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:24.680069 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d0635e-d870-4460-ac6f-6a7d93f65cfc admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:24.695286 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-a7d0635e-d870-4460-ac6f-6a7d93f65cfc admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 12 18:05:24.700510 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 402/806] 10.222.0.18 () {56 vars in 1138 bytes} [Tue Oct 12 18:05:24 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:24.703863 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75bb438-abf3-41e5-9a91-9703b47392f5 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:24.715026 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75bb438-abf3-41e5-9a91-9703b47392f5 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:24.720440 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a116b671-7d6c-4481-8865-4b3f74ee2728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:24.721576 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a116b671-7d6c-4481-8865-4b3f74ee2728 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:24.722082 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a116b671-7d6c-4481-8865-4b3f74ee2728 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:24.722611 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a116b671-7d6c-4481-8865-4b3f74ee2728 admin admin] PATH_INFO: `/v3/users` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:24.723786 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a116b671-7d6c-4481-8865-4b3f74ee2728 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:24.724369 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a116b671-7d6c-4481-8865-4b3f74ee2728 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:24.726618 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a116b671-7d6c-4481-8865-4b3f74ee2728 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:24.752142 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 405/807] 10.222.0.18 () {56 vars in 1170 bytes} [Tue Oct 12 18:05:24 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:24.754944 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d0635e-d870-4460-ac6f-6a7d93f65cfc admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:24.765423 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d0635e-d870-4460-ac6f-6a7d93f65cfc admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:24.771206 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc56b6c-4b39-485f-8af0-e99631769cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:24.772311 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc56b6c-4b39-485f-8af0-e99631769cb5 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:24.772842 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc56b6c-4b39-485f-8af0-e99631769cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:24.773374 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc56b6c-4b39-485f-8af0-e99631769cb5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:24.784570 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc56b6c-4b39-485f-8af0-e99631769cb5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:24.786816 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc56b6c-4b39-485f-8af0-e99631769cb5 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:24.804869 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-7cc56b6c-4b39-485f-8af0-e99631769cb5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 18:05:24.811759 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 403/808] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:05:24 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:24.813357 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a116b671-7d6c-4481-8865-4b3f74ee2728 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:24.824084 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a116b671-7d6c-4481-8865-4b3f74ee2728 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:24.829151 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e213fd-06c9-4bc1-9092-be429195b4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:24.830150 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e213fd-06c9-4bc1-9092-be429195b4ff admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:24.830655 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e213fd-06c9-4bc1-9092-be429195b4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:24.831136 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e213fd-06c9-4bc1-9092-be429195b4ff admin admin] PATH_INFO: `/v3/domains` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:24.832086 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e213fd-06c9-4bc1-9092-be429195b4ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:24.832718 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e213fd-06c9-4bc1-9092-be429195b4ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:24.834534 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e213fd-06c9-4bc1-9092-be429195b4ff admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:24.852511 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 406/809] 10.222.0.18 () {56 vars in 1130 bytes} [Tue Oct 12 18:05:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:24.854240 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc56b6c-4b39-485f-8af0-e99631769cb5 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:24.865030 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc56b6c-4b39-485f-8af0-e99631769cb5 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:24.866893 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13432d56-b68d-49d0-9f77-9ebf687c18de None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:24.867414 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13432d56-b68d-49d0-9f77-9ebf687c18de None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:24.867895 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13432d56-b68d-49d0-9f77-9ebf687c18de None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:24.869741 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b28c80e-78ba-4a6f-8d69-db9d749cf68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:24.870417 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 407/810] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:05:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:05:24.873623 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b28c80e-78ba-4a6f-8d69-db9d749cf68c admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:24.873623 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b28c80e-78ba-4a6f-8d69-db9d749cf68c admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:24.873623 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b28c80e-78ba-4a6f-8d69-db9d749cf68c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:24.877073 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3b9f2-517b-451a-aad6-1ec9aca99f76 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:24.877626 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3b9f2-517b-451a-aad6-1ec9aca99f76 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:24.878113 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3b9f2-517b-451a-aad6-1ec9aca99f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:24.879253 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b28c80e-78ba-4a6f-8d69-db9d749cf68c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:24.882066 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b28c80e-78ba-4a6f-8d69-db9d749cf68c admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:24.897134 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-2b28c80e-78ba-4a6f-8d69-db9d749cf68c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 18:05:24.898102 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-c8d3b9f2-517b-451a-aad6-1ec9aca99f76 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:05:24.899572 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-c8d3b9f2-517b-451a-aad6-1ec9aca99f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:05:24.903932 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 404/811] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Oct 12 18:05:24 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:24.905258 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b28c80e-78ba-4a6f-8d69-db9d749cf68c admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:24.915118 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 408/812] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:05:24 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:05:24.916443 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b28c80e-78ba-4a6f-8d69-db9d749cf68c admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:24.924674 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34744f1-35d4-4151-9616-388f2979e75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:24.925431 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34744f1-35d4-4151-9616-388f2979e75e admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:24.925786 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34744f1-35d4-4151-9616-388f2979e75e admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:24.926206 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34744f1-35d4-4151-9616-388f2979e75e admin admin] PATH_INFO: `/v3/projects` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:24.927170 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34744f1-35d4-4151-9616-388f2979e75e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:24.927597 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34744f1-35d4-4151-9616-388f2979e75e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:24.929710 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34744f1-35d4-4151-9616-388f2979e75e admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:24.938633 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d3b9f2-517b-451a-aad6-1ec9aca99f76 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:24.943474 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 405/813] 10.222.0.18 () {56 vars in 1169 bytes} [Tue Oct 12 18:05:24 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:05:24.948482 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d3b9f2-517b-451a-aad6-1ec9aca99f76 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:24.950185 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34744f1-35d4-4151-9616-388f2979e75e admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:24.953190 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e90973f-058d-475f-ad6f-4a7243056a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:24.954063 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e90973f-058d-475f-ad6f-4a7243056a05 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:24.954416 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e90973f-058d-475f-ad6f-4a7243056a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:24.954764 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e90973f-058d-475f-ad6f-4a7243056a05 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:24.955506 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e90973f-058d-475f-ad6f-4a7243056a05 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:24.957216 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e90973f-058d-475f-ad6f-4a7243056a05 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:24.960857 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34744f1-35d4-4151-9616-388f2979e75e admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:24.965439 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbde4d1-f62c-4c34-acae-926944c78306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:24.966315 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbde4d1-f62c-4c34-acae-926944c78306 admin admin] REQUEST_METHOD: `PUT` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:24.966595 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbde4d1-f62c-4c34-acae-926944c78306 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:24.966869 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbde4d1-f62c-4c34-acae-926944c78306 admin admin] PATH_INFO: `/v3/projects/e843aaa9e5e44a8e98f7cc7412d9697b/users/8f6a3a7064754fb79a0a06b3ad4a7d05/roles/d7656b67d66f4c2d81879698f36ca670` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:24.969173 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbde4d1-f62c-4c34-acae-926944c78306 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e843aaa9e5e44a8e98f7cc7412d9697b, user_id=8f6a3a7064754fb79a0a06b3ad4a7d05, role_id=d7656b67d66f4c2d81879698f36ca670)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:24.969661 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-5e90973f-058d-475f-ad6f-4a7243056a05 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 12 18:05:24.971291 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 409/814] 10.222.0.18 () {56 vars in 1135 bytes} [Tue Oct 12 18:05:24 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:24.971917 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbde4d1-f62c-4c34-acae-926944c78306 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:24.979588 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e90973f-058d-475f-ad6f-4a7243056a05 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:24.989614 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e90973f-058d-475f-ad6f-4a7243056a05 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:24.994135 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c8f2a9-e0f0-48dd-adf3-008cd4922a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:24.994777 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c8f2a9-e0f0-48dd-adf3-008cd4922a64 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:24.995058 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c8f2a9-e0f0-48dd-adf3-008cd4922a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:24.995328 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c8f2a9-e0f0-48dd-adf3-008cd4922a64 admin admin] PATH_INFO: `/v3/services` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:24.996037 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c8f2a9-e0f0-48dd-adf3-008cd4922a64 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:24.996352 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c8f2a9-e0f0-48dd-adf3-008cd4922a64 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:24.998047 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c8f2a9-e0f0-48dd-adf3-008cd4922a64 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:25.007345 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 410/815] 10.222.0.18 () {56 vars in 1135 bytes} [Tue Oct 12 18:05:24 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:25.009968 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c8f2a9-e0f0-48dd-adf3-008cd4922a64 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:25.019743 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c8f2a9-e0f0-48dd-adf3-008cd4922a64 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:25.035323 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dd79c2-6f74-4096-8e5e-9a79b9fdc313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:25.035323 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd79c2-6f74-4096-8e5e-9a79b9fdc313 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:25.035323 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd79c2-6f74-4096-8e5e-9a79b9fdc313 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:25.035323 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd79c2-6f74-4096-8e5e-9a79b9fdc313 admin admin] PATH_INFO: `/v3/services` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:25.035667 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dd79c2-6f74-4096-8e5e-9a79b9fdc313 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:25.035667 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dd79c2-6f74-4096-8e5e-9a79b9fdc313 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:25.035667 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dd79c2-6f74-4096-8e5e-9a79b9fdc313 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:25.035667 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 411/816] 10.222.0.18 () {56 vars in 1135 bytes} [Tue Oct 12 18:05:25 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:05:25.039911 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dd79c2-6f74-4096-8e5e-9a79b9fdc313 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:25.049737 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dd79c2-6f74-4096-8e5e-9a79b9fdc313 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:25.054301 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6ac67a-3649-47e8-8a94-a905b22ec8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:25.054956 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6ac67a-3649-47e8-8a94-a905b22ec8dd admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:25.055237 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6ac67a-3649-47e8-8a94-a905b22ec8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:25.055513 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6ac67a-3649-47e8-8a94-a905b22ec8dd admin admin] PATH_INFO: `/v3/endpoints` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:25.056309 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6ac67a-3649-47e8-8a94-a905b22ec8dd admin admin] RBAC: Adding query filter params (interface=public, service_id=cbbb024e7ab84c708aee50aa5144161c, region_id=RegionOne) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:25.056650 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6ac67a-3649-47e8-8a94-a905b22ec8dd admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:25.058453 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6ac67a-3649-47e8-8a94-a905b22ec8dd admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:25.064447 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 412/817] 10.222.0.18 () {56 vars in 1272 bytes} [Tue Oct 12 18:05:25 2021] GET /identity/v3/endpoints?service_id=cbbb024e7ab84c708aee50aa5144161c&interface=public®ion_id=RegionOne => generated 194 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:05:25.071051 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6ac67a-3649-47e8-8a94-a905b22ec8dd admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:25.076247 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 406/818] 10.222.0.18 () {58 vars in 1460 bytes} [Tue Oct 12 18:05:24 2021] PUT /identity/v3/projects/e843aaa9e5e44a8e98f7cc7412d9697b/users/8f6a3a7064754fb79a0a06b3ad4a7d05/roles/d7656b67d66f4c2d81879698f36ca670 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 18:05:25.082308 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6ac67a-3649-47e8-8a94-a905b22ec8dd admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:25.143746 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c813441c-da5c-4020-86e5-94144175b5e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:25.144472 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c813441c-da5c-4020-86e5-94144175b5e1 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:25.144833 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c813441c-da5c-4020-86e5-94144175b5e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:25.145659 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c813441c-da5c-4020-86e5-94144175b5e1 admin admin] PATH_INFO: `/v3/services` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:25.146371 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c813441c-da5c-4020-86e5-94144175b5e1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:25.148018 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c813441c-da5c-4020-86e5-94144175b5e1 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:25.222399 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 413/819] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 12 18:05:25 2021] GET /identity/v3/services => generated 1268 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:05:25.344496 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec4a38-0853-49fd-81a7-dd2284b639f8 None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:25.344814 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec4a38-0853-49fd-81a7-dd2284b639f8 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:25.345061 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec4a38-0853-49fd-81a7-dd2284b639f8 None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:25.347188 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 407/820] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:05:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:05:25.354116 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f66a2-3cfd-470f-9f77-35407f29ff71 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:25.354429 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f66a2-3cfd-470f-9f77-35407f29ff71 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:25.354673 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f66a2-3cfd-470f-9f77-35407f29ff71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:25.373891 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-576f66a2-3cfd-470f-9f77-35407f29ff71 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:05:25.375100 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-576f66a2-3cfd-470f-9f77-35407f29ff71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:05:25.383679 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 414/821] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:05:25 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:05:25.396816 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ca208-01a2-471d-94c4-a5226c1262d4 None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:25.397336 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ca208-01a2-471d-94c4-a5226c1262d4 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:25.397336 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ca208-01a2-471d-94c4-a5226c1262d4 None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:25.399422 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 408/822] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:05:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:05:25.405950 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21abb827-a3c1-4cce-a259-d64ad9429028 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:25.406465 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21abb827-a3c1-4cce-a259-d64ad9429028 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:25.406465 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21abb827-a3c1-4cce-a259-d64ad9429028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:25.411317 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1ca208-01a2-471d-94c4-a5226c1262d4 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:25.423949 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1ca208-01a2-471d-94c4-a5226c1262d4 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:25.425817 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-21abb827-a3c1-4cce-a259-d64ad9429028 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:05:25.427562 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-21abb827-a3c1-4cce-a259-d64ad9429028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:05:25.429863 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc7afa6-b98a-42e4-ba48-b825aab23606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:25.430793 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc7afa6-b98a-42e4-ba48-b825aab23606 admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:25.431272 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc7afa6-b98a-42e4-ba48-b825aab23606 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:25.431754 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc7afa6-b98a-42e4-ba48-b825aab23606 admin admin] PATH_INFO: `/v3/services` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:25.432760 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc7afa6-b98a-42e4-ba48-b825aab23606 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:25.434553 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc7afa6-b98a-42e4-ba48-b825aab23606 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:25.435940 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 415/823] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:05:25 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:05:25.463609 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21abb827-a3c1-4cce-a259-d64ad9429028 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:25.472889 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21abb827-a3c1-4cce-a259-d64ad9429028 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:25.477995 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9e52a0-3c38-4047-9659-0073dc08a02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:25.478956 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9e52a0-3c38-4047-9659-0073dc08a02e admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:25.479245 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9e52a0-3c38-4047-9659-0073dc08a02e admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:25.479518 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9e52a0-3c38-4047-9659-0073dc08a02e admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:25.480187 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9e52a0-3c38-4047-9659-0073dc08a02e admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:25.481830 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9e52a0-3c38-4047-9659-0073dc08a02e admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:25.494222 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-4b9e52a0-3c38-4047-9659-0073dc08a02e admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 12 18:05:25.495716 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 416/824] 10.222.0.18 () {56 vars in 1153 bytes} [Tue Oct 12 18:05:25 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 18:05:25.503049 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9e52a0-3c38-4047-9659-0073dc08a02e admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:25.520733 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 409/825] 10.222.0.18 () {60 vars in 1162 bytes} [Tue Oct 12 18:05:25 2021] POST /identity/v3/services => generated 241 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 18:05:25.520896 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9e52a0-3c38-4047-9659-0073dc08a02e admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:25.538523 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c00ccd4-1f49-4735-b6b4-8fda7da08c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:25.539515 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c00ccd4-1f49-4735-b6b4-8fda7da08c2e admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:25.539942 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c00ccd4-1f49-4735-b6b4-8fda7da08c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:25.542803 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c00ccd4-1f49-4735-b6b4-8fda7da08c2e admin admin] PATH_INFO: `/v3/services` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:25.542803 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c00ccd4-1f49-4735-b6b4-8fda7da08c2e admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:25.542803 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c00ccd4-1f49-4735-b6b4-8fda7da08c2e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:25.543416 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c00ccd4-1f49-4735-b6b4-8fda7da08c2e admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:25.549561 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 417/826] 10.222.0.18 () {56 vars in 1147 bytes} [Tue Oct 12 18:05:25 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:05:25.557653 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc7afa6-b98a-42e4-ba48-b825aab23606 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:25.568896 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc7afa6-b98a-42e4-ba48-b825aab23606 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:25.573989 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e6bc28-8458-4c05-97a8-87a0aa412f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:25.574669 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6bc28-8458-4c05-97a8-87a0aa412f5a admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:25.575011 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6bc28-8458-4c05-97a8-87a0aa412f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:25.575338 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6bc28-8458-4c05-97a8-87a0aa412f5a admin admin] PATH_INFO: `/v3/services` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:25.576164 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e6bc28-8458-4c05-97a8-87a0aa412f5a admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:25.576509 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e6bc28-8458-4c05-97a8-87a0aa412f5a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:25.578282 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e6bc28-8458-4c05-97a8-87a0aa412f5a admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:25.584821 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 410/827] 10.222.0.18 () {56 vars in 1147 bytes} [Tue Oct 12 18:05:25 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:25.591486 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c00ccd4-1f49-4735-b6b4-8fda7da08c2e admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:25.602811 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c00ccd4-1f49-4735-b6b4-8fda7da08c2e admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:25.607842 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbf18d8-2f0c-4b94-b400-4aaab71fff14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:25.608738 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf18d8-2f0c-4b94-b400-4aaab71fff14 admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:25.609031 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf18d8-2f0c-4b94-b400-4aaab71fff14 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:25.609305 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf18d8-2f0c-4b94-b400-4aaab71fff14 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:25.610142 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbf18d8-2f0c-4b94-b400-4aaab71fff14 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:25.614665 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbf18d8-2f0c-4b94-b400-4aaab71fff14 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:25.706208 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 418/828] 10.222.0.18 () {60 vars in 1165 bytes} [Tue Oct 12 18:05:25 2021] POST /identity/v3/endpoints => generated 347 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:05:27.383602 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455cfe5a-e15f-42fe-97df-2a95e7655a7a None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:27.384146 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455cfe5a-e15f-42fe-97df-2a95e7655a7a None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:27.384146 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455cfe5a-e15f-42fe-97df-2a95e7655a7a None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:27.386150 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 411/829] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:05:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:05:27.392633 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef5a97-92b0-4ab8-9fe3-faf36b9611f3 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:27.393122 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef5a97-92b0-4ab8-9fe3-faf36b9611f3 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:27.393198 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef5a97-92b0-4ab8-9fe3-faf36b9611f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:27.412297 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-eeef5a97-92b0-4ab8-9fe3-faf36b9611f3 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:05:27.413558 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-eeef5a97-92b0-4ab8-9fe3-faf36b9611f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:05:27.433045 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 419/830] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:05:27 2021] POST /identity/v3/auth/tokens => generated 2105 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:05:27.459666 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455cfe5a-e15f-42fe-97df-2a95e7655a7a None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:27.477746 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455cfe5a-e15f-42fe-97df-2a95e7655a7a None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:27.482237 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6c728e-60f2-4746-93a0-6992e26b6c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:27.483040 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c728e-60f2-4746-93a0-6992e26b6c21 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:27.483317 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c728e-60f2-4746-93a0-6992e26b6c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:27.483587 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c728e-60f2-4746-93a0-6992e26b6c21 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:27.494669 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6c728e-60f2-4746-93a0-6992e26b6c21 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 18:05:27.502097 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-aa6c728e-60f2-4746-93a0-6992e26b6c21 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 12 18:05:27.503619 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 412/831] 10.222.0.18 () {56 vars in 1141 bytes} [Tue Oct 12 18:05:27 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:27.510760 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeef5a97-92b0-4ab8-9fe3-faf36b9611f3 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:27.520033 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeef5a97-92b0-4ab8-9fe3-faf36b9611f3 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:27.525750 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6b5831-be28-4b84-93d2-6a9290cae531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:27.526415 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b5831-be28-4b84-93d2-6a9290cae531 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:27.526697 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b5831-be28-4b84-93d2-6a9290cae531 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:27.527066 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b5831-be28-4b84-93d2-6a9290cae531 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:27.527863 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6b5831-be28-4b84-93d2-6a9290cae531 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:27.528171 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6b5831-be28-4b84-93d2-6a9290cae531 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:27.529882 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6b5831-be28-4b84-93d2-6a9290cae531 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:27.538959 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 420/832] 10.222.0.18 () {56 vars in 1136 bytes} [Tue Oct 12 18:05:27 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:27.545450 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6c728e-60f2-4746-93a0-6992e26b6c21 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:27.555008 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b84cd4-8c78-4f9d-a4ce-410e9bd90c04 None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:27.555296 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b84cd4-8c78-4f9d-a4ce-410e9bd90c04 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:27.555568 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b84cd4-8c78-4f9d-a4ce-410e9bd90c04 None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:27.557704 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 421/833] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:05:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 18:05:27.559995 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6c728e-60f2-4746-93a0-6992e26b6c21 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:27.563643 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5047161-559c-461b-8c5c-e4c4264c57ba None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:27.563943 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5047161-559c-461b-8c5c-e4c4264c57ba None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:27.564296 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5047161-559c-461b-8c5c-e4c4264c57ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:27.565870 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df13fea-65e9-458a-ac67-80377ab65e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:27.567681 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df13fea-65e9-458a-ac67-80377ab65e88 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:27.568174 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df13fea-65e9-458a-ac67-80377ab65e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:27.568650 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df13fea-65e9-458a-ac67-80377ab65e88 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:27.580440 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df13fea-65e9-458a-ac67-80377ab65e88 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:27.583217 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df13fea-65e9-458a-ac67-80377ab65e88 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:27.583652 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-b5047161-559c-461b-8c5c-e4c4264c57ba None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:05:27.585210 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-b5047161-559c-461b-8c5c-e4c4264c57ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:05:27.594119 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 422/834] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:05:27 2021] POST /identity/v3/auth/tokens => generated 2105 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:05:27.602833 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-9df13fea-65e9-458a-ac67-80377ab65e88 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 18:05:27.604522 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 413/835] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:05:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:27.610917 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5047161-559c-461b-8c5c-e4c4264c57ba None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:27.621518 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df13fea-65e9-458a-ac67-80377ab65e88 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:27.621759 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5047161-559c-461b-8c5c-e4c4264c57ba None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:27.626489 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bf718c-16fe-4de3-8e5c-c0f411879cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:27.627158 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf718c-16fe-4de3-8e5c-c0f411879cb9 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:27.627439 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf718c-16fe-4de3-8e5c-c0f411879cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:27.627713 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf718c-16fe-4de3-8e5c-c0f411879cb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:27.629654 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bf718c-16fe-4de3-8e5c-c0f411879cb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:27.629974 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bf718c-16fe-4de3-8e5c-c0f411879cb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:27.631616 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bf718c-16fe-4de3-8e5c-c0f411879cb9 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:27.642430 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df13fea-65e9-458a-ac67-80377ab65e88 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:27.644583 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 423/836] 10.222.0.18 () {56 vars in 1130 bytes} [Tue Oct 12 18:05:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:27.648095 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e121f75-5bd0-4c41-bac7-2191c7b33cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:27.652484 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e121f75-5bd0-4c41-bac7-2191c7b33cf1 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:27.652484 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e121f75-5bd0-4c41-bac7-2191c7b33cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:27.652484 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e121f75-5bd0-4c41-bac7-2191c7b33cf1 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:27.652484 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e121f75-5bd0-4c41-bac7-2191c7b33cf1 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:27.652807 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bf718c-16fe-4de3-8e5c-c0f411879cb9 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:27.652880 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e121f75-5bd0-4c41-bac7-2191c7b33cf1 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:27.660807 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bf718c-16fe-4de3-8e5c-c0f411879cb9 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:27.665340 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-9e121f75-5bd0-4c41-bac7-2191c7b33cf1 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 12 18:05:27.665461 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cdde9f-7bda-4537-8954-00d975f52bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:27.666144 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cdde9f-7bda-4537-8954-00d975f52bc9 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:27.666425 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cdde9f-7bda-4537-8954-00d975f52bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:27.666695 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cdde9f-7bda-4537-8954-00d975f52bc9 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:27.667734 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 414/837] 10.222.0.18 () {56 vars in 1135 bytes} [Tue Oct 12 18:05:27 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:27.674375 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e121f75-5bd0-4c41-bac7-2191c7b33cf1 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:27.678537 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cdde9f-7bda-4537-8954-00d975f52bc9 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:27.680771 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cdde9f-7bda-4537-8954-00d975f52bc9 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:27.686254 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e121f75-5bd0-4c41-bac7-2191c7b33cf1 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:27.691034 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92689e9c-1fdc-4325-b1ba-766512051149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:27.691835 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92689e9c-1fdc-4325-b1ba-766512051149 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:27.692766 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92689e9c-1fdc-4325-b1ba-766512051149 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:27.693141 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92689e9c-1fdc-4325-b1ba-766512051149 admin admin] PATH_INFO: `/v3/services` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:27.693961 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92689e9c-1fdc-4325-b1ba-766512051149 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:27.694361 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92689e9c-1fdc-4325-b1ba-766512051149 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:27.696033 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92689e9c-1fdc-4325-b1ba-766512051149 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:27.699112 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-40cdde9f-7bda-4537-8954-00d975f52bc9 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 12 18:05:27.701095 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 424/838] 10.222.0.18 () {56 vars in 1138 bytes} [Tue Oct 12 18:05:27 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:27.704544 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 415/839] 10.222.0.18 () {56 vars in 1135 bytes} [Tue Oct 12 18:05:27 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:05:27.707287 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cdde9f-7bda-4537-8954-00d975f52bc9 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:27.713055 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92689e9c-1fdc-4325-b1ba-766512051149 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:27.725586 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cdde9f-7bda-4537-8954-00d975f52bc9 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:27.726605 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92689e9c-1fdc-4325-b1ba-766512051149 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:27.731165 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c3a361-0961-40d4-9caf-bafa3f14b719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:27.731571 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e11b0b3-adde-4cab-9f28-dffd5501dd3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:27.731814 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3a361-0961-40d4-9caf-bafa3f14b719 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:27.732093 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3a361-0961-40d4-9caf-bafa3f14b719 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:27.732364 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3a361-0961-40d4-9caf-bafa3f14b719 admin admin] PATH_INFO: `/v3/services` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:27.733098 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e11b0b3-adde-4cab-9f28-dffd5501dd3d admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:27.733219 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c3a361-0961-40d4-9caf-bafa3f14b719 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:27.733406 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c3a361-0961-40d4-9caf-bafa3f14b719 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:27.733939 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e11b0b3-adde-4cab-9f28-dffd5501dd3d admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:27.734420 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e11b0b3-adde-4cab-9f28-dffd5501dd3d admin admin] PATH_INFO: `/v3/users` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:27.735003 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c3a361-0961-40d4-9caf-bafa3f14b719 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:27.735730 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e11b0b3-adde-4cab-9f28-dffd5501dd3d admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:27.736230 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e11b0b3-adde-4cab-9f28-dffd5501dd3d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:27.738335 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e11b0b3-adde-4cab-9f28-dffd5501dd3d admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:27.741048 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 416/840] 10.222.0.18 () {56 vars in 1135 bytes} [Tue Oct 12 18:05:27 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:27.747593 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c3a361-0961-40d4-9caf-bafa3f14b719 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:27.758439 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c3a361-0961-40d4-9caf-bafa3f14b719 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:27.762785 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 425/841] 10.222.0.18 () {56 vars in 1170 bytes} [Tue Oct 12 18:05:27 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:05:27.768848 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b74239-1dff-4162-96cd-b231696ffcff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:27.768848 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b74239-1dff-4162-96cd-b231696ffcff admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:27.768848 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b74239-1dff-4162-96cd-b231696ffcff admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:27.768848 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b74239-1dff-4162-96cd-b231696ffcff admin admin] PATH_INFO: `/v3/endpoints` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:27.769255 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b74239-1dff-4162-96cd-b231696ffcff admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:27.769255 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b74239-1dff-4162-96cd-b231696ffcff admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:27.770801 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e11b0b3-adde-4cab-9f28-dffd5501dd3d admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:27.782311 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e11b0b3-adde-4cab-9f28-dffd5501dd3d admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:27.787524 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0322da8-9660-4bad-8440-47b4833ef016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:27.788224 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0322da8-9660-4bad-8440-47b4833ef016 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:27.788557 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0322da8-9660-4bad-8440-47b4833ef016 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:27.788828 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0322da8-9660-4bad-8440-47b4833ef016 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:27.796808 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0322da8-9660-4bad-8440-47b4833ef016 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:27.798586 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0322da8-9660-4bad-8440-47b4833ef016 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:27.808039 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 426/842] 10.222.0.18 () {58 vars in 1324 bytes} [Tue Oct 12 18:05:27 2021] GET /identity/v3/auth/tokens => generated 2105 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:05:27.813980 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0322da8-9660-4bad-8440-47b4833ef016 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:27.822158 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0322da8-9660-4bad-8440-47b4833ef016 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:27.826652 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d3232e-84d1-4866-ba75-742f004e72c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:27.827399 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d3232e-84d1-4866-ba75-742f004e72c4 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:27.827678 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d3232e-84d1-4866-ba75-742f004e72c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:27.827952 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d3232e-84d1-4866-ba75-742f004e72c4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:27.838374 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d3232e-84d1-4866-ba75-742f004e72c4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:27.841141 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d3232e-84d1-4866-ba75-742f004e72c4 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:27.864770 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-d6d3232e-84d1-4866-ba75-742f004e72c4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 18:05:27.865213 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 417/844] 10.222.0.18 () {60 vars in 1165 bytes} [Tue Oct 12 18:05:27 2021] POST /identity/v3/endpoints => generated 346 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:05:27.869963 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 427/844] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:05:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 18:05:27.871418 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b74239-1dff-4162-96cd-b231696ffcff admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:27.907066 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e687eba-657f-4a47-8b61-1602a44d7050 None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:27.907265 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b74239-1dff-4162-96cd-b231696ffcff admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:27.907349 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e687eba-657f-4a47-8b61-1602a44d7050 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:27.907595 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e687eba-657f-4a47-8b61-1602a44d7050 None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:27.909969 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 428/845] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:05:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 18:05:27.912167 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d885cb8-422b-4a72-92b1-8c3798d3d449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:27.912890 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d885cb8-422b-4a72-92b1-8c3798d3d449 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:27.913170 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d885cb8-422b-4a72-92b1-8c3798d3d449 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:27.913443 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d885cb8-422b-4a72-92b1-8c3798d3d449 admin admin] PATH_INFO: `/v3/domains` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:27.914190 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d885cb8-422b-4a72-92b1-8c3798d3d449 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:27.914499 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d885cb8-422b-4a72-92b1-8c3798d3d449 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:27.916158 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d885cb8-422b-4a72-92b1-8c3798d3d449 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:27.918743 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39efea49-c24b-4fa8-ac5d-7667667da107 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:27.919933 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39efea49-c24b-4fa8-ac5d-7667667da107 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:27.920363 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39efea49-c24b-4fa8-ac5d-7667667da107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:27.936339 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 418/846] 10.222.0.18 () {56 vars in 1130 bytes} [Tue Oct 12 18:05:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:27.937838 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d885cb8-422b-4a72-92b1-8c3798d3d449 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:27.943216 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-39efea49-c24b-4fa8-ac5d-7667667da107 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:05:27.944562 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-39efea49-c24b-4fa8-ac5d-7667667da107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:05:27.950064 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d885cb8-422b-4a72-92b1-8c3798d3d449 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:27.960022 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 429/847] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:05:27 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:05:27.961077 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d12b7c9-0e44-474e-a281-120b7c96bac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:27.961945 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d12b7c9-0e44-474e-a281-120b7c96bac2 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:27.962227 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d12b7c9-0e44-474e-a281-120b7c96bac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:27.962543 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d12b7c9-0e44-474e-a281-120b7c96bac2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:27.970681 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d12b7c9-0e44-474e-a281-120b7c96bac2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:27.972852 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d12b7c9-0e44-474e-a281-120b7c96bac2 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:27.982878 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39efea49-c24b-4fa8-ac5d-7667667da107 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:27.988209 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-9d12b7c9-0e44-474e-a281-120b7c96bac2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 18:05:27.995369 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 419/848] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Oct 12 18:05:27 2021] GET /identity/v3/projects/service => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 18:05:27.997427 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d12b7c9-0e44-474e-a281-120b7c96bac2 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:27.997615 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39efea49-c24b-4fa8-ac5d-7667667da107 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:28.002649 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b70892-73b9-42d4-839b-66b8e16a5a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:28.003539 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b70892-73b9-42d4-839b-66b8e16a5a48 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:28.003817 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b70892-73b9-42d4-839b-66b8e16a5a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:28.004131 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b70892-73b9-42d4-839b-66b8e16a5a48 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:28.005372 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b70892-73b9-42d4-839b-66b8e16a5a48 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:28.007083 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b70892-73b9-42d4-839b-66b8e16a5a48 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:28.009992 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d12b7c9-0e44-474e-a281-120b7c96bac2 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:28.015055 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02a7147-866f-407c-99a0-dc3e2d322a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:28.016339 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a7147-866f-407c-99a0-dc3e2d322a40 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:28.016850 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a7147-866f-407c-99a0-dc3e2d322a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:28.017323 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a7147-866f-407c-99a0-dc3e2d322a40 admin admin] PATH_INFO: `/v3/projects` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:28.018363 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02a7147-866f-407c-99a0-dc3e2d322a40 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:28.018878 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02a7147-866f-407c-99a0-dc3e2d322a40 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:28.020720 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-76b70892-73b9-42d4-839b-66b8e16a5a48 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 18:05:28.021574 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02a7147-866f-407c-99a0-dc3e2d322a40 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:28.028463 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 430/849] 10.222.0.18 () {56 vars in 1147 bytes} [Tue Oct 12 18:05:27 2021] GET /identity/v3/services/object-store => generated 93 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 18:05:28.029860 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b70892-73b9-42d4-839b-66b8e16a5a48 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:28.042858 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b70892-73b9-42d4-839b-66b8e16a5a48 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:28.043701 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 420/850] 10.222.0.18 () {56 vars in 1169 bytes} [Tue Oct 12 18:05:27 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:28.045189 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c76e5e9-bdeb-42ac-a432-0c027fe9368b None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:28.045478 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c76e5e9-bdeb-42ac-a432-0c027fe9368b None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:28.045754 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c76e5e9-bdeb-42ac-a432-0c027fe9368b None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:28.047691 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 421/851] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:05:28 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:05:28.052869 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf8d19-cd64-4ecc-8e1c-d456f0bb1eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:28.053317 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c76e5e9-bdeb-42ac-a432-0c027fe9368b None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:28.053623 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf8d19-cd64-4ecc-8e1c-d456f0bb1eb6 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:28.053899 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf8d19-cd64-4ecc-8e1c-d456f0bb1eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:28.054165 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf8d19-cd64-4ecc-8e1c-d456f0bb1eb6 admin admin] PATH_INFO: `/v3/services` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:28.054885 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cf8d19-cd64-4ecc-8e1c-d456f0bb1eb6 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:28.055239 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cf8d19-cd64-4ecc-8e1c-d456f0bb1eb6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:28.056833 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cf8d19-cd64-4ecc-8e1c-d456f0bb1eb6 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:28.062252 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 431/852] 10.222.0.18 () {56 vars in 1143 bytes} [Tue Oct 12 18:05:28 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:05:28.063539 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70859a4-fe4d-433b-be39-fc26a00e4194 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:28.063824 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70859a4-fe4d-433b-be39-fc26a00e4194 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:28.064093 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70859a4-fe4d-433b-be39-fc26a00e4194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:28.079934 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c76e5e9-bdeb-42ac-a432-0c027fe9368b None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:28.084834 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-a70859a4-fe4d-433b-be39-fc26a00e4194 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:05:28.085499 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7a534a-0e41-4c43-a6ec-fb856462b090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:28.089054 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-a70859a4-fe4d-433b-be39-fc26a00e4194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:05:28.089168 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a534a-0e41-4c43-a6ec-fb856462b090 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:28.089168 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a534a-0e41-4c43-a6ec-fb856462b090 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:28.089168 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a534a-0e41-4c43-a6ec-fb856462b090 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:28.089168 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7a534a-0e41-4c43-a6ec-fb856462b090 admin admin] RBAC: Adding query filter params (role.id=d7656b67d66f4c2d81879698f36ca670, scope.project.id=e843aaa9e5e44a8e98f7cc7412d9697b, user.id=8f6a3a7064754fb79a0a06b3ad4a7d05) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:28.089168 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7a534a-0e41-4c43-a6ec-fb856462b090 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:28.089768 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7a534a-0e41-4c43-a6ec-fb856462b090 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:28.094959 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 432/853] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:05:28 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:05:28.095993 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70859a4-fe4d-433b-be39-fc26a00e4194 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:28.104424 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 422/854] 10.222.0.18 () {56 vars in 1395 bytes} [Tue Oct 12 18:05:28 2021] GET /identity/v3/role_assignments?user.id=8f6a3a7064754fb79a0a06b3ad4a7d05&scope.project.id=e843aaa9e5e44a8e98f7cc7412d9697b&role.id=d7656b67d66f4c2d81879698f36ca670 => generated 608 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:28.113311 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70859a4-fe4d-433b-be39-fc26a00e4194 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:28.118804 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d475f56-f2cc-4a6f-872e-955672d6bfc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:28.120102 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d475f56-f2cc-4a6f-872e-955672d6bfc7 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:28.120102 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d475f56-f2cc-4a6f-872e-955672d6bfc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:28.120777 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d475f56-f2cc-4a6f-872e-955672d6bfc7 admin admin] PATH_INFO: `/v3/services` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:28.121321 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7a534a-0e41-4c43-a6ec-fb856462b090 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:28.121532 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d475f56-f2cc-4a6f-872e-955672d6bfc7 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:28.121844 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d475f56-f2cc-4a6f-872e-955672d6bfc7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:28.123489 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d475f56-f2cc-4a6f-872e-955672d6bfc7 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:28.132258 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 433/855] 10.222.0.18 () {56 vars in 1143 bytes} [Tue Oct 12 18:05:28 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:28.135076 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7a534a-0e41-4c43-a6ec-fb856462b090 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:28.139301 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d475f56-f2cc-4a6f-872e-955672d6bfc7 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:28.143856 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a2a1ee-2686-4306-ac36-e182ab866422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:28.144721 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a2a1ee-2686-4306-ac36-e182ab866422 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:28.145584 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a2a1ee-2686-4306-ac36-e182ab866422 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:28.146044 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a2a1ee-2686-4306-ac36-e182ab866422 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:28.146564 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a2a1ee-2686-4306-ac36-e182ab866422 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:28.148173 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a2a1ee-2686-4306-ac36-e182ab866422 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:28.152676 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d475f56-f2cc-4a6f-872e-955672d6bfc7 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:28.157503 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3651bf76-5ccd-4e8a-9fbf-58fd0dbac14c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:28.158097 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3651bf76-5ccd-4e8a-9fbf-58fd0dbac14c admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:28.158377 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3651bf76-5ccd-4e8a-9fbf-58fd0dbac14c admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:28.158649 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3651bf76-5ccd-4e8a-9fbf-58fd0dbac14c admin admin] PATH_INFO: `/v3/endpoints` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:28.159476 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3651bf76-5ccd-4e8a-9fbf-58fd0dbac14c admin admin] RBAC: Adding query filter params (interface=public, service_id=c62a2f2159a444fda3e0007e9d8ba29d, region_id=RegionOne) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:28.159788 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3651bf76-5ccd-4e8a-9fbf-58fd0dbac14c admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:28.161628 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3651bf76-5ccd-4e8a-9fbf-58fd0dbac14c admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:28.162065 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-b3a2a1ee-2686-4306-ac36-e182ab866422 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 12 18:05:28.163371 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 423/856] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Oct 12 18:05:28 2021] GET /identity/v3/services/compute => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 18:05:28.167870 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 434/857] 10.222.0.18 () {56 vars in 1272 bytes} [Tue Oct 12 18:05:28 2021] GET /identity/v3/endpoints?service_id=c62a2f2159a444fda3e0007e9d8ba29d&interface=public®ion_id=RegionOne => generated 194 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:05:28.170545 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a2a1ee-2686-4306-ac36-e182ab866422 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:28.174844 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3651bf76-5ccd-4e8a-9fbf-58fd0dbac14c admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:28.182261 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a2a1ee-2686-4306-ac36-e182ab866422 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:28.185626 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3651bf76-5ccd-4e8a-9fbf-58fd0dbac14c admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:28.187504 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889ef3f5-870d-428b-ad5c-167a2c78d596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:28.188493 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ef3f5-870d-428b-ad5c-167a2c78d596 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:28.189009 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ef3f5-870d-428b-ad5c-167a2c78d596 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:28.190175 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ef3f5-870d-428b-ad5c-167a2c78d596 admin admin] PATH_INFO: `/v3/services` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:28.190175 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889ef3f5-870d-428b-ad5c-167a2c78d596 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:28.190406 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889ef3f5-870d-428b-ad5c-167a2c78d596 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:28.192229 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889ef3f5-870d-428b-ad5c-167a2c78d596 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:28.192499 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a56efb-182a-436f-ad6c-e51ef992acb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:28.192954 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a56efb-182a-436f-ad6c-e51ef992acb0 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:28.193234 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a56efb-182a-436f-ad6c-e51ef992acb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:28.193664 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a56efb-182a-436f-ad6c-e51ef992acb0 admin admin] PATH_INFO: `/v3/services` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:28.194440 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a56efb-182a-436f-ad6c-e51ef992acb0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:28.196221 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a56efb-182a-436f-ad6c-e51ef992acb0 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:28.199318 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 424/858] 10.222.0.18 () {56 vars in 1133 bytes} [Tue Oct 12 18:05:28 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:28.202919 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 435/859] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 12 18:05:28 2021] GET /identity/v3/services => generated 1497 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:05:28.206537 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889ef3f5-870d-428b-ad5c-167a2c78d596 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:28.220026 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889ef3f5-870d-428b-ad5c-167a2c78d596 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:28.226428 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24cd2e4-daca-4613-b289-20e0906e0628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:28.227124 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24cd2e4-daca-4613-b289-20e0906e0628 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:28.227403 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24cd2e4-daca-4613-b289-20e0906e0628 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:28.227679 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24cd2e4-daca-4613-b289-20e0906e0628 admin admin] PATH_INFO: `/v3/services` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:28.228577 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24cd2e4-daca-4613-b289-20e0906e0628 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:28.229923 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24cd2e4-daca-4613-b289-20e0906e0628 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:28.231375 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24cd2e4-daca-4613-b289-20e0906e0628 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:28.238717 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 425/860] 10.222.0.18 () {56 vars in 1133 bytes} [Tue Oct 12 18:05:28 2021] GET /identity/v3/services?type=compute => generated 124 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:30.465367 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a21d4-99fd-4286-ade7-f3b5d21fc1c3 None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:30.466300 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a21d4-99fd-4286-ade7-f3b5d21fc1c3 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:30.466300 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a21d4-99fd-4286-ade7-f3b5d21fc1c3 None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:30.467949 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 436/861] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:05:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:05:30.474543 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c81c25-1c2e-4008-9e5c-760c8bfe6713 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:30.475453 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c81c25-1c2e-4008-9e5c-760c8bfe6713 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:30.475453 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c81c25-1c2e-4008-9e5c-760c8bfe6713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:30.494601 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-f4c81c25-1c2e-4008-9e5c-760c8bfe6713 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:05:30.495831 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-f4c81c25-1c2e-4008-9e5c-760c8bfe6713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:05:30.504773 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 426/862] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:05:30 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:05:30.534871 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a21d4-99fd-4286-ade7-f3b5d21fc1c3 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:30.542264 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac45be-0032-49e5-8cca-e200736992fc None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:30.542542 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac45be-0032-49e5-8cca-e200736992fc None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:30.542808 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac45be-0032-49e5-8cca-e200736992fc None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:30.544914 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 427/863] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:05:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 18:05:30.550664 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21310ac-84ec-4ee5-8184-5d87f8a9773f None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:30.550946 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21310ac-84ec-4ee5-8184-5d87f8a9773f None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:30.551754 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21310ac-84ec-4ee5-8184-5d87f8a9773f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:30.552051 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a21d4-99fd-4286-ade7-f3b5d21fc1c3 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:30.556822 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f60728-8f74-4260-88ad-d1eb99764264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:30.558018 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f60728-8f74-4260-88ad-d1eb99764264 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:30.558447 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f60728-8f74-4260-88ad-d1eb99764264 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:30.559755 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f60728-8f74-4260-88ad-d1eb99764264 admin admin] PATH_INFO: `/v3/services/image` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:30.560599 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f60728-8f74-4260-88ad-d1eb99764264 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:30.562342 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f60728-8f74-4260-88ad-d1eb99764264 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:30.570651 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-c21310ac-84ec-4ee5-8184-5d87f8a9773f None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:05:30.571809 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-c21310ac-84ec-4ee5-8184-5d87f8a9773f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:05:30.575404 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-d7f60728-8f74-4260-88ad-d1eb99764264 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 12 18:05:30.577159 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 437/864] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Oct 12 18:05:30 2021] GET /identity/v3/services/image => generated 86 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:30.582973 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 428/865] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:05:30 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:05:30.583966 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f60728-8f74-4260-88ad-d1eb99764264 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:30.597469 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f60728-8f74-4260-88ad-d1eb99764264 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:30.602371 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064a1026-c422-4d51-8d18-76233acaa7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:30.603182 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a1026-c422-4d51-8d18-76233acaa7e5 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:30.603606 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a1026-c422-4d51-8d18-76233acaa7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:30.604047 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a1026-c422-4d51-8d18-76233acaa7e5 admin admin] PATH_INFO: `/v3/services` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:30.604950 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064a1026-c422-4d51-8d18-76233acaa7e5 admin admin] RBAC: Adding query filter params (name=image) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:30.605410 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064a1026-c422-4d51-8d18-76233acaa7e5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:30.607152 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064a1026-c422-4d51-8d18-76233acaa7e5 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:30.607514 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21310ac-84ec-4ee5-8184-5d87f8a9773f None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:30.618826 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 438/866] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:05:30 2021] GET /identity/v3/services?name=image => generated 122 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:30.622433 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21310ac-84ec-4ee5-8184-5d87f8a9773f None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:30.625617 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76e723-d264-4fde-a109-5df9de00db15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:30.626416 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76e723-d264-4fde-a109-5df9de00db15 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:30.626692 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76e723-d264-4fde-a109-5df9de00db15 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:30.626962 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76e723-d264-4fde-a109-5df9de00db15 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:30.627624 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f76e723-d264-4fde-a109-5df9de00db15 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:30.630241 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f76e723-d264-4fde-a109-5df9de00db15 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:30.631481 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064a1026-c422-4d51-8d18-76233acaa7e5 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:30.641570 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064a1026-c422-4d51-8d18-76233acaa7e5 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:30.645533 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-0f76e723-d264-4fde-a109-5df9de00db15 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 18:05:30.646828 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d1d7a8-b24c-4af5-82b7-b2546fef9b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:30.647384 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 429/867] 10.222.0.18 () {56 vars in 1147 bytes} [Tue Oct 12 18:05:30 2021] GET /identity/v3/services/object-store => generated 93 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 18:05:30.647828 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d1d7a8-b24c-4af5-82b7-b2546fef9b9c admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:30.648223 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d1d7a8-b24c-4af5-82b7-b2546fef9b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:30.648632 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d1d7a8-b24c-4af5-82b7-b2546fef9b9c admin admin] PATH_INFO: `/v3/services` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:30.649309 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4846402-4ee1-45e8-b955-de4ac558662d None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:30.649561 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d1d7a8-b24c-4af5-82b7-b2546fef9b9c admin admin] RBAC: Adding query filter params (type=image) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:30.649889 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4846402-4ee1-45e8-b955-de4ac558662d None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:30.650074 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d1d7a8-b24c-4af5-82b7-b2546fef9b9c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:30.650459 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4846402-4ee1-45e8-b955-de4ac558662d None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:30.651899 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d1d7a8-b24c-4af5-82b7-b2546fef9b9c admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:30.652683 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 430/868] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:05:30 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:05:30.657167 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 439/869] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:05:30 2021] GET /identity/v3/services?type=image => generated 122 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:05:30.658090 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d1d7a8-b24c-4af5-82b7-b2546fef9b9c admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:30.658308 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db1c52-7682-4074-90a8-4fa2f8036c7a None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:30.658595 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db1c52-7682-4074-90a8-4fa2f8036c7a None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:30.658864 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db1c52-7682-4074-90a8-4fa2f8036c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:30.667688 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d1d7a8-b24c-4af5-82b7-b2546fef9b9c admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:30.673407 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd7ecb3-dbf4-4561-9dca-e9590ed4bcbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:30.674086 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd7ecb3-dbf4-4561-9dca-e9590ed4bcbf admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:30.674363 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd7ecb3-dbf4-4561-9dca-e9590ed4bcbf admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:30.674629 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd7ecb3-dbf4-4561-9dca-e9590ed4bcbf admin admin] PATH_INFO: `/v3/services` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:30.675363 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd7ecb3-dbf4-4561-9dca-e9590ed4bcbf admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:30.675667 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd7ecb3-dbf4-4561-9dca-e9590ed4bcbf admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:30.677911 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd7ecb3-dbf4-4561-9dca-e9590ed4bcbf admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:30.685263 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 440/870] 10.222.0.18 () {56 vars in 1143 bytes} [Tue Oct 12 18:05:30 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:30.692557 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-a0db1c52-7682-4074-90a8-4fa2f8036c7a None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:05:30.693358 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd7ecb3-dbf4-4561-9dca-e9590ed4bcbf admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:30.693883 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-a0db1c52-7682-4074-90a8-4fa2f8036c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:05:30.702993 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 431/871] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:05:30 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:05:30.705198 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd7ecb3-dbf4-4561-9dca-e9590ed4bcbf admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:30.712123 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b0b55a-0c13-4478-aa50-e65d951c7982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:30.713063 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0b55a-0c13-4478-aa50-e65d951c7982 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:30.713545 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0b55a-0c13-4478-aa50-e65d951c7982 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:30.713993 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0b55a-0c13-4478-aa50-e65d951c7982 admin admin] PATH_INFO: `/v3/services` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:30.714883 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b0b55a-0c13-4478-aa50-e65d951c7982 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:30.715430 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b0b55a-0c13-4478-aa50-e65d951c7982 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:30.717274 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b0b55a-0c13-4478-aa50-e65d951c7982 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:30.723870 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 441/872] 10.222.0.18 () {56 vars in 1143 bytes} [Tue Oct 12 18:05:30 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:30.727901 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0db1c52-7682-4074-90a8-4fa2f8036c7a None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:30.731208 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b0b55a-0c13-4478-aa50-e65d951c7982 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:30.739180 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0db1c52-7682-4074-90a8-4fa2f8036c7a None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:30.744095 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b0b55a-0c13-4478-aa50-e65d951c7982 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:30.744333 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e2d64d-5c98-416e-8d93-20875fe552f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:30.745143 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e2d64d-5c98-416e-8d93-20875fe552f7 admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:30.745532 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e2d64d-5c98-416e-8d93-20875fe552f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:30.745933 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e2d64d-5c98-416e-8d93-20875fe552f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:30.746808 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e2d64d-5c98-416e-8d93-20875fe552f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:30.748937 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e2d64d-5c98-416e-8d93-20875fe552f7 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:30.749091 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b5e9a7-666e-4f6c-afc3-851558de2c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:30.749690 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b5e9a7-666e-4f6c-afc3-851558de2c5f admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:30.749971 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b5e9a7-666e-4f6c-afc3-851558de2c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:30.750245 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b5e9a7-666e-4f6c-afc3-851558de2c5f admin admin] PATH_INFO: `/v3/endpoints` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:30.750899 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.common [None req-88e2d64d-5c98-416e-8d93-20875fe552f7 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 12 18:05:30.751010 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b5e9a7-666e-4f6c-afc3-851558de2c5f admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:30.752977 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b5e9a7-666e-4f6c-afc3-851558de2c5f admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:30.813854 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.sql.core [None req-88e2d64d-5c98-416e-8d93-20875fe552f7 admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 12 18:05:30.813854 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 12 18:05:30.813854 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [parameters: {'id': 'f96dd53cd6284f67baba1024f6c30f9f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 12 18:05:30.813854 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=74006) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 12 18:05:30.821258 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 442/873] 10.222.0.18 () {60 vars in 1165 bytes} [Tue Oct 12 18:05:30 2021] POST /identity/v3/endpoints => generated 349 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 18:05:30.825151 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-88e2d64d-5c98-416e-8d93-20875fe552f7 admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f96dd53cd6284f67baba1024f6c30f9f.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f96dd53cd6284f67baba1024f6c30f9f. Oct 12 18:05:30.827024 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 432/874] 10.222.0.18 () {60 vars in 1161 bytes} [Tue Oct 12 18:05:30 2021] POST /identity/v3/projects => generated 262 bytes in 99 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:30.834178 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b5e9a7-666e-4f6c-afc3-851558de2c5f admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:30.857943 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b5e9a7-666e-4f6c-afc3-851558de2c5f admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:30.863581 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8729c4d-0030-4d0c-a4a0-2e039e9c090c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:30.865378 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8729c4d-0030-4d0c-a4a0-2e039e9c090c admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:30.865890 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8729c4d-0030-4d0c-a4a0-2e039e9c090c admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:30.866389 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8729c4d-0030-4d0c-a4a0-2e039e9c090c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:30.874883 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8729c4d-0030-4d0c-a4a0-2e039e9c090c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:30.877408 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8729c4d-0030-4d0c-a4a0-2e039e9c090c admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:30.888987 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad70894d-a1dd-4223-8f9e-1ee70828a3f8 None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:30.889294 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad70894d-a1dd-4223-8f9e-1ee70828a3f8 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:30.889537 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad70894d-a1dd-4223-8f9e-1ee70828a3f8 None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:30.893621 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-e8729c4d-0030-4d0c-a4a0-2e039e9c090c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 18:05:30.895115 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 443/875] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Oct 12 18:05:30 2021] GET /identity/v3/projects/service => generated 88 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:30.895224 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 433/876] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:05:30 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 18:05:30.902221 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c00f2f-174f-4c4e-acb0-4661110dcc48 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:30.902533 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad70894d-a1dd-4223-8f9e-1ee70828a3f8 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:30.902656 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c00f2f-174f-4c4e-acb0-4661110dcc48 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:30.902807 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c00f2f-174f-4c4e-acb0-4661110dcc48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:30.920335 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad70894d-a1dd-4223-8f9e-1ee70828a3f8 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:30.922551 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-08c00f2f-174f-4c4e-acb0-4661110dcc48 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:05:30.923780 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-08c00f2f-174f-4c4e-acb0-4661110dcc48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:05:30.926742 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77292936-8048-4641-a47d-811a64c6b659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:30.927781 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77292936-8048-4641-a47d-811a64c6b659 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:30.928311 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77292936-8048-4641-a47d-811a64c6b659 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:30.928814 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77292936-8048-4641-a47d-811a64c6b659 admin admin] PATH_INFO: `/v3/projects` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:30.929788 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77292936-8048-4641-a47d-811a64c6b659 admin admin] RBAC: Adding query filter params (name=service) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:30.930308 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77292936-8048-4641-a47d-811a64c6b659 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:30.932723 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77292936-8048-4641-a47d-811a64c6b659 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:30.932906 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 444/877] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:05:30 2021] POST /identity/v3/auth/tokens => generated 2480 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:05:30.954965 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 434/878] 10.222.0.18 () {56 vars in 1133 bytes} [Tue Oct 12 18:05:30 2021] GET /identity/v3/projects?name=service => generated 411 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:05:30.960261 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c00f2f-174f-4c4e-acb0-4661110dcc48 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:30.970439 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c00f2f-174f-4c4e-acb0-4661110dcc48 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:30.976298 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810895eb-f747-439e-aae9-0b1479b7b087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:30.977082 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810895eb-f747-439e-aae9-0b1479b7b087 admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:30.977361 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810895eb-f747-439e-aae9-0b1479b7b087 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:30.977691 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810895eb-f747-439e-aae9-0b1479b7b087 admin admin] PATH_INFO: `/v3/services` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:30.978476 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810895eb-f747-439e-aae9-0b1479b7b087 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:30.980270 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810895eb-f747-439e-aae9-0b1479b7b087 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:31.060713 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 445/879] 10.222.0.18 () {60 vars in 1162 bytes} [Tue Oct 12 18:05:30 2021] POST /identity/v3/services => generated 242 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:05:32.989687 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78b877-11a5-41ca-a64c-95dca1eb17cb None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:32.990173 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78b877-11a5-41ca-a64c-95dca1eb17cb None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:32.990173 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78b877-11a5-41ca-a64c-95dca1eb17cb None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:32.992189 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 435/880] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:05:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:05:32.998191 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e88967-094c-4f55-8ae3-efc0d091b2eb None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:32.998690 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e88967-094c-4f55-8ae3-efc0d091b2eb None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:32.998854 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e88967-094c-4f55-8ae3-efc0d091b2eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:33.017225 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-22e88967-094c-4f55-8ae3-efc0d091b2eb None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:05:33.018438 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-22e88967-094c-4f55-8ae3-efc0d091b2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:05:33.036607 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 446/881] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:05:32 2021] POST /identity/v3/auth/tokens => generated 2576 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:05:33.060999 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78b877-11a5-41ca-a64c-95dca1eb17cb None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:33.074768 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78b877-11a5-41ca-a64c-95dca1eb17cb None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:33.079608 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcb36ac-7826-43d9-a39b-c3b2843c4699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:33.080287 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb36ac-7826-43d9-a39b-c3b2843c4699 admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:33.080599 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb36ac-7826-43d9-a39b-c3b2843c4699 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:33.080878 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb36ac-7826-43d9-a39b-c3b2843c4699 admin admin] PATH_INFO: `/v3/services` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:33.081647 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcb36ac-7826-43d9-a39b-c3b2843c4699 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:33.083320 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcb36ac-7826-43d9-a39b-c3b2843c4699 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:33.170224 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 436/882] 10.222.0.18 () {60 vars in 1162 bytes} [Tue Oct 12 18:05:33 2021] POST /identity/v3/services => generated 242 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:05:33.203969 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0651a764-a411-442b-8296-bef0f5be813d None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:33.204319 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0651a764-a411-442b-8296-bef0f5be813d None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:33.204558 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0651a764-a411-442b-8296-bef0f5be813d None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:33.206994 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 447/883] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:05:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:05:33.214239 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b45fd3-be31-412c-82b9-0ebbbddba8ed None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:33.214563 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b45fd3-be31-412c-82b9-0ebbbddba8ed None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:33.214786 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b45fd3-be31-412c-82b9-0ebbbddba8ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:33.236303 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-e1b45fd3-be31-412c-82b9-0ebbbddba8ed None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:05:33.238221 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-e1b45fd3-be31-412c-82b9-0ebbbddba8ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:05:33.258263 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 437/884] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:05:33 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:05:33.282904 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0651a764-a411-442b-8296-bef0f5be813d None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:33.296453 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0651a764-a411-442b-8296-bef0f5be813d None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:33.304884 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd972aa-6468-48e7-b288-1725d09d89b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:33.304884 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd972aa-6468-48e7-b288-1725d09d89b8 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:33.304884 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd972aa-6468-48e7-b288-1725d09d89b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:33.305490 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a46a2c3-c415-46c1-8f61-be1c3a0723aa None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:33.305666 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd972aa-6468-48e7-b288-1725d09d89b8 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:33.305909 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a46a2c3-c415-46c1-8f61-be1c3a0723aa None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:33.305909 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a46a2c3-c415-46c1-8f61-be1c3a0723aa None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:33.306191 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd972aa-6468-48e7-b288-1725d09d89b8 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:33.306191 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd972aa-6468-48e7-b288-1725d09d89b8 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:33.306732 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 438/885] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:05:33 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 18:05:33.313277 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e032f78-3c82-4186-9e9a-57c3d15a68f0 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:33.313893 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e032f78-3c82-4186-9e9a-57c3d15a68f0 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:33.314379 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e032f78-3c82-4186-9e9a-57c3d15a68f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:33.318958 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-4fd972aa-6468-48e7-b288-1725d09d89b8 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 18:05:33.320598 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 448/886] 10.222.0.18 () {56 vars in 1147 bytes} [Tue Oct 12 18:05:33 2021] GET /identity/v3/services/object-store => generated 93 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:33.327398 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd972aa-6468-48e7-b288-1725d09d89b8 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:33.335431 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-8e032f78-3c82-4186-9e9a-57c3d15a68f0 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:05:33.336994 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-8e032f78-3c82-4186-9e9a-57c3d15a68f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:05:33.338395 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd972aa-6468-48e7-b288-1725d09d89b8 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:33.343650 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129bcdfa-2d41-4bd1-856a-42e124d40a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:33.344463 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129bcdfa-2d41-4bd1-856a-42e124d40a5b admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:33.344746 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129bcdfa-2d41-4bd1-856a-42e124d40a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:33.345024 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129bcdfa-2d41-4bd1-856a-42e124d40a5b admin admin] PATH_INFO: `/v3/services` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:33.345942 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129bcdfa-2d41-4bd1-856a-42e124d40a5b admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:33.346251 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129bcdfa-2d41-4bd1-856a-42e124d40a5b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:33.347700 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 439/887] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:05:33 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:05:33.347943 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129bcdfa-2d41-4bd1-856a-42e124d40a5b admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:33.356556 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802717ec-920f-4d79-91b8-0f4def30fad1 None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:33.356556 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802717ec-920f-4d79-91b8-0f4def30fad1 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:33.356556 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802717ec-920f-4d79-91b8-0f4def30fad1 None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:33.356896 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 449/888] 10.222.0.18 () {56 vars in 1143 bytes} [Tue Oct 12 18:05:33 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:05:33.356972 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 440/889] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:05:33 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:05:33.361126 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46022a1-7b98-453c-8cce-f303967984c3 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:33.361416 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46022a1-7b98-453c-8cce-f303967984c3 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:33.361515 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802717ec-920f-4d79-91b8-0f4def30fad1 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:33.361702 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46022a1-7b98-453c-8cce-f303967984c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:33.379822 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802717ec-920f-4d79-91b8-0f4def30fad1 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:33.382157 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-d46022a1-7b98-453c-8cce-f303967984c3 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:05:33.383375 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-d46022a1-7b98-453c-8cce-f303967984c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:05:33.384339 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49b999f-32eb-4e63-9aac-ec5d9139590e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:33.385320 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b999f-32eb-4e63-9aac-ec5d9139590e admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:33.385848 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b999f-32eb-4e63-9aac-ec5d9139590e admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:33.386200 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b999f-32eb-4e63-9aac-ec5d9139590e admin admin] PATH_INFO: `/v3/services` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:33.386976 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49b999f-32eb-4e63-9aac-ec5d9139590e admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:33.387240 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49b999f-32eb-4e63-9aac-ec5d9139590e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:33.388978 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49b999f-32eb-4e63-9aac-ec5d9139590e admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:33.392210 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 450/890] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:05:33 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:05:33.392596 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46022a1-7b98-453c-8cce-f303967984c3 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:33.399671 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 441/891] 10.222.0.18 () {56 vars in 1143 bytes} [Tue Oct 12 18:05:33 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:33.404818 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46022a1-7b98-453c-8cce-f303967984c3 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:33.406227 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49b999f-32eb-4e63-9aac-ec5d9139590e admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:33.415836 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a473d105-e2b8-41e0-8dfc-3ae4cea9128e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:33.416534 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a473d105-e2b8-41e0-8dfc-3ae4cea9128e admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:33.416825 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a473d105-e2b8-41e0-8dfc-3ae4cea9128e admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:33.417101 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a473d105-e2b8-41e0-8dfc-3ae4cea9128e admin admin] PATH_INFO: `/v3/users` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:33.417813 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a473d105-e2b8-41e0-8dfc-3ae4cea9128e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:33.419448 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49b999f-32eb-4e63-9aac-ec5d9139590e admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:33.419681 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a473d105-e2b8-41e0-8dfc-3ae4cea9128e admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:33.421057 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.common [None req-a473d105-e2b8-41e0-8dfc-3ae4cea9128e admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 12 18:05:33.424076 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11614033-c3f0-4cfd-806b-f727e074dfec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:33.424834 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11614033-c3f0-4cfd-806b-f727e074dfec admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:33.425121 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11614033-c3f0-4cfd-806b-f727e074dfec admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:33.425393 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11614033-c3f0-4cfd-806b-f727e074dfec admin admin] PATH_INFO: `/v3/endpoints` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:33.426728 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11614033-c3f0-4cfd-806b-f727e074dfec admin admin] RBAC: Adding query filter params (interface=admin, service_id=c62a2f2159a444fda3e0007e9d8ba29d, region_id=RegionOne) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:33.427039 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11614033-c3f0-4cfd-806b-f727e074dfec admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:33.429535 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11614033-c3f0-4cfd-806b-f727e074dfec admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:33.435121 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 442/892] 10.222.0.18 () {56 vars in 1270 bytes} [Tue Oct 12 18:05:33 2021] GET /identity/v3/endpoints?service_id=c62a2f2159a444fda3e0007e9d8ba29d&interface=admin®ion_id=RegionOne => generated 193 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:33.435913 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11614033-c3f0-4cfd-806b-f727e074dfec admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:33.445963 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11614033-c3f0-4cfd-806b-f727e074dfec admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:33.450467 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b18efbb-f3e4-4ccf-92e4-6a986ffca1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:33.451236 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b18efbb-f3e4-4ccf-92e4-6a986ffca1e8 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:33.451523 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b18efbb-f3e4-4ccf-92e4-6a986ffca1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:33.451800 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b18efbb-f3e4-4ccf-92e4-6a986ffca1e8 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:33.452530 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b18efbb-f3e4-4ccf-92e4-6a986ffca1e8 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:33.454103 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b18efbb-f3e4-4ccf-92e4-6a986ffca1e8 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:33.465183 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-3b18efbb-f3e4-4ccf-92e4-6a986ffca1e8 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 12 18:05:33.466341 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 443/893] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Oct 12 18:05:33 2021] GET /identity/v3/services/compute => generated 88 bytes in 31 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:33.467093 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b18efbb-f3e4-4ccf-92e4-6a986ffca1e8 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:33.470390 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.sql.core [None req-a473d105-e2b8-41e0-8dfc-3ae4cea9128e admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 12 18:05:33.470390 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 12 18:05:33.470390 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [parameters: {'user_id': 'f6366a4c40f54d5bb31d4ead1c61e22a', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 12 18:05:33.470390 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=74005) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 12 18:05:33.476367 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b18efbb-f3e4-4ccf-92e4-6a986ffca1e8 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:33.481069 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fb3993-67cd-46b6-b656-8d570330db99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:33.481707 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fb3993-67cd-46b6-b656-8d570330db99 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:33.481988 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fb3993-67cd-46b6-b656-8d570330db99 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:33.482264 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fb3993-67cd-46b6-b656-8d570330db99 admin admin] PATH_INFO: `/v3/services` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:33.482950 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fb3993-67cd-46b6-b656-8d570330db99 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:33.484580 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fb3993-67cd-46b6-b656-8d570330db99 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:33.486269 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-a473d105-e2b8-41e0-8dfc-3ae4cea9128e admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 12 18:05:33.487621 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 451/894] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:05:33 2021] POST /identity/v3/users => generated 160 bytes in 95 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:33.489281 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a473d105-e2b8-41e0-8dfc-3ae4cea9128e admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:33.496441 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 444/895] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 12 18:05:33 2021] GET /identity/v3/services => generated 1957 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:05:33.497538 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fb3993-67cd-46b6-b656-8d570330db99 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:33.499347 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a473d105-e2b8-41e0-8dfc-3ae4cea9128e admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:33.504823 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17703ad6-e862-4631-a2db-6d2a75e9313b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:33.505546 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17703ad6-e862-4631-a2db-6d2a75e9313b admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:33.505828 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17703ad6-e862-4631-a2db-6d2a75e9313b admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:33.506099 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17703ad6-e862-4631-a2db-6d2a75e9313b admin admin] PATH_INFO: `/v3/services` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:33.506884 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17703ad6-e862-4631-a2db-6d2a75e9313b admin admin] RBAC: Adding query filter params (name=compute) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:33.507188 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17703ad6-e862-4631-a2db-6d2a75e9313b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:33.509274 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17703ad6-e862-4631-a2db-6d2a75e9313b admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:33.510525 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fb3993-67cd-46b6-b656-8d570330db99 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:33.515483 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c08b47-11f2-4b6f-99b8-038ce5cc0afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:33.516601 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c08b47-11f2-4b6f-99b8-038ce5cc0afa admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:33.516880 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c08b47-11f2-4b6f-99b8-038ce5cc0afa admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:33.517164 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c08b47-11f2-4b6f-99b8-038ce5cc0afa admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:33.520816 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 452/896] 10.222.0.18 () {56 vars in 1133 bytes} [Tue Oct 12 18:05:33 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:33.527760 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17703ad6-e862-4631-a2db-6d2a75e9313b admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:33.532055 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c08b47-11f2-4b6f-99b8-038ce5cc0afa admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:33.534526 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c08b47-11f2-4b6f-99b8-038ce5cc0afa admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:33.539529 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17703ad6-e862-4631-a2db-6d2a75e9313b admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:33.545070 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5260e1-b7ae-4e67-badc-4a5480d4188a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:33.546114 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5260e1-b7ae-4e67-badc-4a5480d4188a admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:33.546578 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5260e1-b7ae-4e67-badc-4a5480d4188a admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:33.547078 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5260e1-b7ae-4e67-badc-4a5480d4188a admin admin] PATH_INFO: `/v3/services` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:33.548090 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5260e1-b7ae-4e67-badc-4a5480d4188a admin admin] RBAC: Adding query filter params (type=compute) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:33.548608 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5260e1-b7ae-4e67-badc-4a5480d4188a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:33.550234 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-a2c08b47-11f2-4b6f-99b8-038ce5cc0afa admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 12 18:05:33.550675 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5260e1-b7ae-4e67-badc-4a5480d4188a admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:33.552569 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 445/897] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Oct 12 18:05:33 2021] GET /identity/v3/users/cinder => generated 84 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:33.557438 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 453/898] 10.222.0.18 () {56 vars in 1133 bytes} [Tue Oct 12 18:05:33 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:33.561366 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c08b47-11f2-4b6f-99b8-038ce5cc0afa admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:33.563836 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5260e1-b7ae-4e67-badc-4a5480d4188a admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:33.575044 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c08b47-11f2-4b6f-99b8-038ce5cc0afa admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:33.578470 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5260e1-b7ae-4e67-badc-4a5480d4188a admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:33.585131 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dfb630-009b-4b1a-97e6-4b1191f394a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:33.585814 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dfb630-009b-4b1a-97e6-4b1191f394a3 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:33.586092 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dfb630-009b-4b1a-97e6-4b1191f394a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:33.586365 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dfb630-009b-4b1a-97e6-4b1191f394a3 admin admin] PATH_INFO: `/v3/users` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:33.587178 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dfb630-009b-4b1a-97e6-4b1191f394a3 admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:33.587485 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dfb630-009b-4b1a-97e6-4b1191f394a3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:33.589494 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dfb630-009b-4b1a-97e6-4b1191f394a3 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:33.590609 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d50d3a-8356-4711-9c95-96972420287b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:33.591823 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d50d3a-8356-4711-9c95-96972420287b admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:33.592321 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d50d3a-8356-4711-9c95-96972420287b admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:33.592871 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d50d3a-8356-4711-9c95-96972420287b admin admin] PATH_INFO: `/v3/endpoints` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:33.593887 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d50d3a-8356-4711-9c95-96972420287b admin admin] RBAC: Adding query filter params (interface=public, service_id=f96602a5008847889433e20aee374bf1, region_id=RegionOne) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:33.594495 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d50d3a-8356-4711-9c95-96972420287b admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:33.596553 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d50d3a-8356-4711-9c95-96972420287b admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:33.604203 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 454/899] 10.222.0.18 () {56 vars in 1272 bytes} [Tue Oct 12 18:05:33 2021] GET /identity/v3/endpoints?service_id=f96602a5008847889433e20aee374bf1&interface=public®ion_id=RegionOne => generated 194 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:05:33.610718 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d50d3a-8356-4711-9c95-96972420287b admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:33.621247 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d50d3a-8356-4711-9c95-96972420287b admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:33.626460 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288e2205-24c0-4fa0-8378-854bafa1f236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:33.626822 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e2205-24c0-4fa0-8378-854bafa1f236 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:33.627010 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e2205-24c0-4fa0-8378-854bafa1f236 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:33.627279 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e2205-24c0-4fa0-8378-854bafa1f236 admin admin] PATH_INFO: `/v3/services` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:33.627976 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288e2205-24c0-4fa0-8378-854bafa1f236 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:33.630209 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288e2205-24c0-4fa0-8378-854bafa1f236 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:33.642532 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 446/901] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Oct 12 18:05:33 2021] GET /identity/v3/users?name=cinder => generated 354 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:33.642729 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 455/901] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 12 18:05:33 2021] GET /identity/v3/services => generated 1957 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 18:05:35.501492 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab1005-a661-4ef9-8db2-3af30aa285b0 None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:35.502103 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab1005-a661-4ef9-8db2-3af30aa285b0 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:35.502103 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab1005-a661-4ef9-8db2-3af30aa285b0 None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:35.503906 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 456/902] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:05:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:05:35.509872 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31840e43-a1b3-4360-a8e6-47b898f7b340 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:35.510270 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31840e43-a1b3-4360-a8e6-47b898f7b340 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:35.510469 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31840e43-a1b3-4360-a8e6-47b898f7b340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:35.528093 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-31840e43-a1b3-4360-a8e6-47b898f7b340 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:05:35.529413 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-31840e43-a1b3-4360-a8e6-47b898f7b340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:05:35.537834 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 447/903] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:05:35 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:05:35.561645 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab1005-a661-4ef9-8db2-3af30aa285b0 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:35.573683 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab1005-a661-4ef9-8db2-3af30aa285b0 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:35.577947 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f040169-052b-4fae-b271-a23ace4c66ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:35.578718 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f040169-052b-4fae-b271-a23ace4c66ed admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:35.578998 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f040169-052b-4fae-b271-a23ace4c66ed admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:35.579268 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f040169-052b-4fae-b271-a23ace4c66ed admin admin] PATH_INFO: `/v3/services/image` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:35.579924 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f040169-052b-4fae-b271-a23ace4c66ed admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:35.581544 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f040169-052b-4fae-b271-a23ace4c66ed admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:35.592179 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-8f040169-052b-4fae-b271-a23ace4c66ed admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 12 18:05:35.593511 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 457/904] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Oct 12 18:05:35 2021] GET /identity/v3/services/image => generated 86 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:35.600604 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31840e43-a1b3-4360-a8e6-47b898f7b340 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:35.609535 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31840e43-a1b3-4360-a8e6-47b898f7b340 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:35.616214 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28db085-b694-4e56-bdd3-e9c595c7f79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:35.617225 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28db085-b694-4e56-bdd3-e9c595c7f79d admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:35.617225 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28db085-b694-4e56-bdd3-e9c595c7f79d admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:35.617589 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28db085-b694-4e56-bdd3-e9c595c7f79d admin admin] PATH_INFO: `/v3/services` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:35.618379 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28db085-b694-4e56-bdd3-e9c595c7f79d admin admin] RBAC: Adding query filter params (name=image) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:35.618746 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28db085-b694-4e56-bdd3-e9c595c7f79d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:35.620544 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28db085-b694-4e56-bdd3-e9c595c7f79d admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:35.630001 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 448/905] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:05:35 2021] GET /identity/v3/services?name=image => generated 122 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:35.636086 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f040169-052b-4fae-b271-a23ace4c66ed admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:35.646996 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f040169-052b-4fae-b271-a23ace4c66ed admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:35.651741 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec27509-5547-4e1a-ab6d-2ba2cdfd8e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:35.652444 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec27509-5547-4e1a-ab6d-2ba2cdfd8e5e admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:35.652731 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec27509-5547-4e1a-ab6d-2ba2cdfd8e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:35.653004 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec27509-5547-4e1a-ab6d-2ba2cdfd8e5e admin admin] PATH_INFO: `/v3/services` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:35.653733 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec27509-5547-4e1a-ab6d-2ba2cdfd8e5e admin admin] RBAC: Adding query filter params (type=image) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:35.654043 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec27509-5547-4e1a-ab6d-2ba2cdfd8e5e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:35.655677 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec27509-5547-4e1a-ab6d-2ba2cdfd8e5e admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:35.662064 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 458/906] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:05:35 2021] GET /identity/v3/services?type=image => generated 350 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:35.668462 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28db085-b694-4e56-bdd3-e9c595c7f79d admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:35.678384 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28db085-b694-4e56-bdd3-e9c595c7f79d admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:35.682814 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be514010-9c0c-490e-96a4-b5b981fa0477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:35.683482 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be514010-9c0c-490e-96a4-b5b981fa0477 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:35.683761 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be514010-9c0c-490e-96a4-b5b981fa0477 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:35.684032 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be514010-9c0c-490e-96a4-b5b981fa0477 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:35.684852 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be514010-9c0c-490e-96a4-b5b981fa0477 admin admin] RBAC: Adding query filter params (interface=public, service_id=73f5b1ca38f541cfa6b0b0f907707807, region_id=RegionOne) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:35.685162 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be514010-9c0c-490e-96a4-b5b981fa0477 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:35.686732 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be514010-9c0c-490e-96a4-b5b981fa0477 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:35.691963 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 449/907] 10.222.0.18 () {56 vars in 1272 bytes} [Tue Oct 12 18:05:35 2021] GET /identity/v3/endpoints?service_id=73f5b1ca38f541cfa6b0b0f907707807&interface=public®ion_id=RegionOne => generated 194 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:35.697864 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec27509-5547-4e1a-ab6d-2ba2cdfd8e5e admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:35.707837 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec27509-5547-4e1a-ab6d-2ba2cdfd8e5e admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:35.712186 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa044b0d-b957-4cc0-85eb-c6302ea6ffe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:35.712860 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa044b0d-b957-4cc0-85eb-c6302ea6ffe4 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:35.713139 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa044b0d-b957-4cc0-85eb-c6302ea6ffe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:35.713405 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa044b0d-b957-4cc0-85eb-c6302ea6ffe4 admin admin] PATH_INFO: `/v3/services` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:35.714083 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa044b0d-b957-4cc0-85eb-c6302ea6ffe4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:35.715658 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa044b0d-b957-4cc0-85eb-c6302ea6ffe4 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:35.723335 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 459/908] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 12 18:05:35 2021] GET /identity/v3/services => generated 1957 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:05:35.797730 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df16367-a0e2-4f9e-ad48-99ab299ee8ce None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:35.798063 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df16367-a0e2-4f9e-ad48-99ab299ee8ce None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:35.798282 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df16367-a0e2-4f9e-ad48-99ab299ee8ce None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:35.800476 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 450/909] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:05:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:05:35.807213 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20156d0-a9ed-47fe-ab83-7a15d3e46fb3 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:35.807558 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20156d0-a9ed-47fe-ab83-7a15d3e46fb3 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:35.807763 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20156d0-a9ed-47fe-ab83-7a15d3e46fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:35.826914 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-c20156d0-a9ed-47fe-ab83-7a15d3e46fb3 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:05:35.828479 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-c20156d0-a9ed-47fe-ab83-7a15d3e46fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:05:35.837259 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 460/910] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:05:35 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:05:35.861566 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df16367-a0e2-4f9e-ad48-99ab299ee8ce None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:35.874186 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df16367-a0e2-4f9e-ad48-99ab299ee8ce None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:35.878875 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552bfd2e-bf5b-4c79-b0d0-fdd5462f2b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:35.879702 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552bfd2e-bf5b-4c79-b0d0-fdd5462f2b91 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:35.879985 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552bfd2e-bf5b-4c79-b0d0-fdd5462f2b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:35.880260 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552bfd2e-bf5b-4c79-b0d0-fdd5462f2b91 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:35.880994 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552bfd2e-bf5b-4c79-b0d0-fdd5462f2b91 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:35.882631 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552bfd2e-bf5b-4c79-b0d0-fdd5462f2b91 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:35.895408 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-552bfd2e-bf5b-4c79-b0d0-fdd5462f2b91 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 18:05:35.896895 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 451/911] 10.222.0.18 () {56 vars in 1147 bytes} [Tue Oct 12 18:05:35 2021] GET /identity/v3/services/object-store => generated 93 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:35.903821 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20156d0-a9ed-47fe-ab83-7a15d3e46fb3 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:35.914048 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20156d0-a9ed-47fe-ab83-7a15d3e46fb3 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:35.919059 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d13c35-f18e-46b9-bcd0-3ddd13b2d6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:35.920020 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d13c35-f18e-46b9-bcd0-3ddd13b2d6db admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:35.920547 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d13c35-f18e-46b9-bcd0-3ddd13b2d6db admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:35.921017 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d13c35-f18e-46b9-bcd0-3ddd13b2d6db admin admin] PATH_INFO: `/v3/services` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:35.921957 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d13c35-f18e-46b9-bcd0-3ddd13b2d6db admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:35.922529 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d13c35-f18e-46b9-bcd0-3ddd13b2d6db admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:35.924366 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d13c35-f18e-46b9-bcd0-3ddd13b2d6db admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:35.929924 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 461/912] 10.222.0.18 () {56 vars in 1143 bytes} [Tue Oct 12 18:05:35 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:35.936295 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552bfd2e-bf5b-4c79-b0d0-fdd5462f2b91 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:35.938530 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b3fda9-8081-4d53-9be1-85b4883d0af8 None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:35.938811 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b3fda9-8081-4d53-9be1-85b4883d0af8 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:35.939081 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b3fda9-8081-4d53-9be1-85b4883d0af8 None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:35.940798 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 462/913] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:05:35 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:05:35.946464 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af24cc02-5406-4c1d-b6c8-93bc292a2d4a None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:35.946592 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552bfd2e-bf5b-4c79-b0d0-fdd5462f2b91 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:35.946753 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af24cc02-5406-4c1d-b6c8-93bc292a2d4a None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:35.947026 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af24cc02-5406-4c1d-b6c8-93bc292a2d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:35.952573 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5a92c3-e71d-4f4e-bb3f-678a1b96c7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:35.953447 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a92c3-e71d-4f4e-bb3f-678a1b96c7dc admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:35.953732 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a92c3-e71d-4f4e-bb3f-678a1b96c7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:35.954007 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a92c3-e71d-4f4e-bb3f-678a1b96c7dc admin admin] PATH_INFO: `/v3/services` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:35.954728 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5a92c3-e71d-4f4e-bb3f-678a1b96c7dc admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:35.955033 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5a92c3-e71d-4f4e-bb3f-678a1b96c7dc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:35.956871 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5a92c3-e71d-4f4e-bb3f-678a1b96c7dc admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:35.962764 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 452/914] 10.222.0.18 () {56 vars in 1143 bytes} [Tue Oct 12 18:05:35 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:35.965123 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-af24cc02-5406-4c1d-b6c8-93bc292a2d4a None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:05:35.966304 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-af24cc02-5406-4c1d-b6c8-93bc292a2d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:05:35.969255 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5a92c3-e71d-4f4e-bb3f-678a1b96c7dc admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:35.974851 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 463/915] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:05:35 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:05:35.980050 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5a92c3-e71d-4f4e-bb3f-678a1b96c7dc admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:35.984753 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e687ae1-e2bb-4f4c-a2df-4cec67d7a73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:35.985549 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e687ae1-e2bb-4f4c-a2df-4cec67d7a73d admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:35.985966 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e687ae1-e2bb-4f4c-a2df-4cec67d7a73d admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:35.986398 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e687ae1-e2bb-4f4c-a2df-4cec67d7a73d admin admin] PATH_INFO: `/v3/endpoints` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:35.987297 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e687ae1-e2bb-4f4c-a2df-4cec67d7a73d admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:35.989558 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e687ae1-e2bb-4f4c-a2df-4cec67d7a73d admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:35.998986 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af24cc02-5406-4c1d-b6c8-93bc292a2d4a None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:36.008390 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af24cc02-5406-4c1d-b6c8-93bc292a2d4a None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:36.013110 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ee8dee-4174-4fac-9e71-f6e9f8bd442a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:36.013885 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ee8dee-4174-4fac-9e71-f6e9f8bd442a admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:36.014166 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ee8dee-4174-4fac-9e71-f6e9f8bd442a admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:36.014437 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ee8dee-4174-4fac-9e71-f6e9f8bd442a admin admin] PATH_INFO: `/v3/services/compute` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:36.015104 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ee8dee-4174-4fac-9e71-f6e9f8bd442a admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:36.016982 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ee8dee-4174-4fac-9e71-f6e9f8bd442a admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:36.027820 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-12ee8dee-4174-4fac-9e71-f6e9f8bd442a admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 12 18:05:36.028991 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 464/916] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Oct 12 18:05:35 2021] GET /identity/v3/services/compute => generated 88 bytes in 30 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 18:05:36.035925 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ee8dee-4174-4fac-9e71-f6e9f8bd442a admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:36.045150 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ee8dee-4174-4fac-9e71-f6e9f8bd442a admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:36.049627 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd1d5db-5836-4328-915d-b9d13b1967b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:36.050180 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1d5db-5836-4328-915d-b9d13b1967b2 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:36.050462 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1d5db-5836-4328-915d-b9d13b1967b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:36.050759 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1d5db-5836-4328-915d-b9d13b1967b2 admin admin] PATH_INFO: `/v3/services` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:36.052021 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd1d5db-5836-4328-915d-b9d13b1967b2 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:36.052354 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd1d5db-5836-4328-915d-b9d13b1967b2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:36.053928 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd1d5db-5836-4328-915d-b9d13b1967b2 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:36.058845 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 465/917] 10.222.0.18 () {56 vars in 1133 bytes} [Tue Oct 12 18:05:36 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:05:36.064942 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd1d5db-5836-4328-915d-b9d13b1967b2 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:36.073852 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd1d5db-5836-4328-915d-b9d13b1967b2 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:36.078397 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eb7f90-0713-4b7f-acbf-afa172389a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:36.078993 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb7f90-0713-4b7f-acbf-afa172389a52 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:36.079270 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb7f90-0713-4b7f-acbf-afa172389a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:36.079542 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb7f90-0713-4b7f-acbf-afa172389a52 admin admin] PATH_INFO: `/v3/services` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:36.080230 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eb7f90-0713-4b7f-acbf-afa172389a52 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:36.080558 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eb7f90-0713-4b7f-acbf-afa172389a52 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:36.082084 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eb7f90-0713-4b7f-acbf-afa172389a52 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:36.086850 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 466/918] 10.222.0.18 () {56 vars in 1133 bytes} [Tue Oct 12 18:05:36 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:05:36.092952 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eb7f90-0713-4b7f-acbf-afa172389a52 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:36.102264 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eb7f90-0713-4b7f-acbf-afa172389a52 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:36.107478 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffe6a8b-d201-4878-a30f-ed0181067654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:36.108107 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe6a8b-d201-4878-a30f-ed0181067654 admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:36.108389 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe6a8b-d201-4878-a30f-ed0181067654 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:36.108724 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe6a8b-d201-4878-a30f-ed0181067654 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:36.109877 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffe6a8b-d201-4878-a30f-ed0181067654 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:36.111439 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffe6a8b-d201-4878-a30f-ed0181067654 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:36.188427 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 453/919] 10.222.0.18 () {60 vars in 1165 bytes} [Tue Oct 12 18:05:35 2021] POST /identity/v3/endpoints => generated 325 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 18:05:36.317730 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 467/920] 10.222.0.18 () {60 vars in 1165 bytes} [Tue Oct 12 18:05:36 2021] POST /identity/v3/endpoints => generated 334 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 18:05:38.016734 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d2e609-38b9-4194-868a-d6b4e189d6e9 None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:38.017248 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d2e609-38b9-4194-868a-d6b4e189d6e9 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:38.017340 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d2e609-38b9-4194-868a-d6b4e189d6e9 None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:38.020446 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 454/921] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:05:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:05:38.025495 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e9726-d0b6-4081-bbb3-4ada09428e91 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:38.025894 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e9726-d0b6-4081-bbb3-4ada09428e91 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:38.026054 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e9726-d0b6-4081-bbb3-4ada09428e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:38.043871 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-190e9726-d0b6-4081-bbb3-4ada09428e91 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:05:38.045086 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-190e9726-d0b6-4081-bbb3-4ada09428e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:05:38.065299 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 468/922] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:05:38 2021] POST /identity/v3/auth/tokens => generated 2977 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:05:38.089563 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d2e609-38b9-4194-868a-d6b4e189d6e9 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:38.101818 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d2e609-38b9-4194-868a-d6b4e189d6e9 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:38.106150 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c123fe-497d-495f-876f-470c5b50b934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:38.106928 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c123fe-497d-495f-876f-470c5b50b934 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:38.107205 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c123fe-497d-495f-876f-470c5b50b934 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:38.107476 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c123fe-497d-495f-876f-470c5b50b934 admin admin] PATH_INFO: `/v3/services/image` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:38.108138 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c123fe-497d-495f-876f-470c5b50b934 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:38.110051 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c123fe-497d-495f-876f-470c5b50b934 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:38.121686 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-b0c123fe-497d-495f-876f-470c5b50b934 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 12 18:05:38.123068 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 455/923] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Oct 12 18:05:38 2021] GET /identity/v3/services/image => generated 86 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:38.130136 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190e9726-d0b6-4081-bbb3-4ada09428e91 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:38.139571 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190e9726-d0b6-4081-bbb3-4ada09428e91 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:38.144720 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f553fbf-1bf0-4e4e-9017-8b633d96aacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:38.145437 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f553fbf-1bf0-4e4e-9017-8b633d96aacb admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:38.145787 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f553fbf-1bf0-4e4e-9017-8b633d96aacb admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:38.146313 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f553fbf-1bf0-4e4e-9017-8b633d96aacb admin admin] PATH_INFO: `/v3/services` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:38.147142 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f553fbf-1bf0-4e4e-9017-8b633d96aacb admin admin] RBAC: Adding query filter params (name=image) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:38.147512 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f553fbf-1bf0-4e4e-9017-8b633d96aacb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:38.149309 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f553fbf-1bf0-4e4e-9017-8b633d96aacb admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:38.159320 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 469/924] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:05:38 2021] GET /identity/v3/services?name=image => generated 122 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:05:38.160567 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c123fe-497d-495f-876f-470c5b50b934 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:38.170586 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c123fe-497d-495f-876f-470c5b50b934 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:38.175044 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b612cb37-bb37-4331-b8eb-ee1f879a32d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:38.176202 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b612cb37-bb37-4331-b8eb-ee1f879a32d4 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:38.176508 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b612cb37-bb37-4331-b8eb-ee1f879a32d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:38.176786 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b612cb37-bb37-4331-b8eb-ee1f879a32d4 admin admin] PATH_INFO: `/v3/services` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:38.177495 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b612cb37-bb37-4331-b8eb-ee1f879a32d4 admin admin] RBAC: Adding query filter params (type=image) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:38.177797 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b612cb37-bb37-4331-b8eb-ee1f879a32d4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:38.179366 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b612cb37-bb37-4331-b8eb-ee1f879a32d4 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:38.189368 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 456/925] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:05:38 2021] GET /identity/v3/services?type=image => generated 350 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:38.190573 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f553fbf-1bf0-4e4e-9017-8b633d96aacb admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:38.201060 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f553fbf-1bf0-4e4e-9017-8b633d96aacb admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:38.205610 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d20d214-471e-4c89-aa18-889da7aa3067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:38.206339 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d20d214-471e-4c89-aa18-889da7aa3067 admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:38.206689 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d20d214-471e-4c89-aa18-889da7aa3067 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:38.207077 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d20d214-471e-4c89-aa18-889da7aa3067 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:38.207890 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d20d214-471e-4c89-aa18-889da7aa3067 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:38.209577 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d20d214-471e-4c89-aa18-889da7aa3067 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:38.288568 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 470/926] 10.222.0.18 () {60 vars in 1165 bytes} [Tue Oct 12 18:05:38 2021] POST /identity/v3/endpoints => generated 327 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:05:38.439347 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc17fbec-ef5d-4d1a-8ca2-d3a80e30d9d4 None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:38.439634 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc17fbec-ef5d-4d1a-8ca2-d3a80e30d9d4 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:38.439907 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc17fbec-ef5d-4d1a-8ca2-d3a80e30d9d4 None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:38.442463 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 457/927] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:05:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:05:38.448715 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5741c-73e8-4df2-b03d-c514f294898f None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:38.449005 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5741c-73e8-4df2-b03d-c514f294898f None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:38.449284 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5741c-73e8-4df2-b03d-c514f294898f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:38.468492 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-a0f5741c-73e8-4df2-b03d-c514f294898f None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:05:38.469576 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-a0f5741c-73e8-4df2-b03d-c514f294898f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:05:38.487316 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 471/928] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:05:38 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:05:38.511876 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc17fbec-ef5d-4d1a-8ca2-d3a80e30d9d4 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:38.524694 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc17fbec-ef5d-4d1a-8ca2-d3a80e30d9d4 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:38.529324 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee600e73-ba1a-4f66-afbd-d1b819cc42f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:38.530145 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee600e73-ba1a-4f66-afbd-d1b819cc42f7 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:38.530430 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee600e73-ba1a-4f66-afbd-d1b819cc42f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:38.530695 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee600e73-ba1a-4f66-afbd-d1b819cc42f7 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:38.531995 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee600e73-ba1a-4f66-afbd-d1b819cc42f7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:38.533772 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee600e73-ba1a-4f66-afbd-d1b819cc42f7 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:38.536349 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 458/929] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:05:38 2021] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:38.543432 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f5741c-73e8-4df2-b03d-c514f294898f None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:38.553416 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f5741c-73e8-4df2-b03d-c514f294898f None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:38.558130 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f244684a-769b-4799-88a6-24f014591e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:38.558820 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f244684a-769b-4799-88a6-24f014591e01 admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:38.559100 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f244684a-769b-4799-88a6-24f014591e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:38.559376 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f244684a-769b-4799-88a6-24f014591e01 admin admin] PATH_INFO: `/v3/projects` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:38.560117 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f244684a-769b-4799-88a6-24f014591e01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:38.562097 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f244684a-769b-4799-88a6-24f014591e01 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:38.678171 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdea44e4-f1ce-4bac-ba49-c064e5a61d20 None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:38.678453 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdea44e4-f1ce-4bac-ba49-c064e5a61d20 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:38.678733 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdea44e4-f1ce-4bac-ba49-c064e5a61d20 None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:38.680513 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 459/930] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:05:38 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:05:38.686057 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d08e4a0-2b22-45a8-ac9b-7ca1a1b67499 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:38.686335 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d08e4a0-2b22-45a8-ac9b-7ca1a1b67499 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:38.686602 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d08e4a0-2b22-45a8-ac9b-7ca1a1b67499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:38.704166 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-8d08e4a0-2b22-45a8-ac9b-7ca1a1b67499 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:05:38.705374 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-8d08e4a0-2b22-45a8-ac9b-7ca1a1b67499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:05:38.706052 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 472/931] 10.222.0.18 () {60 vars in 1162 bytes} [Tue Oct 12 18:05:38 2021] POST /identity/v3/projects => generated 311 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:05:38.770138 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 460/932] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:05:38 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:05:38.796204 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f244684a-769b-4799-88a6-24f014591e01 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:38.806591 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f244684a-769b-4799-88a6-24f014591e01 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:38.811274 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a48c9c5-328f-4558-90fc-d3cf4bc55c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:38.812075 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48c9c5-328f-4558-90fc-d3cf4bc55c49 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:38.812359 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48c9c5-328f-4558-90fc-d3cf4bc55c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:38.812674 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48c9c5-328f-4558-90fc-d3cf4bc55c49 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:38.824539 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a48c9c5-328f-4558-90fc-d3cf4bc55c49 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 18:05:38.832821 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-0a48c9c5-328f-4558-90fc-d3cf4bc55c49 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 12 18:05:38.834294 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 473/933] 10.222.0.18 () {56 vars in 1141 bytes} [Tue Oct 12 18:05:38 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:38.840933 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d08e4a0-2b22-45a8-ac9b-7ca1a1b67499 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:38.851762 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d08e4a0-2b22-45a8-ac9b-7ca1a1b67499 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:38.856588 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7a0da8-0bdf-4b97-a0ec-070c7d7c7f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:38.857291 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7a0da8-0bdf-4b97-a0ec-070c7d7c7f6e admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:38.857573 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7a0da8-0bdf-4b97-a0ec-070c7d7c7f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:38.857845 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7a0da8-0bdf-4b97-a0ec-070c7d7c7f6e admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:38.858624 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7a0da8-0bdf-4b97-a0ec-070c7d7c7f6e admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:38.858934 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7a0da8-0bdf-4b97-a0ec-070c7d7c7f6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:38.860877 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7a0da8-0bdf-4b97-a0ec-070c7d7c7f6e admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:38.870136 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 461/934] 10.222.0.18 () {56 vars in 1136 bytes} [Tue Oct 12 18:05:38 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:38.876535 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a48c9c5-328f-4558-90fc-d3cf4bc55c49 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:38.886761 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a48c9c5-328f-4558-90fc-d3cf4bc55c49 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:38.891723 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0470b-06b0-4859-985d-97705f0721fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:38.892564 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0470b-06b0-4859-985d-97705f0721fe admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:38.892844 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0470b-06b0-4859-985d-97705f0721fe admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:38.893112 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0470b-06b0-4859-985d-97705f0721fe admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:38.905064 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd0470b-06b0-4859-985d-97705f0721fe admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:38.906531 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd0470b-06b0-4859-985d-97705f0721fe admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:38.924295 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-fdd0470b-06b0-4859-985d-97705f0721fe admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 18:05:38.926293 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 474/935] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:05:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:38.932330 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7a0da8-0bdf-4b97-a0ec-070c7d7c7f6e admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:38.942641 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7a0da8-0bdf-4b97-a0ec-070c7d7c7f6e admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:38.947212 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb2082a-ab15-4a37-b4c6-7f1eaa834849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:38.947913 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2082a-ab15-4a37-b4c6-7f1eaa834849 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:38.948192 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2082a-ab15-4a37-b4c6-7f1eaa834849 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:38.948527 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2082a-ab15-4a37-b4c6-7f1eaa834849 admin admin] PATH_INFO: `/v3/domains` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:38.949251 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb2082a-ab15-4a37-b4c6-7f1eaa834849 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:38.949611 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb2082a-ab15-4a37-b4c6-7f1eaa834849 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:38.951182 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb2082a-ab15-4a37-b4c6-7f1eaa834849 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:38.964292 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 462/936] 10.222.0.18 () {56 vars in 1130 bytes} [Tue Oct 12 18:05:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:05:38.970398 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0470b-06b0-4859-985d-97705f0721fe admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:38.980049 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0470b-06b0-4859-985d-97705f0721fe admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:38.984598 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7c73df-b275-42bc-b638-d990ba702fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:38.985367 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c73df-b275-42bc-b638-d990ba702fe0 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:38.985646 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c73df-b275-42bc-b638-d990ba702fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:38.985914 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c73df-b275-42bc-b638-d990ba702fe0 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:38.993636 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7c73df-b275-42bc-b638-d990ba702fe0 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:38.995674 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7c73df-b275-42bc-b638-d990ba702fe0 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:39.010269 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-fc7c73df-b275-42bc-b638-d990ba702fe0 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 12 18:05:39.011639 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 475/937] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Oct 12 18:05:38 2021] GET /identity/v3/users/nova => generated 82 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:39.018014 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb2082a-ab15-4a37-b4c6-7f1eaa834849 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:39.028447 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb2082a-ab15-4a37-b4c6-7f1eaa834849 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:39.032857 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d130bb93-c3c7-44f5-99a2-60e294fa9e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:39.033555 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d130bb93-c3c7-44f5-99a2-60e294fa9e98 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:39.033837 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d130bb93-c3c7-44f5-99a2-60e294fa9e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:39.034104 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d130bb93-c3c7-44f5-99a2-60e294fa9e98 admin admin] PATH_INFO: `/v3/users` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:39.034933 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d130bb93-c3c7-44f5-99a2-60e294fa9e98 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:39.035789 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d130bb93-c3c7-44f5-99a2-60e294fa9e98 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:39.037643 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d130bb93-c3c7-44f5-99a2-60e294fa9e98 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:39.054808 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 463/938] 10.222.0.18 () {56 vars in 1154 bytes} [Tue Oct 12 18:05:39 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:05:39.060769 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7c73df-b275-42bc-b638-d990ba702fe0 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:39.070912 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7c73df-b275-42bc-b638-d990ba702fe0 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:39.075440 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc35aeb-b027-4af1-aeae-823d15fcda4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:39.076143 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc35aeb-b027-4af1-aeae-823d15fcda4b admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:39.076540 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc35aeb-b027-4af1-aeae-823d15fcda4b admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:39.076900 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc35aeb-b027-4af1-aeae-823d15fcda4b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:39.085259 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc35aeb-b027-4af1-aeae-823d15fcda4b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:39.087001 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc35aeb-b027-4af1-aeae-823d15fcda4b admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:39.095845 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 476/939] 10.222.0.18 () {58 vars in 1324 bytes} [Tue Oct 12 18:05:39 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:05:39.101966 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d130bb93-c3c7-44f5-99a2-60e294fa9e98 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:39.111495 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d130bb93-c3c7-44f5-99a2-60e294fa9e98 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:39.115987 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a5e651-ea5d-419d-b7dd-d952b80db796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:39.116800 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5e651-ea5d-419d-b7dd-d952b80db796 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:39.122973 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5e651-ea5d-419d-b7dd-d952b80db796 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:39.122973 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5e651-ea5d-419d-b7dd-d952b80db796 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:39.127478 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a5e651-ea5d-419d-b7dd-d952b80db796 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:39.129878 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a5e651-ea5d-419d-b7dd-d952b80db796 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:39.147212 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-b1a5e651-ea5d-419d-b7dd-d952b80db796 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 18:05:39.148616 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 464/940] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:05:39 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:39.154563 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc35aeb-b027-4af1-aeae-823d15fcda4b admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:39.163368 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc35aeb-b027-4af1-aeae-823d15fcda4b admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:39.167852 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc8c32e-a6a0-4ebf-828c-e5cad173314e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:39.168527 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8c32e-a6a0-4ebf-828c-e5cad173314e admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:39.168808 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8c32e-a6a0-4ebf-828c-e5cad173314e admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:39.169077 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8c32e-a6a0-4ebf-828c-e5cad173314e admin admin] PATH_INFO: `/v3/domains` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:39.169791 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc8c32e-a6a0-4ebf-828c-e5cad173314e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:39.170090 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc8c32e-a6a0-4ebf-828c-e5cad173314e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:39.171661 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc8c32e-a6a0-4ebf-828c-e5cad173314e admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:39.183367 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 477/941] 10.222.0.18 () {56 vars in 1130 bytes} [Tue Oct 12 18:05:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:39.189284 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a5e651-ea5d-419d-b7dd-d952b80db796 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:39.199300 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a5e651-ea5d-419d-b7dd-d952b80db796 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:39.203734 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cc5276-8c6f-4937-9f0e-d0b11b7cb088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:39.204538 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc5276-8c6f-4937-9f0e-d0b11b7cb088 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:39.204816 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc5276-8c6f-4937-9f0e-d0b11b7cb088 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:39.205085 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc5276-8c6f-4937-9f0e-d0b11b7cb088 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:39.211830 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cc5276-8c6f-4937-9f0e-d0b11b7cb088 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:39.213796 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cc5276-8c6f-4937-9f0e-d0b11b7cb088 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:39.227098 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-89cc5276-8c6f-4937-9f0e-d0b11b7cb088 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 18:05:39.233623 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 465/942] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Oct 12 18:05:39 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:39.235111 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc8c32e-a6a0-4ebf-828c-e5cad173314e admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:39.245248 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc8c32e-a6a0-4ebf-828c-e5cad173314e admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:39.249761 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daae8fe-04f9-4f2d-b986-c5228e278dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:39.250404 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daae8fe-04f9-4f2d-b986-c5228e278dbd admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:39.250685 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daae8fe-04f9-4f2d-b986-c5228e278dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:39.250955 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daae8fe-04f9-4f2d-b986-c5228e278dbd admin admin] PATH_INFO: `/v3/projects` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:39.251741 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daae8fe-04f9-4f2d-b986-c5228e278dbd admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:39.252044 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daae8fe-04f9-4f2d-b986-c5228e278dbd admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:39.253972 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daae8fe-04f9-4f2d-b986-c5228e278dbd admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:39.266825 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 478/943] 10.222.0.18 () {56 vars in 1169 bytes} [Tue Oct 12 18:05:39 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:39.273403 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cc5276-8c6f-4937-9f0e-d0b11b7cb088 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:39.283670 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cc5276-8c6f-4937-9f0e-d0b11b7cb088 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:39.288697 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79740094-7268-4c04-b602-9c4aaaa70e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:39.289328 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79740094-7268-4c04-b602-9c4aaaa70e9d admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:39.289608 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79740094-7268-4c04-b602-9c4aaaa70e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:39.289884 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79740094-7268-4c04-b602-9c4aaaa70e9d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:39.290718 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79740094-7268-4c04-b602-9c4aaaa70e9d admin admin] RBAC: Adding query filter params (role.id=d7656b67d66f4c2d81879698f36ca670, scope.project.id=e843aaa9e5e44a8e98f7cc7412d9697b, user.id=3417097a280b499086b36df9a2548239) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:39.291026 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79740094-7268-4c04-b602-9c4aaaa70e9d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:39.292873 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79740094-7268-4c04-b602-9c4aaaa70e9d admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:39.298338 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 466/944] 10.222.0.18 () {56 vars in 1395 bytes} [Tue Oct 12 18:05:39 2021] GET /identity/v3/role_assignments?user.id=3417097a280b499086b36df9a2548239&scope.project.id=e843aaa9e5e44a8e98f7cc7412d9697b&role.id=d7656b67d66f4c2d81879698f36ca670 => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:40.571435 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e8aabf-a68c-4362-a0d1-d58b984e9faa None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:40.571956 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e8aabf-a68c-4362-a0d1-d58b984e9faa None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:40.571956 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e8aabf-a68c-4362-a0d1-d58b984e9faa None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:40.573796 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 479/945] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:05:40 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:05:40.579550 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2300c36-328e-486c-bc4d-2393f0c45b1d None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:40.579986 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2300c36-328e-486c-bc4d-2393f0c45b1d None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:40.580120 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2300c36-328e-486c-bc4d-2393f0c45b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:40.598227 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-b2300c36-328e-486c-bc4d-2393f0c45b1d None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:05:40.599421 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-b2300c36-328e-486c-bc4d-2393f0c45b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:05:40.607339 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 467/946] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:05:40 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:05:40.631293 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e8aabf-a68c-4362-a0d1-d58b984e9faa None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:40.643674 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e8aabf-a68c-4362-a0d1-d58b984e9faa None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:40.648644 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf915266-8e86-4ba8-9530-b6a6f864cdfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:40.649280 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf915266-8e86-4ba8-9530-b6a6f864cdfd admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:40.649563 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf915266-8e86-4ba8-9530-b6a6f864cdfd admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:40.649838 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf915266-8e86-4ba8-9530-b6a6f864cdfd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:40.657410 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf915266-8e86-4ba8-9530-b6a6f864cdfd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:40.659234 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf915266-8e86-4ba8-9530-b6a6f864cdfd admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:40.668175 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 480/947] 10.222.0.18 () {58 vars in 1324 bytes} [Tue Oct 12 18:05:40 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:05:40.674660 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2300c36-328e-486c-bc4d-2393f0c45b1d None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:40.683631 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2300c36-328e-486c-bc4d-2393f0c45b1d None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:40.688150 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c460dace-ef49-485b-9f0a-e43766fc52cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:40.689023 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c460dace-ef49-485b-9f0a-e43766fc52cc admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:40.689387 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c460dace-ef49-485b-9f0a-e43766fc52cc admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:40.689663 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c460dace-ef49-485b-9f0a-e43766fc52cc admin admin] PATH_INFO: `/v3/domains/default` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:40.690835 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c460dace-ef49-485b-9f0a-e43766fc52cc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:40.693055 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c460dace-ef49-485b-9f0a-e43766fc52cc admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:40.694733 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 468/948] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:05:40 2021] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:05:41.007138 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f2ff9d-ea47-4b4c-a47f-ff29bc9e9f32 None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:41.007333 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f2ff9d-ea47-4b4c-a47f-ff29bc9e9f32 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:41.007611 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f2ff9d-ea47-4b4c-a47f-ff29bc9e9f32 None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:41.009493 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 481/949] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:05:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:05:41.015484 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bfea64-d21e-487a-a56d-380dc3370bef None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:41.015768 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bfea64-d21e-487a-a56d-380dc3370bef None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:41.016304 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bfea64-d21e-487a-a56d-380dc3370bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:41.034515 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-d1bfea64-d21e-487a-a56d-380dc3370bef None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:05:41.036223 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-d1bfea64-d21e-487a-a56d-380dc3370bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:05:41.043827 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 469/950] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:05:41 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:05:41.069399 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f2ff9d-ea47-4b4c-a47f-ff29bc9e9f32 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:41.081496 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f2ff9d-ea47-4b4c-a47f-ff29bc9e9f32 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:41.086365 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c05263-544f-409d-99e9-c8a0ae662cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:41.087134 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c05263-544f-409d-99e9-c8a0ae662cb3 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:41.087413 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c05263-544f-409d-99e9-c8a0ae662cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:41.087684 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c05263-544f-409d-99e9-c8a0ae662cb3 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:41.088896 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c05263-544f-409d-99e9-c8a0ae662cb3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:41.090588 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c05263-544f-409d-99e9-c8a0ae662cb3 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:41.092162 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 482/951] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:05:41 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:41.099058 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bfea64-d21e-487a-a56d-380dc3370bef None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:41.108057 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bfea64-d21e-487a-a56d-380dc3370bef None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:41.112710 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea09ae92-5617-4b54-a88a-4bbff9859ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:41.113870 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea09ae92-5617-4b54-a88a-4bbff9859ba1 admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:41.114149 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea09ae92-5617-4b54-a88a-4bbff9859ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:41.114422 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea09ae92-5617-4b54-a88a-4bbff9859ba1 admin admin] PATH_INFO: `/v3/users` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:41.115138 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea09ae92-5617-4b54-a88a-4bbff9859ba1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:41.117082 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea09ae92-5617-4b54-a88a-4bbff9859ba1 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:41.204426 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 470/952] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Oct 12 18:05:41 2021] POST /identity/v3/users => generated 285 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:05:41.525707 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782cfbf3-771e-4035-8b65-50c994152a8a None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:41.525987 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782cfbf3-771e-4035-8b65-50c994152a8a None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:41.526258 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782cfbf3-771e-4035-8b65-50c994152a8a None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:41.528018 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 483/953] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:05:41 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:05:41.533971 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d684332-259c-447b-946d-94fa83a22053 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:41.534259 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d684332-259c-447b-946d-94fa83a22053 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:41.534528 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d684332-259c-447b-946d-94fa83a22053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:41.551773 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-6d684332-259c-447b-946d-94fa83a22053 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:05:41.552952 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-6d684332-259c-447b-946d-94fa83a22053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:05:41.560464 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 471/954] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:05:41 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:05:41.584245 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782cfbf3-771e-4035-8b65-50c994152a8a None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:41.596098 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782cfbf3-771e-4035-8b65-50c994152a8a None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:41.600451 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e045611-eb79-47bd-a56c-25e32c12f363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:41.601234 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e045611-eb79-47bd-a56c-25e32c12f363 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:41.601509 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e045611-eb79-47bd-a56c-25e32c12f363 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:41.601778 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e045611-eb79-47bd-a56c-25e32c12f363 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:41.611549 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e045611-eb79-47bd-a56c-25e32c12f363 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 18:05:41.618900 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-3e045611-eb79-47bd-a56c-25e32c12f363 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 12 18:05:41.620085 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 484/955] 10.222.0.18 () {56 vars in 1141 bytes} [Tue Oct 12 18:05:41 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:41.627290 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d684332-259c-447b-946d-94fa83a22053 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:41.637171 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d684332-259c-447b-946d-94fa83a22053 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:41.641848 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df90a31-d1cd-4e55-8f8d-c684034e0545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:41.642493 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df90a31-d1cd-4e55-8f8d-c684034e0545 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:41.642765 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df90a31-d1cd-4e55-8f8d-c684034e0545 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:41.643034 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df90a31-d1cd-4e55-8f8d-c684034e0545 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:41.643785 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df90a31-d1cd-4e55-8f8d-c684034e0545 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:41.644083 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df90a31-d1cd-4e55-8f8d-c684034e0545 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:41.646288 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df90a31-d1cd-4e55-8f8d-c684034e0545 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:41.654094 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 472/956] 10.222.0.18 () {56 vars in 1136 bytes} [Tue Oct 12 18:05:41 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:41.660221 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e045611-eb79-47bd-a56c-25e32c12f363 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:41.670157 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e045611-eb79-47bd-a56c-25e32c12f363 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:41.674604 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e568684b-71da-4e2b-8269-8466d6ff192e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:41.675360 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e568684b-71da-4e2b-8269-8466d6ff192e admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:41.676154 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e568684b-71da-4e2b-8269-8466d6ff192e admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:41.676446 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e568684b-71da-4e2b-8269-8466d6ff192e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:41.686183 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e568684b-71da-4e2b-8269-8466d6ff192e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:41.687988 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e568684b-71da-4e2b-8269-8466d6ff192e admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:41.704708 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-e568684b-71da-4e2b-8269-8466d6ff192e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 18:05:41.706012 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 485/957] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:05:41 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:41.711872 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df90a31-d1cd-4e55-8f8d-c684034e0545 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:41.721367 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df90a31-d1cd-4e55-8f8d-c684034e0545 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:41.725905 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db778f1-07b1-487b-8b34-3263bc7be3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:41.726611 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db778f1-07b1-487b-8b34-3263bc7be3b1 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:41.726965 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db778f1-07b1-487b-8b34-3263bc7be3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:41.727304 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db778f1-07b1-487b-8b34-3263bc7be3b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:41.728099 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db778f1-07b1-487b-8b34-3263bc7be3b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:41.728512 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db778f1-07b1-487b-8b34-3263bc7be3b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:41.730163 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db778f1-07b1-487b-8b34-3263bc7be3b1 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:41.743141 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 473/958] 10.222.0.18 () {56 vars in 1130 bytes} [Tue Oct 12 18:05:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:41.748956 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e568684b-71da-4e2b-8269-8466d6ff192e admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:41.758779 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e568684b-71da-4e2b-8269-8466d6ff192e admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:41.763319 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3883d678-5393-4f9b-84aa-900db44c51fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:41.764077 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3883d678-5393-4f9b-84aa-900db44c51fd admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:41.764356 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3883d678-5393-4f9b-84aa-900db44c51fd admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:41.764665 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3883d678-5393-4f9b-84aa-900db44c51fd admin admin] PATH_INFO: `/v3/users/nova` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:41.771958 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3883d678-5393-4f9b-84aa-900db44c51fd admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:41.774063 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3883d678-5393-4f9b-84aa-900db44c51fd admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:41.787346 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-3883d678-5393-4f9b-84aa-900db44c51fd admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 12 18:05:41.788537 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 486/959] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Oct 12 18:05:41 2021] GET /identity/v3/users/nova => generated 82 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 18:05:41.794210 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db778f1-07b1-487b-8b34-3263bc7be3b1 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:41.803986 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db778f1-07b1-487b-8b34-3263bc7be3b1 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:41.808439 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f41ea9-8dcc-4671-a149-2524e2d5a880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:41.809142 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f41ea9-8dcc-4671-a149-2524e2d5a880 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:41.809482 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f41ea9-8dcc-4671-a149-2524e2d5a880 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:41.809822 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f41ea9-8dcc-4671-a149-2524e2d5a880 admin admin] PATH_INFO: `/v3/users` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:41.810736 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f41ea9-8dcc-4671-a149-2524e2d5a880 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:41.811108 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f41ea9-8dcc-4671-a149-2524e2d5a880 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:41.813052 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f41ea9-8dcc-4671-a149-2524e2d5a880 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:41.835024 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 474/960] 10.222.0.18 () {56 vars in 1154 bytes} [Tue Oct 12 18:05:41 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:41.836242 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3883d678-5393-4f9b-84aa-900db44c51fd admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:41.845414 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3883d678-5393-4f9b-84aa-900db44c51fd admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:41.849807 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b6a0c0-5fff-41ed-9ea8-f221b99eca5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:41.850557 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b6a0c0-5fff-41ed-9ea8-f221b99eca5c admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:41.850834 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b6a0c0-5fff-41ed-9ea8-f221b99eca5c admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:41.851102 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b6a0c0-5fff-41ed-9ea8-f221b99eca5c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:41.861200 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b6a0c0-5fff-41ed-9ea8-f221b99eca5c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:41.863507 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b6a0c0-5fff-41ed-9ea8-f221b99eca5c admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:41.880091 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-28b6a0c0-5fff-41ed-9ea8-f221b99eca5c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 18:05:41.881241 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 487/961] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:05:41 2021] GET /identity/v3/domains/Default => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:41.887319 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f41ea9-8dcc-4671-a149-2524e2d5a880 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:41.896887 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f41ea9-8dcc-4671-a149-2524e2d5a880 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:41.901277 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c176c7-9807-46b8-918e-89d49e7ffead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:41.901908 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c176c7-9807-46b8-918e-89d49e7ffead admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:41.902183 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c176c7-9807-46b8-918e-89d49e7ffead admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:41.902452 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c176c7-9807-46b8-918e-89d49e7ffead admin admin] PATH_INFO: `/v3/domains` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:41.903167 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c176c7-9807-46b8-918e-89d49e7ffead admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:41.903467 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c176c7-9807-46b8-918e-89d49e7ffead admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:41.905066 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c176c7-9807-46b8-918e-89d49e7ffead admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:41.915860 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 475/962] 10.222.0.18 () {56 vars in 1130 bytes} [Tue Oct 12 18:05:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:41.921791 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b6a0c0-5fff-41ed-9ea8-f221b99eca5c admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:41.931783 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b6a0c0-5fff-41ed-9ea8-f221b99eca5c admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:41.936312 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad11321a-773c-4c77-8b6c-b831ceaa4764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:41.937111 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11321a-773c-4c77-8b6c-b831ceaa4764 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:41.937392 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11321a-773c-4c77-8b6c-b831ceaa4764 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:41.937664 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11321a-773c-4c77-8b6c-b831ceaa4764 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:41.945024 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad11321a-773c-4c77-8b6c-b831ceaa4764 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:41.946975 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad11321a-773c-4c77-8b6c-b831ceaa4764 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:41.959634 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-ad11321a-773c-4c77-8b6c-b831ceaa4764 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 18:05:41.960811 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 488/963] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Oct 12 18:05:41 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:41.967087 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c176c7-9807-46b8-918e-89d49e7ffead admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:41.976671 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c176c7-9807-46b8-918e-89d49e7ffead admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:41.981162 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76812ee1-96fb-45fd-a114-1ad47fa7b450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:41.981870 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76812ee1-96fb-45fd-a114-1ad47fa7b450 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:41.982212 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76812ee1-96fb-45fd-a114-1ad47fa7b450 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:41.982549 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76812ee1-96fb-45fd-a114-1ad47fa7b450 admin admin] PATH_INFO: `/v3/projects` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:41.983414 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76812ee1-96fb-45fd-a114-1ad47fa7b450 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:41.983780 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76812ee1-96fb-45fd-a114-1ad47fa7b450 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:41.985715 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76812ee1-96fb-45fd-a114-1ad47fa7b450 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:41.997839 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 476/964] 10.222.0.18 () {56 vars in 1169 bytes} [Tue Oct 12 18:05:41 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:42.004295 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad11321a-773c-4c77-8b6c-b831ceaa4764 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:42.014430 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad11321a-773c-4c77-8b6c-b831ceaa4764 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:42.019829 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c37c46-f121-4be6-b09d-ef91a029b5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:42.020746 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c37c46-f121-4be6-b09d-ef91a029b5cc admin admin] REQUEST_METHOD: `PUT` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:42.021030 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c37c46-f121-4be6-b09d-ef91a029b5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:42.021303 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c37c46-f121-4be6-b09d-ef91a029b5cc admin admin] PATH_INFO: `/v3/projects/e843aaa9e5e44a8e98f7cc7412d9697b/users/3417097a280b499086b36df9a2548239/roles/d7656b67d66f4c2d81879698f36ca670` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:42.023543 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c37c46-f121-4be6-b09d-ef91a029b5cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e843aaa9e5e44a8e98f7cc7412d9697b, user_id=3417097a280b499086b36df9a2548239, role_id=d7656b67d66f4c2d81879698f36ca670)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:42.026232 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c37c46-f121-4be6-b09d-ef91a029b5cc admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:42.092792 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 489/965] 10.222.0.18 () {58 vars in 1460 bytes} [Tue Oct 12 18:05:42 2021] PUT /identity/v3/projects/e843aaa9e5e44a8e98f7cc7412d9697b/users/3417097a280b499086b36df9a2548239/roles/d7656b67d66f4c2d81879698f36ca670 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:05:43.468937 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb1f19a-90cb-4a01-afc4-a75a8f7d6064 None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:43.469496 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb1f19a-90cb-4a01-afc4-a75a8f7d6064 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:43.469496 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb1f19a-90cb-4a01-afc4-a75a8f7d6064 None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:43.471220 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 477/966] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:05:43 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:05:43.477271 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51695fa-43a2-4816-aa72-aff1570829bc None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:43.477706 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51695fa-43a2-4816-aa72-aff1570829bc None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:43.477810 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51695fa-43a2-4816-aa72-aff1570829bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:43.495488 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-d51695fa-43a2-4816-aa72-aff1570829bc None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:05:43.496697 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-d51695fa-43a2-4816-aa72-aff1570829bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:05:43.553250 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 490/967] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:05:43 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:05:43.578017 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb1f19a-90cb-4a01-afc4-a75a8f7d6064 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:43.590400 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb1f19a-90cb-4a01-afc4-a75a8f7d6064 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:43.594662 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4a8dbf-a881-4761-9792-2e5422dbe0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:43.595434 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a8dbf-a881-4761-9792-2e5422dbe0cc admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:43.595714 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a8dbf-a881-4761-9792-2e5422dbe0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:43.595988 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a8dbf-a881-4761-9792-2e5422dbe0cc admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:43.605835 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4a8dbf-a881-4761-9792-2e5422dbe0cc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 18:05:43.612659 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-7d4a8dbf-a881-4761-9792-2e5422dbe0cc admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 18:05:43.614025 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 478/968] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Oct 12 18:05:43 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:43.620613 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51695fa-43a2-4816-aa72-aff1570829bc None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:43.630137 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51695fa-43a2-4816-aa72-aff1570829bc None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:43.634639 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645fb7a5-803a-40f7-9560-fc068c3b56f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:43.635302 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645fb7a5-803a-40f7-9560-fc068c3b56f1 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:43.635583 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645fb7a5-803a-40f7-9560-fc068c3b56f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:43.635857 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645fb7a5-803a-40f7-9560-fc068c3b56f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:43.636641 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645fb7a5-803a-40f7-9560-fc068c3b56f1 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:43.636947 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645fb7a5-803a-40f7-9560-fc068c3b56f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:43.638543 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645fb7a5-803a-40f7-9560-fc068c3b56f1 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:43.647514 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 491/969] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Oct 12 18:05:43 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:43.653883 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4a8dbf-a881-4761-9792-2e5422dbe0cc admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:43.663806 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4a8dbf-a881-4761-9792-2e5422dbe0cc admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:43.668244 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1691ab6-3060-477f-b613-b674dc9c0f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:43.669114 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1691ab6-3060-477f-b613-b674dc9c0f0e admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:43.669388 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1691ab6-3060-477f-b613-b674dc9c0f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:43.669654 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1691ab6-3060-477f-b613-b674dc9c0f0e admin admin] PATH_INFO: `/v3/users/cd82e48799464251a0b9b7bee15b43d8` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:43.682236 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1691ab6-3060-477f-b613-b674dc9c0f0e admin admin] RBAC: Authorizing `identity:get_user(user_id=cd82e48799464251a0b9b7bee15b43d8)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:43.684353 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1691ab6-3060-477f-b613-b674dc9c0f0e admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:43.685973 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 479/970] 10.222.0.18 () {56 vars in 1198 bytes} [Tue Oct 12 18:05:43 2021] GET /identity/v3/users/cd82e48799464251a0b9b7bee15b43d8 => generated 285 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:43.692668 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645fb7a5-803a-40f7-9560-fc068c3b56f1 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:43.701933 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645fb7a5-803a-40f7-9560-fc068c3b56f1 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:43.706381 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd1b71-ba89-47cd-b752-148bb2489207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:43.707561 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd1b71-ba89-47cd-b752-148bb2489207 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:43.707845 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd1b71-ba89-47cd-b752-148bb2489207 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:43.708118 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd1b71-ba89-47cd-b752-148bb2489207 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:43.715719 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cd1b71-ba89-47cd-b752-148bb2489207 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:43.717496 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cd1b71-ba89-47cd-b752-148bb2489207 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:43.726168 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 492/971] 10.222.0.18 () {58 vars in 1324 bytes} [Tue Oct 12 18:05:43 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:05:43.732616 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1691ab6-3060-477f-b613-b674dc9c0f0e admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:43.741964 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1691ab6-3060-477f-b613-b674dc9c0f0e admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:43.746384 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35099c39-f8fe-47d6-b162-e2bfd089e5e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:43.747220 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35099c39-f8fe-47d6-b162-e2bfd089e5e0 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:43.747496 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35099c39-f8fe-47d6-b162-e2bfd089e5e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:43.747769 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35099c39-f8fe-47d6-b162-e2bfd089e5e0 admin admin] PATH_INFO: `/v3/projects/3d16c56719034966bc6ffb0bd9ef6a88` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:43.748967 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35099c39-f8fe-47d6-b162-e2bfd089e5e0 admin admin] RBAC: Authorizing `identity:get_project(project_id=3d16c56719034966bc6ffb0bd9ef6a88)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:43.750987 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35099c39-f8fe-47d6-b162-e2bfd089e5e0 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:43.752644 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 480/972] 10.222.0.18 () {56 vars in 1207 bytes} [Tue Oct 12 18:05:43 2021] GET /identity/v3/projects/3d16c56719034966bc6ffb0bd9ef6a88 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:43.759768 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd1b71-ba89-47cd-b752-148bb2489207 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:43.768838 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd1b71-ba89-47cd-b752-148bb2489207 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:43.773987 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c60839-8d5d-4441-aef6-a201872c3c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:43.774720 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c60839-8d5d-4441-aef6-a201872c3c2b admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:43.775069 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c60839-8d5d-4441-aef6-a201872c3c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:43.775349 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c60839-8d5d-4441-aef6-a201872c3c2b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:43.776181 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c60839-8d5d-4441-aef6-a201872c3c2b admin admin] RBAC: Adding query filter params (role.id=6c54f239944d46e3b027ccce97eb8b49, scope.project.id=3d16c56719034966bc6ffb0bd9ef6a88, user.id=cd82e48799464251a0b9b7bee15b43d8) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:43.776527 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c60839-8d5d-4441-aef6-a201872c3c2b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:43.778359 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c60839-8d5d-4441-aef6-a201872c3c2b admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:43.783630 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 493/973] 10.222.0.18 () {56 vars in 1395 bytes} [Tue Oct 12 18:05:43 2021] GET /identity/v3/role_assignments?user.id=cd82e48799464251a0b9b7bee15b43d8&scope.project.id=3d16c56719034966bc6ffb0bd9ef6a88&role.id=6c54f239944d46e3b027ccce97eb8b49 => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:44.372442 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc43a4-1b25-4eb5-8c24-ceea87dc22b8 None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:44.372732 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc43a4-1b25-4eb5-8c24-ceea87dc22b8 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:44.373005 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc43a4-1b25-4eb5-8c24-ceea87dc22b8 None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:44.374767 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 481/974] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:05:44 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:05:44.381054 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea4b27-3c46-49c3-9f31-a79d9e23abe0 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:44.381348 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea4b27-3c46-49c3-9f31-a79d9e23abe0 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:44.381629 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea4b27-3c46-49c3-9f31-a79d9e23abe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:44.401062 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-acea4b27-3c46-49c3-9f31-a79d9e23abe0 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:05:44.402233 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-acea4b27-3c46-49c3-9f31-a79d9e23abe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:05:44.409719 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 494/975] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:05:44 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:05:44.435467 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edc43a4-1b25-4eb5-8c24-ceea87dc22b8 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:44.447969 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edc43a4-1b25-4eb5-8c24-ceea87dc22b8 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:44.452239 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792aee5c-913d-4afc-a720-214b5227c5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:44.453071 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792aee5c-913d-4afc-a720-214b5227c5a4 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:44.453346 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792aee5c-913d-4afc-a720-214b5227c5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:44.453614 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792aee5c-913d-4afc-a720-214b5227c5a4 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:44.465967 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792aee5c-913d-4afc-a720-214b5227c5a4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 18:05:44.473341 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-792aee5c-913d-4afc-a720-214b5227c5a4 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 12 18:05:44.474500 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 482/976] 10.222.0.18 () {56 vars in 1141 bytes} [Tue Oct 12 18:05:44 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:44.480896 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acea4b27-3c46-49c3-9f31-a79d9e23abe0 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:44.489773 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acea4b27-3c46-49c3-9f31-a79d9e23abe0 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:44.496131 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945db27f-ee66-4fdd-9fc0-9c6393a0be2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:44.496811 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945db27f-ee66-4fdd-9fc0-9c6393a0be2a admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:44.497096 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945db27f-ee66-4fdd-9fc0-9c6393a0be2a admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:44.497369 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945db27f-ee66-4fdd-9fc0-9c6393a0be2a admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:44.498116 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945db27f-ee66-4fdd-9fc0-9c6393a0be2a admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:44.498418 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945db27f-ee66-4fdd-9fc0-9c6393a0be2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:44.499985 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945db27f-ee66-4fdd-9fc0-9c6393a0be2a admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:44.508590 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 495/977] 10.222.0.18 () {56 vars in 1136 bytes} [Tue Oct 12 18:05:44 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:44.514616 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792aee5c-913d-4afc-a720-214b5227c5a4 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:44.526404 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792aee5c-913d-4afc-a720-214b5227c5a4 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:44.532335 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b199081-6d3e-4e5e-801f-baa5a4bad10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:44.533130 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b199081-6d3e-4e5e-801f-baa5a4bad10e admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:44.533404 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b199081-6d3e-4e5e-801f-baa5a4bad10e admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:44.533675 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b199081-6d3e-4e5e-801f-baa5a4bad10e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:44.544129 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b199081-6d3e-4e5e-801f-baa5a4bad10e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:44.545985 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b199081-6d3e-4e5e-801f-baa5a4bad10e admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:44.563619 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-2b199081-6d3e-4e5e-801f-baa5a4bad10e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 18:05:44.565018 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 483/978] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:05:44 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:44.571832 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945db27f-ee66-4fdd-9fc0-9c6393a0be2a admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:44.581476 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945db27f-ee66-4fdd-9fc0-9c6393a0be2a admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:44.586602 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edc3b87-91bd-4a33-947e-c81882dd6c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:44.587247 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc3b87-91bd-4a33-947e-c81882dd6c13 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:44.587529 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc3b87-91bd-4a33-947e-c81882dd6c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:44.587802 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc3b87-91bd-4a33-947e-c81882dd6c13 admin admin] PATH_INFO: `/v3/domains` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:44.588581 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edc3b87-91bd-4a33-947e-c81882dd6c13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:44.588888 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edc3b87-91bd-4a33-947e-c81882dd6c13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:44.590478 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edc3b87-91bd-4a33-947e-c81882dd6c13 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:44.601981 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 496/979] 10.222.0.18 () {56 vars in 1130 bytes} [Tue Oct 12 18:05:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:44.608187 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b199081-6d3e-4e5e-801f-baa5a4bad10e admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:44.618067 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b199081-6d3e-4e5e-801f-baa5a4bad10e admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:44.622623 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e382b4-094d-4e3e-b5a0-a3ff374ea823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:44.623385 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e382b4-094d-4e3e-b5a0-a3ff374ea823 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:44.623656 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e382b4-094d-4e3e-b5a0-a3ff374ea823 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:44.624082 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e382b4-094d-4e3e-b5a0-a3ff374ea823 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:44.632676 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e382b4-094d-4e3e-b5a0-a3ff374ea823 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:44.634668 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e382b4-094d-4e3e-b5a0-a3ff374ea823 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:44.648837 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-b2e382b4-094d-4e3e-b5a0-a3ff374ea823 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 12 18:05:44.649981 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 484/980] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Oct 12 18:05:44 2021] GET /identity/v3/users/nova => generated 82 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:44.656468 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edc3b87-91bd-4a33-947e-c81882dd6c13 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:44.666149 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edc3b87-91bd-4a33-947e-c81882dd6c13 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:44.670700 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dd4df9-5f37-4f7c-9357-3e61f820c0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:44.671348 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd4df9-5f37-4f7c-9357-3e61f820c0a7 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:44.671637 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd4df9-5f37-4f7c-9357-3e61f820c0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:44.671915 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd4df9-5f37-4f7c-9357-3e61f820c0a7 admin admin] PATH_INFO: `/v3/users` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:44.672785 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dd4df9-5f37-4f7c-9357-3e61f820c0a7 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:44.673093 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dd4df9-5f37-4f7c-9357-3e61f820c0a7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:44.674955 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dd4df9-5f37-4f7c-9357-3e61f820c0a7 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:44.692806 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 497/981] 10.222.0.18 () {56 vars in 1154 bytes} [Tue Oct 12 18:05:44 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:44.699080 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e382b4-094d-4e3e-b5a0-a3ff374ea823 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:44.708530 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e382b4-094d-4e3e-b5a0-a3ff374ea823 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:44.712960 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef64b0c-03aa-4e76-876c-099ee6f8e686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:44.713586 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef64b0c-03aa-4e76-876c-099ee6f8e686 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:44.713864 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef64b0c-03aa-4e76-876c-099ee6f8e686 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:44.714137 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef64b0c-03aa-4e76-876c-099ee6f8e686 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:44.721634 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef64b0c-03aa-4e76-876c-099ee6f8e686 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:44.723362 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef64b0c-03aa-4e76-876c-099ee6f8e686 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:44.731915 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 485/982] 10.222.0.18 () {58 vars in 1324 bytes} [Tue Oct 12 18:05:44 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:05:44.738624 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dd4df9-5f37-4f7c-9357-3e61f820c0a7 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:44.748113 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dd4df9-5f37-4f7c-9357-3e61f820c0a7 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:44.752704 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8fac2b-e244-4ecc-ae1f-e37001e4f8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:44.753472 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8fac2b-e244-4ecc-ae1f-e37001e4f8f4 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:44.754289 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8fac2b-e244-4ecc-ae1f-e37001e4f8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:44.754565 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8fac2b-e244-4ecc-ae1f-e37001e4f8f4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:44.764504 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8fac2b-e244-4ecc-ae1f-e37001e4f8f4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:44.766611 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8fac2b-e244-4ecc-ae1f-e37001e4f8f4 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:44.783709 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-de8fac2b-e244-4ecc-ae1f-e37001e4f8f4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 18:05:44.785049 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 498/983] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:05:44 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 18:05:44.791035 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef64b0c-03aa-4e76-876c-099ee6f8e686 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:44.799669 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef64b0c-03aa-4e76-876c-099ee6f8e686 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:44.804728 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00571d9-f042-43eb-bc19-3c48aae64e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:44.805377 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00571d9-f042-43eb-bc19-3c48aae64e5a admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:44.805644 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00571d9-f042-43eb-bc19-3c48aae64e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:44.805918 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00571d9-f042-43eb-bc19-3c48aae64e5a admin admin] PATH_INFO: `/v3/domains` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:44.806645 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00571d9-f042-43eb-bc19-3c48aae64e5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:44.806951 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00571d9-f042-43eb-bc19-3c48aae64e5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:44.808561 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00571d9-f042-43eb-bc19-3c48aae64e5a admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:44.820177 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 486/984] 10.222.0.18 () {56 vars in 1130 bytes} [Tue Oct 12 18:05:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:44.826636 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8fac2b-e244-4ecc-ae1f-e37001e4f8f4 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:44.836774 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8fac2b-e244-4ecc-ae1f-e37001e4f8f4 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:44.841296 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ff990-ca27-443b-8458-9cdd24cb9491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:44.842060 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ff990-ca27-443b-8458-9cdd24cb9491 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:44.842356 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ff990-ca27-443b-8458-9cdd24cb9491 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:44.842607 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ff990-ca27-443b-8458-9cdd24cb9491 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:44.849313 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1ff990-ca27-443b-8458-9cdd24cb9491 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:44.851249 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1ff990-ca27-443b-8458-9cdd24cb9491 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:44.864457 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-0a1ff990-ca27-443b-8458-9cdd24cb9491 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 18:05:44.865752 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 499/985] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Oct 12 18:05:44 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:44.872030 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00571d9-f042-43eb-bc19-3c48aae64e5a admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:44.882238 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00571d9-f042-43eb-bc19-3c48aae64e5a admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:44.887931 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f9915d-af90-40e5-b434-9fe5ab16e70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:44.889067 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f9915d-af90-40e5-b434-9fe5ab16e70a admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:44.889423 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f9915d-af90-40e5-b434-9fe5ab16e70a admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:44.889762 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f9915d-af90-40e5-b434-9fe5ab16e70a admin admin] PATH_INFO: `/v3/projects` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:44.890660 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f9915d-af90-40e5-b434-9fe5ab16e70a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:44.891218 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f9915d-af90-40e5-b434-9fe5ab16e70a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:44.893072 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f9915d-af90-40e5-b434-9fe5ab16e70a admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:44.905039 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 487/986] 10.222.0.18 () {56 vars in 1169 bytes} [Tue Oct 12 18:05:44 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:44.911431 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ff990-ca27-443b-8458-9cdd24cb9491 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:44.923330 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ff990-ca27-443b-8458-9cdd24cb9491 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:44.928637 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3659e585-1d09-49fb-905c-9044e4cbc0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:44.929307 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3659e585-1d09-49fb-905c-9044e4cbc0f6 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:44.929594 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3659e585-1d09-49fb-905c-9044e4cbc0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:44.929855 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3659e585-1d09-49fb-905c-9044e4cbc0f6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:44.930705 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3659e585-1d09-49fb-905c-9044e4cbc0f6 admin admin] RBAC: Adding query filter params (role.id=d7656b67d66f4c2d81879698f36ca670, scope.project.id=e843aaa9e5e44a8e98f7cc7412d9697b, user.id=3417097a280b499086b36df9a2548239) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:44.931015 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3659e585-1d09-49fb-905c-9044e4cbc0f6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:44.932923 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3659e585-1d09-49fb-905c-9044e4cbc0f6 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:44.948434 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 500/987] 10.222.0.18 () {56 vars in 1395 bytes} [Tue Oct 12 18:05:44 2021] GET /identity/v3/role_assignments?user.id=3417097a280b499086b36df9a2548239&scope.project.id=e843aaa9e5e44a8e98f7cc7412d9697b&role.id=d7656b67d66f4c2d81879698f36ca670 => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:05:46.006120 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94578290-8e2e-4a54-bf8d-acff0efec564 None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:46.006617 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94578290-8e2e-4a54-bf8d-acff0efec564 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:46.006617 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94578290-8e2e-4a54-bf8d-acff0efec564 None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:46.008343 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 488/988] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:05:46 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:05:46.014255 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b832940-0e5f-43a4-8258-6b480dfd1b5c None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:46.014672 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b832940-0e5f-43a4-8258-6b480dfd1b5c None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:46.014801 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b832940-0e5f-43a4-8258-6b480dfd1b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:46.032193 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-5b832940-0e5f-43a4-8258-6b480dfd1b5c None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:05:46.033398 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-5b832940-0e5f-43a4-8258-6b480dfd1b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:05:46.041368 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 501/989] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:05:46 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:05:46.065195 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94578290-8e2e-4a54-bf8d-acff0efec564 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:46.077458 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94578290-8e2e-4a54-bf8d-acff0efec564 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:46.082370 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cf6f16-517e-4c3d-a45a-ccc24851520d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:46.083134 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf6f16-517e-4c3d-a45a-ccc24851520d admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:46.083412 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf6f16-517e-4c3d-a45a-ccc24851520d admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:46.083680 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf6f16-517e-4c3d-a45a-ccc24851520d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:46.093586 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cf6f16-517e-4c3d-a45a-ccc24851520d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 18:05:46.100453 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-d3cf6f16-517e-4c3d-a45a-ccc24851520d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 18:05:46.102142 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 489/990] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Oct 12 18:05:46 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:46.107856 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b832940-0e5f-43a4-8258-6b480dfd1b5c None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:46.116567 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b832940-0e5f-43a4-8258-6b480dfd1b5c None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:46.120993 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec4c507-3cad-4e73-a94e-4dab79659e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:46.121662 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec4c507-3cad-4e73-a94e-4dab79659e0e admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:46.121932 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec4c507-3cad-4e73-a94e-4dab79659e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:46.122214 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec4c507-3cad-4e73-a94e-4dab79659e0e admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:46.122961 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec4c507-3cad-4e73-a94e-4dab79659e0e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:46.123257 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec4c507-3cad-4e73-a94e-4dab79659e0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:46.124900 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec4c507-3cad-4e73-a94e-4dab79659e0e admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:46.133351 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 502/991] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Oct 12 18:05:46 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:46.139487 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cf6f16-517e-4c3d-a45a-ccc24851520d admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:46.150175 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cf6f16-517e-4c3d-a45a-ccc24851520d admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:46.154650 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c717231-b85a-4dd7-a75d-4428e87f76c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:46.155475 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c717231-b85a-4dd7-a75d-4428e87f76c3 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:46.155754 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c717231-b85a-4dd7-a75d-4428e87f76c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:46.156022 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c717231-b85a-4dd7-a75d-4428e87f76c3 admin admin] PATH_INFO: `/v3/users/cd82e48799464251a0b9b7bee15b43d8` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:46.157269 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c717231-b85a-4dd7-a75d-4428e87f76c3 admin admin] RBAC: Authorizing `identity:get_user(user_id=cd82e48799464251a0b9b7bee15b43d8)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:46.159380 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c717231-b85a-4dd7-a75d-4428e87f76c3 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:46.165348 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 490/992] 10.222.0.18 () {56 vars in 1198 bytes} [Tue Oct 12 18:05:46 2021] GET /identity/v3/users/cd82e48799464251a0b9b7bee15b43d8 => generated 285 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:05:46.166926 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec4c507-3cad-4e73-a94e-4dab79659e0e admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:46.176653 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec4c507-3cad-4e73-a94e-4dab79659e0e admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:46.181047 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bc434d-0dc0-4eac-afbc-8a71e63f292c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:46.181855 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bc434d-0dc0-4eac-afbc-8a71e63f292c admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:46.182132 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bc434d-0dc0-4eac-afbc-8a71e63f292c admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:46.182402 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bc434d-0dc0-4eac-afbc-8a71e63f292c admin admin] PATH_INFO: `/v3/projects/3d16c56719034966bc6ffb0bd9ef6a88` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:46.183591 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bc434d-0dc0-4eac-afbc-8a71e63f292c admin admin] RBAC: Authorizing `identity:get_project(project_id=3d16c56719034966bc6ffb0bd9ef6a88)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:46.185646 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bc434d-0dc0-4eac-afbc-8a71e63f292c admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:46.187230 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 503/993] 10.222.0.18 () {56 vars in 1207 bytes} [Tue Oct 12 18:05:46 2021] GET /identity/v3/projects/3d16c56719034966bc6ffb0bd9ef6a88 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:05:46.193233 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c717231-b85a-4dd7-a75d-4428e87f76c3 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:46.202327 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c717231-b85a-4dd7-a75d-4428e87f76c3 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:46.207390 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aff3f5-e8a0-4f41-8629-19f16683f18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:46.208224 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aff3f5-e8a0-4f41-8629-19f16683f18e admin admin] REQUEST_METHOD: `PUT` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:46.208528 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aff3f5-e8a0-4f41-8629-19f16683f18e admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:46.208802 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aff3f5-e8a0-4f41-8629-19f16683f18e admin admin] PATH_INFO: `/v3/projects/3d16c56719034966bc6ffb0bd9ef6a88/users/cd82e48799464251a0b9b7bee15b43d8/roles/6c54f239944d46e3b027ccce97eb8b49` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:46.210746 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aff3f5-e8a0-4f41-8629-19f16683f18e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d16c56719034966bc6ffb0bd9ef6a88, user_id=cd82e48799464251a0b9b7bee15b43d8, role_id=6c54f239944d46e3b027ccce97eb8b49)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:46.213379 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aff3f5-e8a0-4f41-8629-19f16683f18e admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:46.303316 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 491/994] 10.222.0.18 () {58 vars in 1460 bytes} [Tue Oct 12 18:05:46 2021] PUT /identity/v3/projects/3d16c56719034966bc6ffb0bd9ef6a88/users/cd82e48799464251a0b9b7bee15b43d8/roles/6c54f239944d46e3b027ccce97eb8b49 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:05:48.534957 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c4357-6f65-4800-8b53-94143c3169e3 None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:48.535543 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c4357-6f65-4800-8b53-94143c3169e3 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:48.535543 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c4357-6f65-4800-8b53-94143c3169e3 None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:48.537275 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 504/995] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:05:48 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:05:48.543183 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d996a5-8f75-4b12-a0bd-63b8c074292a None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:48.543614 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d996a5-8f75-4b12-a0bd-63b8c074292a None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:48.543712 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d996a5-8f75-4b12-a0bd-63b8c074292a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:48.561386 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-77d996a5-8f75-4b12-a0bd-63b8c074292a None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:05:48.562564 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-77d996a5-8f75-4b12-a0bd-63b8c074292a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:05:48.616616 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 492/996] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:05:48 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:05:48.641238 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c4357-6f65-4800-8b53-94143c3169e3 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:48.653099 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c4357-6f65-4800-8b53-94143c3169e3 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:48.657385 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c58f79-3e47-43f5-850e-f4a106fa7537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:48.658149 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c58f79-3e47-43f5-850e-f4a106fa7537 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:48.658429 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c58f79-3e47-43f5-850e-f4a106fa7537 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:48.658719 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c58f79-3e47-43f5-850e-f4a106fa7537 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:48.668532 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c58f79-3e47-43f5-850e-f4a106fa7537 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 18:05:48.675918 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-86c58f79-3e47-43f5-850e-f4a106fa7537 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 18:05:48.677076 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 505/997] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Oct 12 18:05:48 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:05:48.683565 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d996a5-8f75-4b12-a0bd-63b8c074292a None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:48.692969 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d996a5-8f75-4b12-a0bd-63b8c074292a None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:48.697412 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a035b1f7-93c0-4b40-b49d-d770c8c2abe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:48.698060 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a035b1f7-93c0-4b40-b49d-d770c8c2abe5 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:48.698356 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a035b1f7-93c0-4b40-b49d-d770c8c2abe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:48.698613 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a035b1f7-93c0-4b40-b49d-d770c8c2abe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:48.699427 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a035b1f7-93c0-4b40-b49d-d770c8c2abe5 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:48.699725 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a035b1f7-93c0-4b40-b49d-d770c8c2abe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:48.701336 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a035b1f7-93c0-4b40-b49d-d770c8c2abe5 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:48.709477 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 493/998] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Oct 12 18:05:48 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:05:48.715678 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c58f79-3e47-43f5-850e-f4a106fa7537 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:48.725497 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c58f79-3e47-43f5-850e-f4a106fa7537 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:48.729932 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5844a253-1772-4517-beae-4c2ca05e812d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:48.730749 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844a253-1772-4517-beae-4c2ca05e812d admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:48.731029 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844a253-1772-4517-beae-4c2ca05e812d admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:48.731300 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844a253-1772-4517-beae-4c2ca05e812d admin admin] PATH_INFO: `/v3/users/cd82e48799464251a0b9b7bee15b43d8` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:48.732513 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5844a253-1772-4517-beae-4c2ca05e812d admin admin] RBAC: Authorizing `identity:get_user(user_id=cd82e48799464251a0b9b7bee15b43d8)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:48.734641 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5844a253-1772-4517-beae-4c2ca05e812d admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:48.736186 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 506/999] 10.222.0.18 () {56 vars in 1198 bytes} [Tue Oct 12 18:05:48 2021] GET /identity/v3/users/cd82e48799464251a0b9b7bee15b43d8 => generated 285 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:48.742587 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a035b1f7-93c0-4b40-b49d-d770c8c2abe5 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:48.751877 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a035b1f7-93c0-4b40-b49d-d770c8c2abe5 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:48.756898 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0089a0-ef24-4a91-94e4-fa309a6e1a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:48.757512 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0089a0-ef24-4a91-94e4-fa309a6e1a92 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:48.757793 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0089a0-ef24-4a91-94e4-fa309a6e1a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:48.758066 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0089a0-ef24-4a91-94e4-fa309a6e1a92 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:48.765540 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0089a0-ef24-4a91-94e4-fa309a6e1a92 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:48.767509 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0089a0-ef24-4a91-94e4-fa309a6e1a92 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:48.776118 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 494/1000] 10.222.0.18 () {58 vars in 1324 bytes} [Tue Oct 12 18:05:48 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:05:48.782224 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5844a253-1772-4517-beae-4c2ca05e812d admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:48.792051 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5844a253-1772-4517-beae-4c2ca05e812d admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:48.796457 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f401b18-987f-4f22-bdd4-be37d5e3af58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:48.797268 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f401b18-987f-4f22-bdd4-be37d5e3af58 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:48.797547 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f401b18-987f-4f22-bdd4-be37d5e3af58 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:48.797824 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f401b18-987f-4f22-bdd4-be37d5e3af58 admin admin] PATH_INFO: `/v3/projects/3d16c56719034966bc6ffb0bd9ef6a88` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:48.799076 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f401b18-987f-4f22-bdd4-be37d5e3af58 admin admin] RBAC: Authorizing `identity:get_project(project_id=3d16c56719034966bc6ffb0bd9ef6a88)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:48.801711 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f401b18-987f-4f22-bdd4-be37d5e3af58 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:48.803318 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 507/1001] 10.222.0.18 () {56 vars in 1207 bytes} [Tue Oct 12 18:05:48 2021] GET /identity/v3/projects/3d16c56719034966bc6ffb0bd9ef6a88 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:48.809529 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0089a0-ef24-4a91-94e4-fa309a6e1a92 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:48.817852 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0089a0-ef24-4a91-94e4-fa309a6e1a92 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:48.822515 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78779317-b867-45a8-9a75-f36bdd28b5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:48.823126 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78779317-b867-45a8-9a75-f36bdd28b5e9 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:48.823406 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78779317-b867-45a8-9a75-f36bdd28b5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:48.823680 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78779317-b867-45a8-9a75-f36bdd28b5e9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:48.824542 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78779317-b867-45a8-9a75-f36bdd28b5e9 admin admin] RBAC: Adding query filter params (role.id=6c54f239944d46e3b027ccce97eb8b49, scope.project.id=3d16c56719034966bc6ffb0bd9ef6a88, user.id=cd82e48799464251a0b9b7bee15b43d8) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:48.824853 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78779317-b867-45a8-9a75-f36bdd28b5e9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:48.826664 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78779317-b867-45a8-9a75-f36bdd28b5e9 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:48.832332 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 495/1002] 10.222.0.18 () {56 vars in 1395 bytes} [Tue Oct 12 18:05:48 2021] GET /identity/v3/role_assignments?user.id=cd82e48799464251a0b9b7bee15b43d8&scope.project.id=3d16c56719034966bc6ffb0bd9ef6a88&role.id=6c54f239944d46e3b027ccce97eb8b49 => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:05:51.047184 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f11401a-d2c7-4cde-8480-a38a24972ab8 None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:51.047709 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f11401a-d2c7-4cde-8480-a38a24972ab8 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:51.047709 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f11401a-d2c7-4cde-8480-a38a24972ab8 None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:51.049513 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 508/1003] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:05:51 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:05:51.055962 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8e07c9-b792-46f7-ab0a-ec20391ad3e2 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:51.056393 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8e07c9-b792-46f7-ab0a-ec20391ad3e2 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:51.056522 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8e07c9-b792-46f7-ab0a-ec20391ad3e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:51.073653 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-9d8e07c9-b792-46f7-ab0a-ec20391ad3e2 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:05:51.074845 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-9d8e07c9-b792-46f7-ab0a-ec20391ad3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:05:51.082395 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 496/1004] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:05:51 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:05:51.107548 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f11401a-d2c7-4cde-8480-a38a24972ab8 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:51.119945 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f11401a-d2c7-4cde-8480-a38a24972ab8 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:51.124390 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8e2b5c-1bb7-45d5-b723-53315d6f3e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:51.125173 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e2b5c-1bb7-45d5-b723-53315d6f3e97 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:51.125476 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e2b5c-1bb7-45d5-b723-53315d6f3e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:51.125753 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e2b5c-1bb7-45d5-b723-53315d6f3e97 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:51.126922 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8e2b5c-1bb7-45d5-b723-53315d6f3e97 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:51.128631 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8e2b5c-1bb7-45d5-b723-53315d6f3e97 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:51.130162 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 509/1005] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:05:51 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:51.135964 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8e07c9-b792-46f7-ab0a-ec20391ad3e2 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:51.144758 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8e07c9-b792-46f7-ab0a-ec20391ad3e2 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:51.149190 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f442a5e-c088-46ac-8182-3ae17840a2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:51.149820 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f442a5e-c088-46ac-8182-3ae17840a2a8 admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:51.150099 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f442a5e-c088-46ac-8182-3ae17840a2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:51.150371 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f442a5e-c088-46ac-8182-3ae17840a2a8 admin admin] PATH_INFO: `/v3/users` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:51.151072 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f442a5e-c088-46ac-8182-3ae17840a2a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:51.152994 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f442a5e-c088-46ac-8182-3ae17840a2a8 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:51.291680 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 497/1006] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Oct 12 18:05:51 2021] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:05:53.575284 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4fb269-b1c8-433f-a929-5eb3285ebc2e None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:53.575850 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4fb269-b1c8-433f-a929-5eb3285ebc2e None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:53.575850 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4fb269-b1c8-433f-a929-5eb3285ebc2e None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:53.577649 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 510/1007] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:05:53 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:05:53.583650 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d9d66-b017-4311-8c73-7650574f9099 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:53.584076 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d9d66-b017-4311-8c73-7650574f9099 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:53.584203 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d9d66-b017-4311-8c73-7650574f9099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:53.601925 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-fd6d9d66-b017-4311-8c73-7650574f9099 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:05:53.603093 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-fd6d9d66-b017-4311-8c73-7650574f9099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:05:53.610621 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 498/1008] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:05:53 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:05:53.635200 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4fb269-b1c8-433f-a929-5eb3285ebc2e None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:53.647927 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4fb269-b1c8-433f-a929-5eb3285ebc2e None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:53.652203 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7641c6a3-9680-4dfb-bd0b-ad8af2bd194f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:53.653065 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7641c6a3-9680-4dfb-bd0b-ad8af2bd194f admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:53.653344 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7641c6a3-9680-4dfb-bd0b-ad8af2bd194f admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:53.653614 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7641c6a3-9680-4dfb-bd0b-ad8af2bd194f admin admin] PATH_INFO: `/v3/roles/17c81d2cd8f34ad49f4c495ecb2d982e` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:53.655074 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7641c6a3-9680-4dfb-bd0b-ad8af2bd194f admin admin] RBAC: Authorizing `identity:get_role(role_id=17c81d2cd8f34ad49f4c495ecb2d982e)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:53.656071 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING py.warnings [None req-7641c6a3-9680-4dfb-bd0b-ad8af2bd194f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:05:53.656071 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: warnings.warn(msg) Oct 12 18:05:53.656071 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: Oct 12 18:05:53.656987 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7641c6a3-9680-4dfb-bd0b-ad8af2bd194f admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:53.658283 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 511/1009] 10.222.0.18 () {56 vars in 1198 bytes} [Tue Oct 12 18:05:53 2021] GET /identity/v3/roles/17c81d2cd8f34ad49f4c495ecb2d982e => generated 223 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:53.664820 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d9d66-b017-4311-8c73-7650574f9099 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:53.673507 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d9d66-b017-4311-8c73-7650574f9099 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:53.678514 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a9d5e8-a122-41d2-baf7-1ff641249c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:53.679357 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a9d5e8-a122-41d2-baf7-1ff641249c1e admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:53.679638 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a9d5e8-a122-41d2-baf7-1ff641249c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:53.679913 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a9d5e8-a122-41d2-baf7-1ff641249c1e admin admin] PATH_INFO: `/v3/users/b7e0d3627d9e46f18ac8313af9a6f39c` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:53.693311 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a9d5e8-a122-41d2-baf7-1ff641249c1e admin admin] RBAC: Authorizing `identity:get_user(user_id=b7e0d3627d9e46f18ac8313af9a6f39c)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:53.695432 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a9d5e8-a122-41d2-baf7-1ff641249c1e admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:53.697044 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 499/1010] 10.222.0.18 () {56 vars in 1198 bytes} [Tue Oct 12 18:05:53 2021] GET /identity/v3/users/b7e0d3627d9e46f18ac8313af9a6f39c => generated 286 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:53.703033 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7641c6a3-9680-4dfb-bd0b-ad8af2bd194f admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:53.712219 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7641c6a3-9680-4dfb-bd0b-ad8af2bd194f admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:53.716658 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc9a072-a012-4192-ba9d-4a5c8d772589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:53.717266 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9a072-a012-4192-ba9d-4a5c8d772589 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:53.717548 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9a072-a012-4192-ba9d-4a5c8d772589 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:53.717821 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9a072-a012-4192-ba9d-4a5c8d772589 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:53.725244 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc9a072-a012-4192-ba9d-4a5c8d772589 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:53.726962 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc9a072-a012-4192-ba9d-4a5c8d772589 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:53.735498 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 512/1011] 10.222.0.18 () {58 vars in 1324 bytes} [Tue Oct 12 18:05:53 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:05:53.742114 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a9d5e8-a122-41d2-baf7-1ff641249c1e admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:53.751165 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a9d5e8-a122-41d2-baf7-1ff641249c1e admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:53.756180 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9029d8-8036-4a3f-a704-d2282222ce4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:53.757021 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9029d8-8036-4a3f-a704-d2282222ce4f admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:53.757302 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9029d8-8036-4a3f-a704-d2282222ce4f admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:53.757575 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9029d8-8036-4a3f-a704-d2282222ce4f admin admin] PATH_INFO: `/v3/projects/3d16c56719034966bc6ffb0bd9ef6a88` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:53.758731 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9029d8-8036-4a3f-a704-d2282222ce4f admin admin] RBAC: Authorizing `identity:get_project(project_id=3d16c56719034966bc6ffb0bd9ef6a88)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:53.760737 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9029d8-8036-4a3f-a704-d2282222ce4f admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:53.762446 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 500/1012] 10.222.0.18 () {56 vars in 1207 bytes} [Tue Oct 12 18:05:53 2021] GET /identity/v3/projects/3d16c56719034966bc6ffb0bd9ef6a88 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:05:53.768835 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc9a072-a012-4192-ba9d-4a5c8d772589 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:53.777177 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc9a072-a012-4192-ba9d-4a5c8d772589 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:53.781774 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e773c8ab-6bfc-4657-a115-868f55767867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:53.782377 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e773c8ab-6bfc-4657-a115-868f55767867 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:53.782653 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e773c8ab-6bfc-4657-a115-868f55767867 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:53.782924 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e773c8ab-6bfc-4657-a115-868f55767867 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:53.783732 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e773c8ab-6bfc-4657-a115-868f55767867 admin admin] RBAC: Adding query filter params (role.id=17c81d2cd8f34ad49f4c495ecb2d982e, scope.project.id=3d16c56719034966bc6ffb0bd9ef6a88, user.id=b7e0d3627d9e46f18ac8313af9a6f39c) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:53.784036 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e773c8ab-6bfc-4657-a115-868f55767867 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:53.785892 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e773c8ab-6bfc-4657-a115-868f55767867 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:53.791122 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 513/1013] 10.222.0.18 () {56 vars in 1395 bytes} [Tue Oct 12 18:05:53 2021] GET /identity/v3/role_assignments?user.id=b7e0d3627d9e46f18ac8313af9a6f39c&scope.project.id=3d16c56719034966bc6ffb0bd9ef6a88&role.id=17c81d2cd8f34ad49f4c495ecb2d982e => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:55.965197 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29bae3-c9a1-4256-b748-cad5ae896ca9 None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:55.965698 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29bae3-c9a1-4256-b748-cad5ae896ca9 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:55.965698 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29bae3-c9a1-4256-b748-cad5ae896ca9 None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:55.967398 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 501/1014] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:05:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:05:55.973780 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ab5bd1-0da3-45e0-989c-8cd6f3027dcc None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:55.974210 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ab5bd1-0da3-45e0-989c-8cd6f3027dcc None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:55.974333 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ab5bd1-0da3-45e0-989c-8cd6f3027dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:55.991453 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-c0ab5bd1-0da3-45e0-989c-8cd6f3027dcc None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:05:55.992665 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-c0ab5bd1-0da3-45e0-989c-8cd6f3027dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:05:56.000191 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 514/1015] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:05:55 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:05:56.023690 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf29bae3-c9a1-4256-b748-cad5ae896ca9 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:56.035934 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf29bae3-c9a1-4256-b748-cad5ae896ca9 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:56.040192 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70da52e5-8de6-465d-9375-9356a207fc46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:56.041045 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da52e5-8de6-465d-9375-9356a207fc46 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:56.041320 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da52e5-8de6-465d-9375-9356a207fc46 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:56.041585 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da52e5-8de6-465d-9375-9356a207fc46 admin admin] PATH_INFO: `/v3/roles/17c81d2cd8f34ad49f4c495ecb2d982e` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:56.043042 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70da52e5-8de6-465d-9375-9356a207fc46 admin admin] RBAC: Authorizing `identity:get_role(role_id=17c81d2cd8f34ad49f4c495ecb2d982e)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:56.044029 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING py.warnings [None req-70da52e5-8de6-465d-9375-9356a207fc46 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:05:56.044029 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: warnings.warn(msg) Oct 12 18:05:56.044029 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: Oct 12 18:05:56.044933 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70da52e5-8de6-465d-9375-9356a207fc46 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:56.046208 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 502/1016] 10.222.0.18 () {56 vars in 1198 bytes} [Tue Oct 12 18:05:56 2021] GET /identity/v3/roles/17c81d2cd8f34ad49f4c495ecb2d982e => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:56.052249 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ab5bd1-0da3-45e0-989c-8cd6f3027dcc None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:56.060987 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ab5bd1-0da3-45e0-989c-8cd6f3027dcc None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:56.065535 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a243c8b3-d217-41a3-8a6b-9dbb6e108550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:56.066412 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243c8b3-d217-41a3-8a6b-9dbb6e108550 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:56.066695 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243c8b3-d217-41a3-8a6b-9dbb6e108550 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:56.066971 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243c8b3-d217-41a3-8a6b-9dbb6e108550 admin admin] PATH_INFO: `/v3/users/b7e0d3627d9e46f18ac8313af9a6f39c` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:56.068172 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a243c8b3-d217-41a3-8a6b-9dbb6e108550 admin admin] RBAC: Authorizing `identity:get_user(user_id=b7e0d3627d9e46f18ac8313af9a6f39c)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:56.070369 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a243c8b3-d217-41a3-8a6b-9dbb6e108550 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:56.071929 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 515/1017] 10.222.0.18 () {56 vars in 1198 bytes} [Tue Oct 12 18:05:56 2021] GET /identity/v3/users/b7e0d3627d9e46f18ac8313af9a6f39c => generated 286 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:56.077798 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70da52e5-8de6-465d-9375-9356a207fc46 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:56.087438 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70da52e5-8de6-465d-9375-9356a207fc46 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:56.091823 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991beade-8fcf-47ae-8a14-94ec89d4632d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:56.092654 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991beade-8fcf-47ae-8a14-94ec89d4632d admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:56.092932 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991beade-8fcf-47ae-8a14-94ec89d4632d admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:56.093200 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991beade-8fcf-47ae-8a14-94ec89d4632d admin admin] PATH_INFO: `/v3/projects/3d16c56719034966bc6ffb0bd9ef6a88` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:56.094353 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991beade-8fcf-47ae-8a14-94ec89d4632d admin admin] RBAC: Authorizing `identity:get_project(project_id=3d16c56719034966bc6ffb0bd9ef6a88)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:56.096336 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991beade-8fcf-47ae-8a14-94ec89d4632d admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:56.098495 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 503/1018] 10.222.0.18 () {56 vars in 1207 bytes} [Tue Oct 12 18:05:56 2021] GET /identity/v3/projects/3d16c56719034966bc6ffb0bd9ef6a88 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:56.104469 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a243c8b3-d217-41a3-8a6b-9dbb6e108550 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:56.114087 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a243c8b3-d217-41a3-8a6b-9dbb6e108550 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:56.118558 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fa4f38-9a38-46c0-8dc0-082b6243b6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:56.119381 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa4f38-9a38-46c0-8dc0-082b6243b6f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:56.119661 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa4f38-9a38-46c0-8dc0-082b6243b6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:56.119935 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa4f38-9a38-46c0-8dc0-082b6243b6f5 admin admin] PATH_INFO: `/v3/projects/3d16c56719034966bc6ffb0bd9ef6a88/users/b7e0d3627d9e46f18ac8313af9a6f39c/roles/17c81d2cd8f34ad49f4c495ecb2d982e` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:56.122092 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fa4f38-9a38-46c0-8dc0-082b6243b6f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d16c56719034966bc6ffb0bd9ef6a88, user_id=b7e0d3627d9e46f18ac8313af9a6f39c, role_id=17c81d2cd8f34ad49f4c495ecb2d982e)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:56.124719 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fa4f38-9a38-46c0-8dc0-082b6243b6f5 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:56.205828 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 516/1019] 10.222.0.18 () {58 vars in 1460 bytes} [Tue Oct 12 18:05:56 2021] PUT /identity/v3/projects/3d16c56719034966bc6ffb0bd9ef6a88/users/b7e0d3627d9e46f18ac8313af9a6f39c/roles/17c81d2cd8f34ad49f4c495ecb2d982e => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:05:58.401095 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a92408-5354-4d6d-b2e7-d2e2e07f8026 None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:58.401653 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a92408-5354-4d6d-b2e7-d2e2e07f8026 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:58.401653 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a92408-5354-4d6d-b2e7-d2e2e07f8026 None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:58.403398 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 504/1020] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:05:58 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:05:58.409437 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98afd4fa-02af-43ef-b2db-2a02ee1cd892 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:58.409865 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98afd4fa-02af-43ef-b2db-2a02ee1cd892 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:58.409990 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98afd4fa-02af-43ef-b2db-2a02ee1cd892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:58.427472 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-98afd4fa-02af-43ef-b2db-2a02ee1cd892 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:05:58.428707 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-98afd4fa-02af-43ef-b2db-2a02ee1cd892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:05:58.483115 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 517/1021] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:05:58 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:05:58.508762 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a92408-5354-4d6d-b2e7-d2e2e07f8026 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:58.520754 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a92408-5354-4d6d-b2e7-d2e2e07f8026 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:58.525024 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e78117d-6ad3-4120-a814-9787200c63e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:58.525848 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e78117d-6ad3-4120-a814-9787200c63e0 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:58.526123 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e78117d-6ad3-4120-a814-9787200c63e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:58.526392 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e78117d-6ad3-4120-a814-9787200c63e0 admin admin] PATH_INFO: `/v3/roles/17c81d2cd8f34ad49f4c495ecb2d982e` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:58.527841 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e78117d-6ad3-4120-a814-9787200c63e0 admin admin] RBAC: Authorizing `identity:get_role(role_id=17c81d2cd8f34ad49f4c495ecb2d982e)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:58.529437 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e78117d-6ad3-4120-a814-9787200c63e0 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:58.530723 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 505/1022] 10.222.0.18 () {56 vars in 1198 bytes} [Tue Oct 12 18:05:58 2021] GET /identity/v3/roles/17c81d2cd8f34ad49f4c495ecb2d982e => generated 223 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:58.537250 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98afd4fa-02af-43ef-b2db-2a02ee1cd892 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:58.545783 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98afd4fa-02af-43ef-b2db-2a02ee1cd892 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:58.550770 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6ff2a5-625b-48f4-86ff-f89279443c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:58.551603 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ff2a5-625b-48f4-86ff-f89279443c86 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:58.551885 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ff2a5-625b-48f4-86ff-f89279443c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:58.552157 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ff2a5-625b-48f4-86ff-f89279443c86 admin admin] PATH_INFO: `/v3/users/b7e0d3627d9e46f18ac8313af9a6f39c` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:58.553399 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6ff2a5-625b-48f4-86ff-f89279443c86 admin admin] RBAC: Authorizing `identity:get_user(user_id=b7e0d3627d9e46f18ac8313af9a6f39c)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:58.555517 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6ff2a5-625b-48f4-86ff-f89279443c86 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:58.557093 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 518/1023] 10.222.0.18 () {56 vars in 1198 bytes} [Tue Oct 12 18:05:58 2021] GET /identity/v3/users/b7e0d3627d9e46f18ac8313af9a6f39c => generated 286 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:05:58.563042 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e78117d-6ad3-4120-a814-9787200c63e0 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:58.572746 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e78117d-6ad3-4120-a814-9787200c63e0 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:58.577219 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2662fbc9-f8ce-4afb-aa71-f7b185ad316c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:58.577816 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2662fbc9-f8ce-4afb-aa71-f7b185ad316c admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:58.578100 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2662fbc9-f8ce-4afb-aa71-f7b185ad316c admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:58.578377 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2662fbc9-f8ce-4afb-aa71-f7b185ad316c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:58.586585 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2662fbc9-f8ce-4afb-aa71-f7b185ad316c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:58.588270 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2662fbc9-f8ce-4afb-aa71-f7b185ad316c admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:58.596929 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 506/1024] 10.222.0.18 () {58 vars in 1324 bytes} [Tue Oct 12 18:05:58 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:05:58.602901 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6ff2a5-625b-48f4-86ff-f89279443c86 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:58.611895 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6ff2a5-625b-48f4-86ff-f89279443c86 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:58.616328 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddf3cb7-806f-42f0-b49c-5cc6ba94f133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:58.617160 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf3cb7-806f-42f0-b49c-5cc6ba94f133 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:58.617441 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf3cb7-806f-42f0-b49c-5cc6ba94f133 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:58.617713 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf3cb7-806f-42f0-b49c-5cc6ba94f133 admin admin] PATH_INFO: `/v3/projects/3d16c56719034966bc6ffb0bd9ef6a88` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:58.618860 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddf3cb7-806f-42f0-b49c-5cc6ba94f133 admin admin] RBAC: Authorizing `identity:get_project(project_id=3d16c56719034966bc6ffb0bd9ef6a88)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:58.620900 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddf3cb7-806f-42f0-b49c-5cc6ba94f133 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:58.622496 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 519/1025] 10.222.0.18 () {56 vars in 1207 bytes} [Tue Oct 12 18:05:58 2021] GET /identity/v3/projects/3d16c56719034966bc6ffb0bd9ef6a88 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:05:58.629561 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2662fbc9-f8ce-4afb-aa71-f7b185ad316c admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:05:58.638185 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2662fbc9-f8ce-4afb-aa71-f7b185ad316c admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:05:58.642944 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8709f473-f6ba-4ac1-beb1-26ecf4b2ab8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:05:58.643564 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8709f473-f6ba-4ac1-beb1-26ecf4b2ab8d admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:05:58.644413 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8709f473-f6ba-4ac1-beb1-26ecf4b2ab8d admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:05:58.644699 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8709f473-f6ba-4ac1-beb1-26ecf4b2ab8d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:05:58.645526 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8709f473-f6ba-4ac1-beb1-26ecf4b2ab8d admin admin] RBAC: Adding query filter params (role.id=17c81d2cd8f34ad49f4c495ecb2d982e, scope.project.id=3d16c56719034966bc6ffb0bd9ef6a88, user.id=b7e0d3627d9e46f18ac8313af9a6f39c) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:05:58.645836 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8709f473-f6ba-4ac1-beb1-26ecf4b2ab8d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:05:58.647642 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8709f473-f6ba-4ac1-beb1-26ecf4b2ab8d admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:05:58.653359 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 507/1026] 10.222.0.18 () {56 vars in 1395 bytes} [Tue Oct 12 18:05:58 2021] GET /identity/v3/role_assignments?user.id=b7e0d3627d9e46f18ac8313af9a6f39c&scope.project.id=3d16c56719034966bc6ffb0bd9ef6a88&role.id=17c81d2cd8f34ad49f4c495ecb2d982e => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:06:00.893363 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33363f5b-99a0-41d6-b12b-cf8005d8fce5 None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:06:00.893911 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33363f5b-99a0-41d6-b12b-cf8005d8fce5 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:06:00.893911 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33363f5b-99a0-41d6-b12b-cf8005d8fce5 None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:06:00.895721 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 520/1027] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:06:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:06:00.901613 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7bd0d6-b3bf-4640-9446-c240fcfed77d None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:06:00.902026 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7bd0d6-b3bf-4640-9446-c240fcfed77d None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:06:00.902153 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7bd0d6-b3bf-4640-9446-c240fcfed77d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:06:00.920003 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-dd7bd0d6-b3bf-4640-9446-c240fcfed77d None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:06:00.921184 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-dd7bd0d6-b3bf-4640-9446-c240fcfed77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:06:00.929204 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 508/1028] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:06:00 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:06:00.952545 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33363f5b-99a0-41d6-b12b-cf8005d8fce5 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:06:00.966835 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33363f5b-99a0-41d6-b12b-cf8005d8fce5 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:06:00.971221 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f4edf-d303-4f20-8fb3-ad5508ff00f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:06:00.972548 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f4edf-d303-4f20-8fb3-ad5508ff00f0 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:06:00.972954 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f4edf-d303-4f20-8fb3-ad5508ff00f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:06:00.973189 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f4edf-d303-4f20-8fb3-ad5508ff00f0 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:06:00.974371 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9f4edf-d303-4f20-8fb3-ad5508ff00f0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:06:00.976056 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9f4edf-d303-4f20-8fb3-ad5508ff00f0 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:06:00.977661 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 521/1029] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:06:00 2021] GET /identity/v3/domains/default => generated 199 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:06:00.984315 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7bd0d6-b3bf-4640-9446-c240fcfed77d None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:06:00.993842 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7bd0d6-b3bf-4640-9446-c240fcfed77d None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:06:00.998235 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ba35c6-02ef-4af1-a593-81b7e74868c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:06:00.999040 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba35c6-02ef-4af1-a593-81b7e74868c8 admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:06:00.999324 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba35c6-02ef-4af1-a593-81b7e74868c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:06:00.999593 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba35c6-02ef-4af1-a593-81b7e74868c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:06:01.000295 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ba35c6-02ef-4af1-a593-81b7e74868c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:06:01.002188 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ba35c6-02ef-4af1-a593-81b7e74868c8 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:06:01.127397 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 509/1030] 10.222.0.18 () {60 vars in 1162 bytes} [Tue Oct 12 18:06:00 2021] POST /identity/v3/projects => generated 311 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 18:06:03.390287 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c48abc-090a-4852-93b2-a009e96700e5 None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:06:03.390845 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c48abc-090a-4852-93b2-a009e96700e5 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:06:03.390845 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c48abc-090a-4852-93b2-a009e96700e5 None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:06:03.392888 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 522/1031] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:06:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:06:03.399413 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d96dec-eca9-431d-9bbc-f8170bc6857e None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:06:03.399792 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d96dec-eca9-431d-9bbc-f8170bc6857e None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:06:03.399970 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d96dec-eca9-431d-9bbc-f8170bc6857e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:06:03.417186 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-e1d96dec-eca9-431d-9bbc-f8170bc6857e None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:06:03.418356 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-e1d96dec-eca9-431d-9bbc-f8170bc6857e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:06:03.473348 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 510/1032] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:06:03 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:06:03.499484 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c48abc-090a-4852-93b2-a009e96700e5 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:06:03.511381 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c48abc-090a-4852-93b2-a009e96700e5 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:06:03.515751 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b27a2b-6a0b-4c39-a558-94a51c839d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:06:03.516813 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b27a2b-6a0b-4c39-a558-94a51c839d42 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:06:03.517098 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b27a2b-6a0b-4c39-a558-94a51c839d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:06:03.517374 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b27a2b-6a0b-4c39-a558-94a51c839d42 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:06:03.519038 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b27a2b-6a0b-4c39-a558-94a51c839d42 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:06:03.520748 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b27a2b-6a0b-4c39-a558-94a51c839d42 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:06:03.522302 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 523/1033] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:06:03 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:06:03.528161 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d96dec-eca9-431d-9bbc-f8170bc6857e None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:06:03.536823 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d96dec-eca9-431d-9bbc-f8170bc6857e None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:06:03.541273 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ed0f6e-d4bf-4319-ad6a-25248711dcc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:06:03.541907 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed0f6e-d4bf-4319-ad6a-25248711dcc7 admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:06:03.542185 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed0f6e-d4bf-4319-ad6a-25248711dcc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:06:03.542459 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed0f6e-d4bf-4319-ad6a-25248711dcc7 admin admin] PATH_INFO: `/v3/users` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:06:03.543161 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ed0f6e-d4bf-4319-ad6a-25248711dcc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:06:03.545113 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ed0f6e-d4bf-4319-ad6a-25248711dcc7 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:06:03.646794 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 511/1034] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Oct 12 18:06:03 2021] POST /identity/v3/users => generated 286 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:06:05.879101 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c3917-c400-4b8d-a841-8715e95466af None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:06:05.879598 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c3917-c400-4b8d-a841-8715e95466af None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:06:05.879598 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c3917-c400-4b8d-a841-8715e95466af None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:06:05.881365 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 524/1035] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:06:05 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:06:05.887112 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c18e3-a90b-4db6-809d-e54dd5235807 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:06:05.887479 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c18e3-a90b-4db6-809d-e54dd5235807 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:06:05.887658 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c18e3-a90b-4db6-809d-e54dd5235807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:06:05.905751 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-c54c18e3-a90b-4db6-809d-e54dd5235807 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:06:05.906938 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-c54c18e3-a90b-4db6-809d-e54dd5235807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:06:05.915081 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 512/1036] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:06:05 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:06:05.938630 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5c3917-c400-4b8d-a841-8715e95466af None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:06:05.950374 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5c3917-c400-4b8d-a841-8715e95466af None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:06:05.954677 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5569dc77-b761-4c47-86f4-eb78c36bb3ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:06:05.955434 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5569dc77-b761-4c47-86f4-eb78c36bb3ec admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:06:05.956211 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5569dc77-b761-4c47-86f4-eb78c36bb3ec admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:06:05.956524 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5569dc77-b761-4c47-86f4-eb78c36bb3ec admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:06:05.966295 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5569dc77-b761-4c47-86f4-eb78c36bb3ec admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 18:06:05.973750 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-5569dc77-b761-4c47-86f4-eb78c36bb3ec admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 18:06:05.974857 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 525/1037] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Oct 12 18:06:05 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:06:05.980872 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54c18e3-a90b-4db6-809d-e54dd5235807 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:06:05.989417 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54c18e3-a90b-4db6-809d-e54dd5235807 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:06:05.993812 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eb9115-9da0-4945-8c04-b975c9c64561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:06:05.994441 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eb9115-9da0-4945-8c04-b975c9c64561 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:06:05.994747 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eb9115-9da0-4945-8c04-b975c9c64561 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:06:05.995016 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eb9115-9da0-4945-8c04-b975c9c64561 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:06:05.995755 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eb9115-9da0-4945-8c04-b975c9c64561 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:06:05.996053 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eb9115-9da0-4945-8c04-b975c9c64561 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:06:05.997653 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eb9115-9da0-4945-8c04-b975c9c64561 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:06:06.005717 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 513/1038] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Oct 12 18:06:05 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:06:06.011649 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5569dc77-b761-4c47-86f4-eb78c36bb3ec admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:06:06.022179 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5569dc77-b761-4c47-86f4-eb78c36bb3ec admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:06:06.026614 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c35af3b-f0a0-495c-9fa8-c9fe98e056c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:06:06.027411 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c35af3b-f0a0-495c-9fa8-c9fe98e056c3 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:06:06.027694 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c35af3b-f0a0-495c-9fa8-c9fe98e056c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:06:06.027968 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c35af3b-f0a0-495c-9fa8-c9fe98e056c3 admin admin] PATH_INFO: `/v3/users/2e14365ac57349aca2057e7383679b46` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:06:06.040493 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c35af3b-f0a0-495c-9fa8-c9fe98e056c3 admin admin] RBAC: Authorizing `identity:get_user(user_id=2e14365ac57349aca2057e7383679b46)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:06:06.042651 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c35af3b-f0a0-495c-9fa8-c9fe98e056c3 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:06:06.044231 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 526/1039] 10.222.0.18 () {56 vars in 1198 bytes} [Tue Oct 12 18:06:06 2021] GET /identity/v3/users/2e14365ac57349aca2057e7383679b46 => generated 286 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:06:06.050147 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eb9115-9da0-4945-8c04-b975c9c64561 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:06:06.059195 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eb9115-9da0-4945-8c04-b975c9c64561 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:06:06.063568 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13fb51b-311b-43dc-8796-7c72d1a50433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:06:06.064171 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13fb51b-311b-43dc-8796-7c72d1a50433 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:06:06.064483 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13fb51b-311b-43dc-8796-7c72d1a50433 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:06:06.064756 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13fb51b-311b-43dc-8796-7c72d1a50433 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:06:06.072884 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13fb51b-311b-43dc-8796-7c72d1a50433 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:06:06.074615 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13fb51b-311b-43dc-8796-7c72d1a50433 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:06:06.084011 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 514/1040] 10.222.0.18 () {58 vars in 1324 bytes} [Tue Oct 12 18:06:06 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:06:06.089807 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c35af3b-f0a0-495c-9fa8-c9fe98e056c3 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:06:06.098972 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c35af3b-f0a0-495c-9fa8-c9fe98e056c3 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:06:06.103402 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56ab203-0809-48e9-a6bc-f47e7221de2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:06:06.104207 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56ab203-0809-48e9-a6bc-f47e7221de2d admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:06:06.104523 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56ab203-0809-48e9-a6bc-f47e7221de2d admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:06:06.104799 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56ab203-0809-48e9-a6bc-f47e7221de2d admin admin] PATH_INFO: `/v3/projects/e89512133bbe4e5f96bbe98dfb380a3c` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:06:06.106075 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56ab203-0809-48e9-a6bc-f47e7221de2d admin admin] RBAC: Authorizing `identity:get_project(project_id=e89512133bbe4e5f96bbe98dfb380a3c)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:06:06.108064 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56ab203-0809-48e9-a6bc-f47e7221de2d admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:06:06.109855 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 527/1041] 10.222.0.18 () {56 vars in 1207 bytes} [Tue Oct 12 18:06:06 2021] GET /identity/v3/projects/e89512133bbe4e5f96bbe98dfb380a3c => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:06:06.115845 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13fb51b-311b-43dc-8796-7c72d1a50433 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:06:06.124305 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13fb51b-311b-43dc-8796-7c72d1a50433 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:06:06.129389 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87ac470-8534-4b4f-899e-b6a7066e4e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:06:06.129972 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ac470-8534-4b4f-899e-b6a7066e4e93 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:06:06.130252 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ac470-8534-4b4f-899e-b6a7066e4e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:06:06.130524 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ac470-8534-4b4f-899e-b6a7066e4e93 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:06:06.131339 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87ac470-8534-4b4f-899e-b6a7066e4e93 admin admin] RBAC: Adding query filter params (role.id=6c54f239944d46e3b027ccce97eb8b49, scope.project.id=e89512133bbe4e5f96bbe98dfb380a3c, user.id=2e14365ac57349aca2057e7383679b46) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:06:06.131648 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87ac470-8534-4b4f-899e-b6a7066e4e93 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:06:06.133463 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87ac470-8534-4b4f-899e-b6a7066e4e93 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:06:06.138551 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 515/1042] 10.222.0.18 () {56 vars in 1395 bytes} [Tue Oct 12 18:06:06 2021] GET /identity/v3/role_assignments?user.id=2e14365ac57349aca2057e7383679b46&scope.project.id=e89512133bbe4e5f96bbe98dfb380a3c&role.id=6c54f239944d46e3b027ccce97eb8b49 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:06:08.323763 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f56e8-d216-477d-8bf3-7edff38fb453 None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:06:08.324295 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f56e8-d216-477d-8bf3-7edff38fb453 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:06:08.324295 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f56e8-d216-477d-8bf3-7edff38fb453 None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:06:08.326101 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 528/1043] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:06:08 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:06:08.332579 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9822c3b0-d0d3-48e8-b8ea-3fbfa1a16a6d None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:06:08.333014 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9822c3b0-d0d3-48e8-b8ea-3fbfa1a16a6d None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:06:08.333114 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9822c3b0-d0d3-48e8-b8ea-3fbfa1a16a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:06:08.350056 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-9822c3b0-d0d3-48e8-b8ea-3fbfa1a16a6d None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:06:08.351221 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-9822c3b0-d0d3-48e8-b8ea-3fbfa1a16a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:06:08.358629 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 516/1044] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:06:08 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:06:08.381974 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925f56e8-d216-477d-8bf3-7edff38fb453 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:06:08.394554 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925f56e8-d216-477d-8bf3-7edff38fb453 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:06:08.398885 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab5589c-d910-4a51-aedd-eb3c6e04c116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:06:08.399636 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab5589c-d910-4a51-aedd-eb3c6e04c116 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:06:08.399916 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab5589c-d910-4a51-aedd-eb3c6e04c116 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:06:08.400189 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab5589c-d910-4a51-aedd-eb3c6e04c116 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:06:08.409955 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab5589c-d910-4a51-aedd-eb3c6e04c116 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 18:06:08.416779 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-dab5589c-d910-4a51-aedd-eb3c6e04c116 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 18:06:08.417889 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 529/1045] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Oct 12 18:06:08 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:06:08.424113 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9822c3b0-d0d3-48e8-b8ea-3fbfa1a16a6d None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:06:08.432780 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9822c3b0-d0d3-48e8-b8ea-3fbfa1a16a6d None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:06:08.437975 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec1cec4-ab78-43e4-a4d8-e2437067699f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:06:08.438626 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec1cec4-ab78-43e4-a4d8-e2437067699f admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:06:08.438906 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec1cec4-ab78-43e4-a4d8-e2437067699f admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:06:08.439177 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec1cec4-ab78-43e4-a4d8-e2437067699f admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:06:08.440769 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec1cec4-ab78-43e4-a4d8-e2437067699f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:06:08.441195 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec1cec4-ab78-43e4-a4d8-e2437067699f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:06:08.442780 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec1cec4-ab78-43e4-a4d8-e2437067699f admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:06:08.453996 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 517/1046] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Oct 12 18:06:08 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:06:08.460989 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab5589c-d910-4a51-aedd-eb3c6e04c116 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:06:08.471048 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab5589c-d910-4a51-aedd-eb3c6e04c116 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:06:08.475547 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bae7c91-52ba-4b83-8253-c6eaeb4e9807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:06:08.476377 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae7c91-52ba-4b83-8253-c6eaeb4e9807 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:06:08.476683 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae7c91-52ba-4b83-8253-c6eaeb4e9807 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:06:08.476952 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae7c91-52ba-4b83-8253-c6eaeb4e9807 admin admin] PATH_INFO: `/v3/users/2e14365ac57349aca2057e7383679b46` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:06:08.478146 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bae7c91-52ba-4b83-8253-c6eaeb4e9807 admin admin] RBAC: Authorizing `identity:get_user(user_id=2e14365ac57349aca2057e7383679b46)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:06:08.480282 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bae7c91-52ba-4b83-8253-c6eaeb4e9807 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:06:08.481860 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 530/1047] 10.222.0.18 () {56 vars in 1198 bytes} [Tue Oct 12 18:06:08 2021] GET /identity/v3/users/2e14365ac57349aca2057e7383679b46 => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:06:08.487913 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec1cec4-ab78-43e4-a4d8-e2437067699f admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:06:08.497122 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec1cec4-ab78-43e4-a4d8-e2437067699f admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:06:08.501564 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e704facd-a5fb-4850-a946-30edd26435c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:06:08.502385 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e704facd-a5fb-4850-a946-30edd26435c1 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:06:08.503168 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e704facd-a5fb-4850-a946-30edd26435c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:06:08.503438 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e704facd-a5fb-4850-a946-30edd26435c1 admin admin] PATH_INFO: `/v3/projects/e89512133bbe4e5f96bbe98dfb380a3c` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:06:08.504627 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e704facd-a5fb-4850-a946-30edd26435c1 admin admin] RBAC: Authorizing `identity:get_project(project_id=e89512133bbe4e5f96bbe98dfb380a3c)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:06:08.506661 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e704facd-a5fb-4850-a946-30edd26435c1 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:06:08.508259 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 518/1048] 10.222.0.18 () {56 vars in 1207 bytes} [Tue Oct 12 18:06:08 2021] GET /identity/v3/projects/e89512133bbe4e5f96bbe98dfb380a3c => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:06:08.514242 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bae7c91-52ba-4b83-8253-c6eaeb4e9807 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:06:08.524149 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bae7c91-52ba-4b83-8253-c6eaeb4e9807 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:06:08.528575 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe0a830-e5d4-4aa9-9d0b-e2eb760992b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:06:08.529393 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe0a830-e5d4-4aa9-9d0b-e2eb760992b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:06:08.529674 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe0a830-e5d4-4aa9-9d0b-e2eb760992b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:06:08.529946 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe0a830-e5d4-4aa9-9d0b-e2eb760992b1 admin admin] PATH_INFO: `/v3/projects/e89512133bbe4e5f96bbe98dfb380a3c/users/2e14365ac57349aca2057e7383679b46/roles/6c54f239944d46e3b027ccce97eb8b49` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:06:08.531868 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe0a830-e5d4-4aa9-9d0b-e2eb760992b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e89512133bbe4e5f96bbe98dfb380a3c, user_id=2e14365ac57349aca2057e7383679b46, role_id=6c54f239944d46e3b027ccce97eb8b49)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:06:08.534480 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe0a830-e5d4-4aa9-9d0b-e2eb760992b1 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:06:08.623502 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 531/1049] 10.222.0.18 () {58 vars in 1460 bytes} [Tue Oct 12 18:06:08 2021] PUT /identity/v3/projects/e89512133bbe4e5f96bbe98dfb380a3c/users/2e14365ac57349aca2057e7383679b46/roles/6c54f239944d46e3b027ccce97eb8b49 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:06:10.829706 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daffec1b-21ee-4b59-be0c-212e6768f8cb None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:06:10.830265 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daffec1b-21ee-4b59-be0c-212e6768f8cb None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:06:10.830265 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daffec1b-21ee-4b59-be0c-212e6768f8cb None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:06:10.831992 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 519/1050] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:06:10 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:06:10.837947 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bfd717-cac3-4b7e-bc38-9b9b4681a1c8 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:06:10.838353 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bfd717-cac3-4b7e-bc38-9b9b4681a1c8 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:06:10.838503 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bfd717-cac3-4b7e-bc38-9b9b4681a1c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:06:10.856092 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-83bfd717-cac3-4b7e-bc38-9b9b4681a1c8 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:06:10.857306 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-83bfd717-cac3-4b7e-bc38-9b9b4681a1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:06:10.911285 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 532/1051] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:06:10 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:06:10.935359 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daffec1b-21ee-4b59-be0c-212e6768f8cb None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:06:10.947603 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daffec1b-21ee-4b59-be0c-212e6768f8cb None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:06:10.951921 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17afd569-cff4-40f4-b92e-10f6156e9f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:06:10.952709 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17afd569-cff4-40f4-b92e-10f6156e9f57 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:06:10.952990 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17afd569-cff4-40f4-b92e-10f6156e9f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:06:10.953258 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17afd569-cff4-40f4-b92e-10f6156e9f57 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:06:10.962953 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17afd569-cff4-40f4-b92e-10f6156e9f57 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 18:06:10.969716 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-17afd569-cff4-40f4-b92e-10f6156e9f57 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 18:06:10.970820 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 520/1052] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Oct 12 18:06:10 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:06:10.977095 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bfd717-cac3-4b7e-bc38-9b9b4681a1c8 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:06:10.985686 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bfd717-cac3-4b7e-bc38-9b9b4681a1c8 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:06:10.990694 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2995b99d-7e0f-4c03-b73c-15dd3de119c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:06:10.991332 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2995b99d-7e0f-4c03-b73c-15dd3de119c1 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:06:10.991614 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2995b99d-7e0f-4c03-b73c-15dd3de119c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:06:10.991888 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2995b99d-7e0f-4c03-b73c-15dd3de119c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:06:10.992734 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2995b99d-7e0f-4c03-b73c-15dd3de119c1 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:06:10.993042 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2995b99d-7e0f-4c03-b73c-15dd3de119c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:06:10.994627 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2995b99d-7e0f-4c03-b73c-15dd3de119c1 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:06:11.003101 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 533/1053] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Oct 12 18:06:10 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:06:11.011002 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17afd569-cff4-40f4-b92e-10f6156e9f57 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:06:11.023646 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17afd569-cff4-40f4-b92e-10f6156e9f57 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:06:11.028209 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3786a3-2257-4e81-86e1-e807badbb061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:06:11.029071 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3786a3-2257-4e81-86e1-e807badbb061 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:06:11.029345 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3786a3-2257-4e81-86e1-e807badbb061 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:06:11.029610 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3786a3-2257-4e81-86e1-e807badbb061 admin admin] PATH_INFO: `/v3/users/2e14365ac57349aca2057e7383679b46` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:06:11.030808 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3786a3-2257-4e81-86e1-e807badbb061 admin admin] RBAC: Authorizing `identity:get_user(user_id=2e14365ac57349aca2057e7383679b46)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:06:11.032954 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3786a3-2257-4e81-86e1-e807badbb061 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:06:11.034518 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 521/1054] 10.222.0.18 () {56 vars in 1198 bytes} [Tue Oct 12 18:06:11 2021] GET /identity/v3/users/2e14365ac57349aca2057e7383679b46 => generated 286 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:06:11.040926 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2995b99d-7e0f-4c03-b73c-15dd3de119c1 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:06:11.050923 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2995b99d-7e0f-4c03-b73c-15dd3de119c1 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:06:11.055505 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfde318-dbf4-4231-ac53-645419729ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:06:11.056129 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfde318-dbf4-4231-ac53-645419729ccb admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:06:11.056424 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfde318-dbf4-4231-ac53-645419729ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:06:11.056710 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfde318-dbf4-4231-ac53-645419729ccb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:06:11.064162 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfde318-dbf4-4231-ac53-645419729ccb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:06:11.066497 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfde318-dbf4-4231-ac53-645419729ccb admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:06:11.075051 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 534/1055] 10.222.0.18 () {58 vars in 1324 bytes} [Tue Oct 12 18:06:11 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:06:11.081301 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3786a3-2257-4e81-86e1-e807badbb061 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:06:11.090466 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3786a3-2257-4e81-86e1-e807badbb061 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:06:11.094885 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c256f5d7-fa43-4103-ab4f-39e47a92c1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:06:11.095703 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256f5d7-fa43-4103-ab4f-39e47a92c1c9 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:06:11.095980 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256f5d7-fa43-4103-ab4f-39e47a92c1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:06:11.096247 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256f5d7-fa43-4103-ab4f-39e47a92c1c9 admin admin] PATH_INFO: `/v3/projects/e89512133bbe4e5f96bbe98dfb380a3c` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:06:11.097427 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c256f5d7-fa43-4103-ab4f-39e47a92c1c9 admin admin] RBAC: Authorizing `identity:get_project(project_id=e89512133bbe4e5f96bbe98dfb380a3c)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:06:11.099423 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c256f5d7-fa43-4103-ab4f-39e47a92c1c9 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:06:11.101042 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 522/1056] 10.222.0.18 () {56 vars in 1207 bytes} [Tue Oct 12 18:06:11 2021] GET /identity/v3/projects/e89512133bbe4e5f96bbe98dfb380a3c => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:06:11.107130 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfde318-dbf4-4231-ac53-645419729ccb admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:06:11.116190 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfde318-dbf4-4231-ac53-645419729ccb admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:06:11.120767 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be25b58d-5bf1-4cb6-a1b8-c278b6b91880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:06:11.121383 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be25b58d-5bf1-4cb6-a1b8-c278b6b91880 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:06:11.121668 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be25b58d-5bf1-4cb6-a1b8-c278b6b91880 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:06:11.121944 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be25b58d-5bf1-4cb6-a1b8-c278b6b91880 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:06:11.122766 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be25b58d-5bf1-4cb6-a1b8-c278b6b91880 admin admin] RBAC: Adding query filter params (role.id=6c54f239944d46e3b027ccce97eb8b49, scope.project.id=e89512133bbe4e5f96bbe98dfb380a3c, user.id=2e14365ac57349aca2057e7383679b46) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:06:11.123079 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be25b58d-5bf1-4cb6-a1b8-c278b6b91880 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:06:11.124950 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be25b58d-5bf1-4cb6-a1b8-c278b6b91880 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:06:11.131120 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 535/1057] 10.222.0.18 () {56 vars in 1395 bytes} [Tue Oct 12 18:06:11 2021] GET /identity/v3/role_assignments?user.id=2e14365ac57349aca2057e7383679b46&scope.project.id=e89512133bbe4e5f96bbe98dfb380a3c&role.id=6c54f239944d46e3b027ccce97eb8b49 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:06:13.343706 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09437463-ecf6-4873-a59f-5c29dc8ba2f1 None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:06:13.344259 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09437463-ecf6-4873-a59f-5c29dc8ba2f1 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:06:13.344259 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09437463-ecf6-4873-a59f-5c29dc8ba2f1 None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:06:13.346625 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 523/1058] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:06:13 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:06:13.352384 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3decb8e-4b65-4815-8e19-7a70b1cf8e72 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:06:13.352824 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3decb8e-4b65-4815-8e19-7a70b1cf8e72 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:06:13.352966 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3decb8e-4b65-4815-8e19-7a70b1cf8e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:06:13.370126 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-f3decb8e-4b65-4815-8e19-7a70b1cf8e72 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:06:13.371314 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-f3decb8e-4b65-4815-8e19-7a70b1cf8e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:06:13.378942 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 536/1059] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:06:13 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:06:13.402728 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09437463-ecf6-4873-a59f-5c29dc8ba2f1 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:06:13.415423 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09437463-ecf6-4873-a59f-5c29dc8ba2f1 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:06:13.419724 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d7567-1f33-4afa-86a8-37c6f27c9b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:06:13.420354 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d7567-1f33-4afa-86a8-37c6f27c9b99 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:06:13.420672 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d7567-1f33-4afa-86a8-37c6f27c9b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:06:13.420950 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d7567-1f33-4afa-86a8-37c6f27c9b99 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:06:13.428559 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8d7567-1f33-4afa-86a8-37c6f27c9b99 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:06:13.430307 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8d7567-1f33-4afa-86a8-37c6f27c9b99 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:06:13.439472 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 524/1060] 10.222.0.18 () {58 vars in 1324 bytes} [Tue Oct 12 18:06:13 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:06:13.446235 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3decb8e-4b65-4815-8e19-7a70b1cf8e72 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:06:13.455154 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3decb8e-4b65-4815-8e19-7a70b1cf8e72 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:06:13.460339 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f20873-9833-40c4-b505-b12546f856a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:06:13.461159 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f20873-9833-40c4-b505-b12546f856a5 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:06:13.461442 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f20873-9833-40c4-b505-b12546f856a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:06:13.461718 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f20873-9833-40c4-b505-b12546f856a5 admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:06:13.468658 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f20873-9833-40c4-b505-b12546f856a5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:06:13.470488 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f20873-9833-40c4-b505-b12546f856a5 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:06:13.485914 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-26f20873-9833-40c4-b505-b12546f856a5 admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Oct 12 18:06:13.487781 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 537/1061] 10.222.0.18 () {56 vars in 1138 bytes} [Tue Oct 12 18:06:13 2021] GET /identity/v3/domains/swift_test => generated 90 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:06:13.494448 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d7567-1f33-4afa-86a8-37c6f27c9b99 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:06:13.504017 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d7567-1f33-4afa-86a8-37c6f27c9b99 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:06:13.508788 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f86088c-4212-4365-a2e7-247076d2f3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:06:13.509470 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f86088c-4212-4365-a2e7-247076d2f3c9 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:06:13.509753 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f86088c-4212-4365-a2e7-247076d2f3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:06:13.510032 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f86088c-4212-4365-a2e7-247076d2f3c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:06:13.510762 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f86088c-4212-4365-a2e7-247076d2f3c9 admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:06:13.511065 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f86088c-4212-4365-a2e7-247076d2f3c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:06:13.512679 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f86088c-4212-4365-a2e7-247076d2f3c9 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:06:13.520252 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 525/1062] 10.222.0.18 () {56 vars in 1136 bytes} [Tue Oct 12 18:06:13 2021] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:06:15.724574 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd698d85-35ab-4efa-a96f-988e1a4c0e3a None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:06:15.725107 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd698d85-35ab-4efa-a96f-988e1a4c0e3a None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:06:15.725107 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd698d85-35ab-4efa-a96f-988e1a4c0e3a None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:06:15.726845 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 538/1063] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:06:15 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:06:15.732691 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c31c3-a646-44eb-ab2f-8d0b73f3674d None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:06:15.733057 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c31c3-a646-44eb-ab2f-8d0b73f3674d None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:06:15.733244 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c31c3-a646-44eb-ab2f-8d0b73f3674d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:06:15.750928 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-dc2c31c3-a646-44eb-ab2f-8d0b73f3674d None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:06:15.752121 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-dc2c31c3-a646-44eb-ab2f-8d0b73f3674d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:06:15.760167 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 526/1064] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:06:15 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:06:15.784033 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd698d85-35ab-4efa-a96f-988e1a4c0e3a None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:06:15.795814 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd698d85-35ab-4efa-a96f-988e1a4c0e3a None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:06:15.800612 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4919e4ee-d6b3-4408-8bf3-c4f88f210d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:06:15.801237 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4919e4ee-d6b3-4408-8bf3-c4f88f210d1c admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:06:15.801516 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4919e4ee-d6b3-4408-8bf3-c4f88f210d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:06:15.801784 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4919e4ee-d6b3-4408-8bf3-c4f88f210d1c admin admin] PATH_INFO: `/v3/domains` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:06:15.802530 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4919e4ee-d6b3-4408-8bf3-c4f88f210d1c admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:06:15.804020 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING py.warnings [None req-4919e4ee-d6b3-4408-8bf3-c4f88f210d1c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_domain failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:06:15.804020 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: warnings.warn(msg) Oct 12 18:06:15.804020 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: Oct 12 18:06:15.804928 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4919e4ee-d6b3-4408-8bf3-c4f88f210d1c admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:06:15.893293 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 539/1065] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 12 18:06:15 2021] POST /identity/v3/domains => generated 267 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 18:06:18.162718 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3414305-9039-4dca-b60d-268f64e478c3 None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:06:18.163342 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3414305-9039-4dca-b60d-268f64e478c3 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:06:18.163342 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3414305-9039-4dca-b60d-268f64e478c3 None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:06:18.165074 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 527/1066] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:06:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:06:18.170969 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff23e10-c585-498a-99e8-b39ac29aadd4 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:06:18.171366 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff23e10-c585-498a-99e8-b39ac29aadd4 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:06:18.171505 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff23e10-c585-498a-99e8-b39ac29aadd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:06:18.189387 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-fff23e10-c585-498a-99e8-b39ac29aadd4 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:06:18.190581 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-fff23e10-c585-498a-99e8-b39ac29aadd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:06:18.243681 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 540/1067] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:06:18 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:06:18.267660 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3414305-9039-4dca-b60d-268f64e478c3 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:06:18.279473 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3414305-9039-4dca-b60d-268f64e478c3 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:06:18.284258 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23211f8-56fb-47bb-bb64-741783a38622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:06:18.285122 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23211f8-56fb-47bb-bb64-741783a38622 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:06:18.285402 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23211f8-56fb-47bb-bb64-741783a38622 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:06:18.285674 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23211f8-56fb-47bb-bb64-741783a38622 admin admin] PATH_INFO: `/v3/domains/cc3177fddee3463c897c9846f8738963` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:06:18.295759 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23211f8-56fb-47bb-bb64-741783a38622 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=cc3177fddee3463c897c9846f8738963)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:06:18.297740 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23211f8-56fb-47bb-bb64-741783a38622 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:06:18.299868 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 528/1068] 10.222.0.18 () {56 vars in 1204 bytes} [Tue Oct 12 18:06:18 2021] GET /identity/v3/domains/cc3177fddee3463c897c9846f8738963 => generated 267 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:06:18.305926 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff23e10-c585-498a-99e8-b39ac29aadd4 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:06:18.314427 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff23e10-c585-498a-99e8-b39ac29aadd4 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:06:18.318909 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2da06b-5020-479a-b16d-f561e0f22b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:06:18.319536 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2da06b-5020-479a-b16d-f561e0f22b49 admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:06:18.319812 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2da06b-5020-479a-b16d-f561e0f22b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:06:18.320083 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2da06b-5020-479a-b16d-f561e0f22b49 admin admin] PATH_INFO: `/v3/projects` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:06:18.320828 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2da06b-5020-479a-b16d-f561e0f22b49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:06:18.322702 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2da06b-5020-479a-b16d-f561e0f22b49 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:06:18.435069 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 541/1069] 10.222.0.18 () {60 vars in 1162 bytes} [Tue Oct 12 18:06:18 2021] POST /identity/v3/projects => generated 361 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:06:20.659622 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d74ea8-de71-4987-8d79-4b50e0042859 None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:06:20.660113 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d74ea8-de71-4987-8d79-4b50e0042859 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:06:20.660207 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d74ea8-de71-4987-8d79-4b50e0042859 None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:06:20.661992 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 529/1070] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:06:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:06:20.668139 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98697f0-bec9-4cfb-b9ec-27bec7099852 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:06:20.668573 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98697f0-bec9-4cfb-b9ec-27bec7099852 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:06:20.668724 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98697f0-bec9-4cfb-b9ec-27bec7099852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:06:20.685914 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-b98697f0-bec9-4cfb-b9ec-27bec7099852 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:06:20.687116 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-b98697f0-bec9-4cfb-b9ec-27bec7099852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:06:20.741210 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 542/1071] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:06:20 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:06:20.767009 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d74ea8-de71-4987-8d79-4b50e0042859 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:06:20.779342 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d74ea8-de71-4987-8d79-4b50e0042859 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:06:20.784229 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660f52b9-c88b-41bd-8cfb-1e04366796d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:06:20.785091 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660f52b9-c88b-41bd-8cfb-1e04366796d6 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:06:20.785369 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660f52b9-c88b-41bd-8cfb-1e04366796d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:06:20.785642 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660f52b9-c88b-41bd-8cfb-1e04366796d6 admin admin] PATH_INFO: `/v3/domains/cc3177fddee3463c897c9846f8738963` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:06:20.786820 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660f52b9-c88b-41bd-8cfb-1e04366796d6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=cc3177fddee3463c897c9846f8738963)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:06:20.788796 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660f52b9-c88b-41bd-8cfb-1e04366796d6 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:06:20.790336 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 530/1072] 10.222.0.18 () {56 vars in 1204 bytes} [Tue Oct 12 18:06:20 2021] GET /identity/v3/domains/cc3177fddee3463c897c9846f8738963 => generated 267 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:06:20.796254 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98697f0-bec9-4cfb-b9ec-27bec7099852 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:06:20.804839 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98697f0-bec9-4cfb-b9ec-27bec7099852 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:06:20.809241 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bda2a3d-a9d3-4505-91be-2d18aa0be9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:06:20.809878 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda2a3d-a9d3-4505-91be-2d18aa0be9b4 admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:06:20.810157 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda2a3d-a9d3-4505-91be-2d18aa0be9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:06:20.810430 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda2a3d-a9d3-4505-91be-2d18aa0be9b4 admin admin] PATH_INFO: `/v3/users` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:06:20.811132 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bda2a3d-a9d3-4505-91be-2d18aa0be9b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:06:20.813074 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bda2a3d-a9d3-4505-91be-2d18aa0be9b4 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:06:20.914087 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 543/1073] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Oct 12 18:06:20 2021] POST /identity/v3/users => generated 311 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:06:23.153110 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649d6ff-b4d3-4bc0-9323-08fce66ef6a5 None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:06:23.153665 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649d6ff-b4d3-4bc0-9323-08fce66ef6a5 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:06:23.153665 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649d6ff-b4d3-4bc0-9323-08fce66ef6a5 None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:06:23.155459 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 531/1074] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:06:23 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:06:23.161825 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5dd2af-b186-434a-b945-d19f1e41b632 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:06:23.162253 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5dd2af-b186-434a-b945-d19f1e41b632 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:06:23.162352 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5dd2af-b186-434a-b945-d19f1e41b632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:06:23.179446 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-1e5dd2af-b186-434a-b945-d19f1e41b632 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:06:23.180653 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-1e5dd2af-b186-434a-b945-d19f1e41b632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:06:23.188106 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 544/1075] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:06:23 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:06:23.212544 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e649d6ff-b4d3-4bc0-9323-08fce66ef6a5 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:06:23.225227 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e649d6ff-b4d3-4bc0-9323-08fce66ef6a5 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:06:23.229556 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e80eac5-9cf2-4e78-9ef7-9684c4a3ffd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:06:23.230318 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e80eac5-9cf2-4e78-9ef7-9684c4a3ffd7 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:06:23.230655 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e80eac5-9cf2-4e78-9ef7-9684c4a3ffd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:06:23.230931 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e80eac5-9cf2-4e78-9ef7-9684c4a3ffd7 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:06:23.241310 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e80eac5-9cf2-4e78-9ef7-9684c4a3ffd7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 18:06:23.248129 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-5e80eac5-9cf2-4e78-9ef7-9684c4a3ffd7 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 18:06:23.249336 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 532/1076] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Oct 12 18:06:23 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:06:23.255853 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5dd2af-b186-434a-b945-d19f1e41b632 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:06:23.264763 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5dd2af-b186-434a-b945-d19f1e41b632 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:06:23.270001 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3101644-51d9-43e8-9485-d3d30ca47152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:06:23.270647 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3101644-51d9-43e8-9485-d3d30ca47152 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:06:23.270928 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3101644-51d9-43e8-9485-d3d30ca47152 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:06:23.271201 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3101644-51d9-43e8-9485-d3d30ca47152 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:06:23.271951 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3101644-51d9-43e8-9485-d3d30ca47152 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:06:23.272256 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3101644-51d9-43e8-9485-d3d30ca47152 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:06:23.274011 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3101644-51d9-43e8-9485-d3d30ca47152 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:06:23.282108 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 545/1077] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Oct 12 18:06:23 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:06:23.288976 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e80eac5-9cf2-4e78-9ef7-9684c4a3ffd7 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:06:23.298246 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e80eac5-9cf2-4e78-9ef7-9684c4a3ffd7 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:06:23.302613 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a817b11-6e4c-4cfd-aeb8-6ed5b9e81fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:06:23.303443 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a817b11-6e4c-4cfd-aeb8-6ed5b9e81fc0 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:06:23.303719 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a817b11-6e4c-4cfd-aeb8-6ed5b9e81fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:06:23.303984 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a817b11-6e4c-4cfd-aeb8-6ed5b9e81fc0 admin admin] PATH_INFO: `/v3/users/8acc6f35e1414692a8a2b35792bb5350` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:06:23.317335 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a817b11-6e4c-4cfd-aeb8-6ed5b9e81fc0 admin admin] RBAC: Authorizing `identity:get_user(user_id=8acc6f35e1414692a8a2b35792bb5350)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:06:23.319429 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a817b11-6e4c-4cfd-aeb8-6ed5b9e81fc0 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:06:23.321013 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 533/1078] 10.222.0.18 () {56 vars in 1198 bytes} [Tue Oct 12 18:06:23 2021] GET /identity/v3/users/8acc6f35e1414692a8a2b35792bb5350 => generated 311 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:06:23.326986 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3101644-51d9-43e8-9485-d3d30ca47152 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:06:23.336787 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3101644-51d9-43e8-9485-d3d30ca47152 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:06:23.341171 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e41a6f1-722a-447c-a9dd-cebb2db47d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:06:23.341783 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e41a6f1-722a-447c-a9dd-cebb2db47d77 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:06:23.342062 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e41a6f1-722a-447c-a9dd-cebb2db47d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:06:23.342332 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e41a6f1-722a-447c-a9dd-cebb2db47d77 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:06:23.349808 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e41a6f1-722a-447c-a9dd-cebb2db47d77 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:06:23.351524 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e41a6f1-722a-447c-a9dd-cebb2db47d77 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:06:23.359971 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 546/1079] 10.222.0.18 () {58 vars in 1324 bytes} [Tue Oct 12 18:06:23 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:06:23.366047 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a817b11-6e4c-4cfd-aeb8-6ed5b9e81fc0 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:06:23.375280 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a817b11-6e4c-4cfd-aeb8-6ed5b9e81fc0 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:06:23.380254 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93603a07-2999-4925-8376-75f388a2b73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:06:23.381102 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93603a07-2999-4925-8376-75f388a2b73d admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:06:23.381394 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93603a07-2999-4925-8376-75f388a2b73d admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:06:23.381669 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93603a07-2999-4925-8376-75f388a2b73d admin admin] PATH_INFO: `/v3/projects/67ff77f836454a978a72b88b0a6c417d` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:06:23.382833 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93603a07-2999-4925-8376-75f388a2b73d admin admin] RBAC: Authorizing `identity:get_project(project_id=67ff77f836454a978a72b88b0a6c417d)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:06:23.384877 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93603a07-2999-4925-8376-75f388a2b73d admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:06:23.386464 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 534/1080] 10.222.0.18 () {56 vars in 1207 bytes} [Tue Oct 12 18:06:23 2021] GET /identity/v3/projects/67ff77f836454a978a72b88b0a6c417d => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:06:23.393335 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e41a6f1-722a-447c-a9dd-cebb2db47d77 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:06:23.401502 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e41a6f1-722a-447c-a9dd-cebb2db47d77 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:06:23.405973 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cdf25e-4a38-4910-981e-40ba89e32573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:06:23.406511 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cdf25e-4a38-4910-981e-40ba89e32573 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:06:23.406788 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cdf25e-4a38-4910-981e-40ba89e32573 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:06:23.407060 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cdf25e-4a38-4910-981e-40ba89e32573 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:06:23.407860 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cdf25e-4a38-4910-981e-40ba89e32573 admin admin] RBAC: Adding query filter params (role.id=6c54f239944d46e3b027ccce97eb8b49, scope.project.id=67ff77f836454a978a72b88b0a6c417d, user.id=8acc6f35e1414692a8a2b35792bb5350) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:06:23.408191 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cdf25e-4a38-4910-981e-40ba89e32573 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:06:23.409983 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cdf25e-4a38-4910-981e-40ba89e32573 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:06:23.414966 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 547/1081] 10.222.0.18 () {56 vars in 1395 bytes} [Tue Oct 12 18:06:23 2021] GET /identity/v3/role_assignments?user.id=8acc6f35e1414692a8a2b35792bb5350&scope.project.id=67ff77f836454a978a72b88b0a6c417d&role.id=6c54f239944d46e3b027ccce97eb8b49 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:06:25.631837 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b6654-2a55-407c-9788-e82ea610ff6c None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:06:25.632279 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b6654-2a55-407c-9788-e82ea610ff6c None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:06:25.632430 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b6654-2a55-407c-9788-e82ea610ff6c None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:06:25.634279 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 535/1082] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:06:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:06:25.640154 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d21af-8c76-42cc-824c-07f3aec4be1b None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:06:25.640632 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d21af-8c76-42cc-824c-07f3aec4be1b None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:06:25.640734 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d21af-8c76-42cc-824c-07f3aec4be1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:06:25.658778 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-325d21af-8c76-42cc-824c-07f3aec4be1b None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:06:25.659965 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-325d21af-8c76-42cc-824c-07f3aec4be1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:06:25.667536 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 548/1083] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:06:25 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:06:25.691530 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7b6654-2a55-407c-9788-e82ea610ff6c None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:06:25.703405 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7b6654-2a55-407c-9788-e82ea610ff6c None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:06:25.708331 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a37c7a-9d97-4c00-a3c4-519fa45b1216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:06:25.709155 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a37c7a-9d97-4c00-a3c4-519fa45b1216 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:06:25.709438 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a37c7a-9d97-4c00-a3c4-519fa45b1216 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:06:25.709740 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a37c7a-9d97-4c00-a3c4-519fa45b1216 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:06:25.719622 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a37c7a-9d97-4c00-a3c4-519fa45b1216 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 18:06:25.726546 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-71a37c7a-9d97-4c00-a3c4-519fa45b1216 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 18:06:25.727663 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 536/1084] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Oct 12 18:06:25 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:06:25.733917 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325d21af-8c76-42cc-824c-07f3aec4be1b None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:06:25.742479 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325d21af-8c76-42cc-824c-07f3aec4be1b None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:06:25.746900 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf2a72a-c2f3-4ef9-88af-4aa5439dbaca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:06:25.747544 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2a72a-c2f3-4ef9-88af-4aa5439dbaca admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:06:25.747823 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2a72a-c2f3-4ef9-88af-4aa5439dbaca admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:06:25.748097 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2a72a-c2f3-4ef9-88af-4aa5439dbaca admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:06:25.748890 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf2a72a-c2f3-4ef9-88af-4aa5439dbaca admin admin] RBAC: Adding query filter params (name=admin) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:06:25.749197 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf2a72a-c2f3-4ef9-88af-4aa5439dbaca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:06:25.750775 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf2a72a-c2f3-4ef9-88af-4aa5439dbaca admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:06:25.759162 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 549/1085] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Oct 12 18:06:25 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:06:25.765139 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a37c7a-9d97-4c00-a3c4-519fa45b1216 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:06:25.775090 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a37c7a-9d97-4c00-a3c4-519fa45b1216 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:06:25.779522 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a3eec8-b3e2-4cec-b322-e9daed46acef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:06:25.780330 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3eec8-b3e2-4cec-b322-e9daed46acef admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:06:25.780650 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3eec8-b3e2-4cec-b322-e9daed46acef admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:06:25.780929 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3eec8-b3e2-4cec-b322-e9daed46acef admin admin] PATH_INFO: `/v3/users/8acc6f35e1414692a8a2b35792bb5350` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:06:25.782121 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a3eec8-b3e2-4cec-b322-e9daed46acef admin admin] RBAC: Authorizing `identity:get_user(user_id=8acc6f35e1414692a8a2b35792bb5350)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:06:25.784789 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a3eec8-b3e2-4cec-b322-e9daed46acef admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:06:25.786322 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 537/1086] 10.222.0.18 () {56 vars in 1198 bytes} [Tue Oct 12 18:06:25 2021] GET /identity/v3/users/8acc6f35e1414692a8a2b35792bb5350 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:06:25.792033 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf2a72a-c2f3-4ef9-88af-4aa5439dbaca admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:06:25.801057 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf2a72a-c2f3-4ef9-88af-4aa5439dbaca admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:06:25.805565 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63779e4-1515-48c6-afce-434352824549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:06:25.806364 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63779e4-1515-48c6-afce-434352824549 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:06:25.806645 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63779e4-1515-48c6-afce-434352824549 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:06:25.806919 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63779e4-1515-48c6-afce-434352824549 admin admin] PATH_INFO: `/v3/projects/67ff77f836454a978a72b88b0a6c417d` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:06:25.808068 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63779e4-1515-48c6-afce-434352824549 admin admin] RBAC: Authorizing `identity:get_project(project_id=67ff77f836454a978a72b88b0a6c417d)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:06:25.810132 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63779e4-1515-48c6-afce-434352824549 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:06:25.811712 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 550/1087] 10.222.0.18 () {56 vars in 1207 bytes} [Tue Oct 12 18:06:25 2021] GET /identity/v3/projects/67ff77f836454a978a72b88b0a6c417d => generated 361 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:06:25.818092 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a3eec8-b3e2-4cec-b322-e9daed46acef admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:06:25.827067 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a3eec8-b3e2-4cec-b322-e9daed46acef admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:06:25.832125 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226b7966-899b-4c36-95c2-0a631a76f833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:06:25.832977 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b7966-899b-4c36-95c2-0a631a76f833 admin admin] REQUEST_METHOD: `PUT` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:06:25.833261 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b7966-899b-4c36-95c2-0a631a76f833 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:06:25.833539 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b7966-899b-4c36-95c2-0a631a76f833 admin admin] PATH_INFO: `/v3/projects/67ff77f836454a978a72b88b0a6c417d/users/8acc6f35e1414692a8a2b35792bb5350/roles/6c54f239944d46e3b027ccce97eb8b49` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:06:25.835473 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226b7966-899b-4c36-95c2-0a631a76f833 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67ff77f836454a978a72b88b0a6c417d, user_id=8acc6f35e1414692a8a2b35792bb5350, role_id=6c54f239944d46e3b027ccce97eb8b49)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:06:25.838095 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226b7966-899b-4c36-95c2-0a631a76f833 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:06:25.959398 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 538/1088] 10.222.0.18 () {58 vars in 1460 bytes} [Tue Oct 12 18:06:25 2021] PUT /identity/v3/projects/67ff77f836454a978a72b88b0a6c417d/users/8acc6f35e1414692a8a2b35792bb5350/roles/6c54f239944d46e3b027ccce97eb8b49 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:06:28.171033 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7027a7b-38d4-4f4c-9b27-67de102c37fb None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:06:28.171583 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7027a7b-38d4-4f4c-9b27-67de102c37fb None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:06:28.171583 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7027a7b-38d4-4f4c-9b27-67de102c37fb None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:06:28.173930 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 551/1089] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:06:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:06:28.179800 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574dcbe-988d-4d93-a82f-a50e1b65439f None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:06:28.180183 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574dcbe-988d-4d93-a82f-a50e1b65439f None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:06:28.180357 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574dcbe-988d-4d93-a82f-a50e1b65439f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:06:28.198035 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-e574dcbe-988d-4d93-a82f-a50e1b65439f None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:06:28.199215 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-e574dcbe-988d-4d93-a82f-a50e1b65439f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:06:28.253654 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 539/1090] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:06:28 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:06:28.278309 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7027a7b-38d4-4f4c-9b27-67de102c37fb None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:06:28.290190 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7027a7b-38d4-4f4c-9b27-67de102c37fb None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:06:28.294455 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e7a51-aae0-4a04-9e5d-21fdbcec4084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:06:28.295209 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e7a51-aae0-4a04-9e5d-21fdbcec4084 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:06:28.295486 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e7a51-aae0-4a04-9e5d-21fdbcec4084 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:06:28.295755 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e7a51-aae0-4a04-9e5d-21fdbcec4084 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:06:28.306078 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63e7a51-aae0-4a04-9e5d-21fdbcec4084 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 18:06:28.312880 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-e63e7a51-aae0-4a04-9e5d-21fdbcec4084 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 18:06:28.313986 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 552/1091] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Oct 12 18:06:28 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 18:06:28.320723 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e574dcbe-988d-4d93-a82f-a50e1b65439f None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:06:28.329330 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e574dcbe-988d-4d93-a82f-a50e1b65439f None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:06:28.333879 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22518247-abfa-46c2-b491-9079f2456df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:06:28.334515 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22518247-abfa-46c2-b491-9079f2456df8 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:06:28.334792 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22518247-abfa-46c2-b491-9079f2456df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:06:28.335063 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22518247-abfa-46c2-b491-9079f2456df8 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:06:28.335805 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22518247-abfa-46c2-b491-9079f2456df8 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:06:28.336107 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22518247-abfa-46c2-b491-9079f2456df8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:06:28.337708 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22518247-abfa-46c2-b491-9079f2456df8 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:06:28.345724 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 540/1092] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Oct 12 18:06:28 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:06:28.351901 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e7a51-aae0-4a04-9e5d-21fdbcec4084 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:06:28.364904 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e7a51-aae0-4a04-9e5d-21fdbcec4084 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:06:28.369314 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdd3711-95e5-4205-8956-b26063f2a740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:06:28.370139 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd3711-95e5-4205-8956-b26063f2a740 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:06:28.370417 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd3711-95e5-4205-8956-b26063f2a740 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:06:28.370682 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd3711-95e5-4205-8956-b26063f2a740 admin admin] PATH_INFO: `/v3/users/8acc6f35e1414692a8a2b35792bb5350` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:06:28.371849 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdd3711-95e5-4205-8956-b26063f2a740 admin admin] RBAC: Authorizing `identity:get_user(user_id=8acc6f35e1414692a8a2b35792bb5350)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:06:28.374015 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdd3711-95e5-4205-8956-b26063f2a740 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:06:28.375569 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 553/1093] 10.222.0.18 () {56 vars in 1198 bytes} [Tue Oct 12 18:06:28 2021] GET /identity/v3/users/8acc6f35e1414692a8a2b35792bb5350 => generated 311 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:06:28.382377 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22518247-abfa-46c2-b491-9079f2456df8 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:06:28.392046 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22518247-abfa-46c2-b491-9079f2456df8 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:06:28.396602 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecc054a-d088-453f-a005-3a6a3685407b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:06:28.397228 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc054a-d088-453f-a005-3a6a3685407b admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:06:28.397510 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc054a-d088-453f-a005-3a6a3685407b admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:06:28.397788 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc054a-d088-453f-a005-3a6a3685407b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:06:28.405276 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecc054a-d088-453f-a005-3a6a3685407b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:06:28.407008 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecc054a-d088-453f-a005-3a6a3685407b admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:06:28.415739 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 541/1094] 10.222.0.18 () {58 vars in 1324 bytes} [Tue Oct 12 18:06:28 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:06:28.421696 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdd3711-95e5-4205-8956-b26063f2a740 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:06:28.431341 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdd3711-95e5-4205-8956-b26063f2a740 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:06:28.435871 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb234147-8c96-4f5c-acfe-081c3aa066a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:06:28.440857 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb234147-8c96-4f5c-acfe-081c3aa066a5 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:06:28.440857 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb234147-8c96-4f5c-acfe-081c3aa066a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:06:28.440857 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb234147-8c96-4f5c-acfe-081c3aa066a5 admin admin] PATH_INFO: `/v3/projects/67ff77f836454a978a72b88b0a6c417d` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:06:28.440857 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb234147-8c96-4f5c-acfe-081c3aa066a5 admin admin] RBAC: Authorizing `identity:get_project(project_id=67ff77f836454a978a72b88b0a6c417d)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:06:28.441254 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb234147-8c96-4f5c-acfe-081c3aa066a5 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:06:28.442490 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 554/1095] 10.222.0.18 () {56 vars in 1207 bytes} [Tue Oct 12 18:06:28 2021] GET /identity/v3/projects/67ff77f836454a978a72b88b0a6c417d => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:06:28.449012 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecc054a-d088-453f-a005-3a6a3685407b admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:06:28.457509 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecc054a-d088-453f-a005-3a6a3685407b admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:06:28.462074 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aad5b02-50b1-42e6-9b9f-85d35722f066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:06:28.462688 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad5b02-50b1-42e6-9b9f-85d35722f066 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:06:28.462970 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad5b02-50b1-42e6-9b9f-85d35722f066 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:06:28.463246 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad5b02-50b1-42e6-9b9f-85d35722f066 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:06:28.464069 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aad5b02-50b1-42e6-9b9f-85d35722f066 admin admin] RBAC: Adding query filter params (role.id=6c54f239944d46e3b027ccce97eb8b49, scope.project.id=67ff77f836454a978a72b88b0a6c417d, user.id=8acc6f35e1414692a8a2b35792bb5350) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:06:28.464381 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aad5b02-50b1-42e6-9b9f-85d35722f066 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:06:28.466211 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aad5b02-50b1-42e6-9b9f-85d35722f066 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:06:28.472108 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 542/1096] 10.222.0.18 () {56 vars in 1395 bytes} [Tue Oct 12 18:06:28 2021] GET /identity/v3/role_assignments?user.id=8acc6f35e1414692a8a2b35792bb5350&scope.project.id=67ff77f836454a978a72b88b0a6c417d&role.id=6c54f239944d46e3b027ccce97eb8b49 => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:07:47.314313 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21322177-eae5-42f8-ac71-f282aa728224 None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:07:47.314917 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21322177-eae5-42f8-ac71-f282aa728224 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:07:47.314917 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21322177-eae5-42f8-ac71-f282aa728224 None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:07:47.316685 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 555/1097] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:07:47 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:07:47.322403 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306b107-d3cb-46e3-a0b6-4ba90a0f9365 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:07:47.322816 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306b107-d3cb-46e3-a0b6-4ba90a0f9365 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:07:47.322976 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306b107-d3cb-46e3-a0b6-4ba90a0f9365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:07:47.340390 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-1306b107-d3cb-46e3-a0b6-4ba90a0f9365 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:07:47.341700 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-1306b107-d3cb-46e3-a0b6-4ba90a0f9365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:07:47.350041 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 543/1098] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:07:47 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:07:47.376301 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21322177-eae5-42f8-ac71-f282aa728224 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:07:47.388469 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21322177-eae5-42f8-ac71-f282aa728224 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:07:47.393616 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98b83d6-543f-4d29-b450-cfb9844e4792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:07:47.394403 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b83d6-543f-4d29-b450-cfb9844e4792 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:07:47.394685 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b83d6-543f-4d29-b450-cfb9844e4792 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:07:47.394960 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b83d6-543f-4d29-b450-cfb9844e4792 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:07:47.405499 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98b83d6-543f-4d29-b450-cfb9844e4792 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:07:47.407341 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98b83d6-543f-4d29-b450-cfb9844e4792 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:07:47.424140 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-e98b83d6-543f-4d29-b450-cfb9844e4792 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 18:07:47.425446 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 556/1099] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:07:47 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:07:47.432174 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1306b107-d3cb-46e3-a0b6-4ba90a0f9365 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:07:47.441664 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1306b107-d3cb-46e3-a0b6-4ba90a0f9365 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:07:47.446197 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34154a03-96b9-4d8c-8629-9bb4e68d77fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:07:47.446842 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34154a03-96b9-4d8c-8629-9bb4e68d77fd admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:07:47.447118 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34154a03-96b9-4d8c-8629-9bb4e68d77fd admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:07:47.447386 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34154a03-96b9-4d8c-8629-9bb4e68d77fd admin admin] PATH_INFO: `/v3/domains` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:07:47.448108 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34154a03-96b9-4d8c-8629-9bb4e68d77fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:07:47.448416 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34154a03-96b9-4d8c-8629-9bb4e68d77fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:07:47.450007 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34154a03-96b9-4d8c-8629-9bb4e68d77fd admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:07:47.461383 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 544/1100] 10.222.0.18 () {56 vars in 1130 bytes} [Tue Oct 12 18:07:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:07:47.467786 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98b83d6-543f-4d29-b450-cfb9844e4792 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:07:47.477659 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98b83d6-543f-4d29-b450-cfb9844e4792 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:07:47.482204 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dc9daa-51f1-4325-833f-f0121a12e3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:07:47.482858 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc9daa-51f1-4325-833f-f0121a12e3ae admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:07:47.483160 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc9daa-51f1-4325-833f-f0121a12e3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:07:47.483945 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc9daa-51f1-4325-833f-f0121a12e3ae admin admin] PATH_INFO: `/v3/users` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:07:47.484714 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dc9daa-51f1-4325-833f-f0121a12e3ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:07:47.486660 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dc9daa-51f1-4325-833f-f0121a12e3ae admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:07:47.662898 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 557/1101] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Oct 12 18:07:47 2021] POST /identity/v3/users => generated 251 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 18:07:50.980730 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b9a16-0584-4f28-bcb2-ea8caa36eed5 None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:07:50.981371 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b9a16-0584-4f28-bcb2-ea8caa36eed5 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:07:50.981371 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b9a16-0584-4f28-bcb2-ea8caa36eed5 None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:07:50.982940 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 545/1102] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:07:50 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 18:07:50.988964 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb6892-3bb8-4227-843e-545bc9829e9b None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:07:50.989376 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb6892-3bb8-4227-843e-545bc9829e9b None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:07:50.989513 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb6892-3bb8-4227-843e-545bc9829e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:07:51.007333 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-b9bb6892-3bb8-4227-843e-545bc9829e9b None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:07:51.008591 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-b9bb6892-3bb8-4227-843e-545bc9829e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:07:51.016803 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 558/1103] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:07:50 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:07:51.041001 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014b9a16-0584-4f28-bcb2-ea8caa36eed5 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:07:51.053083 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014b9a16-0584-4f28-bcb2-ea8caa36eed5 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:07:51.057446 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d81fa5-7cfb-49d7-9a84-249f4f7eeff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:07:51.058223 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d81fa5-7cfb-49d7-9a84-249f4f7eeff2 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:07:51.058502 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d81fa5-7cfb-49d7-9a84-249f4f7eeff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:07:51.058774 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d81fa5-7cfb-49d7-9a84-249f4f7eeff2 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:07:51.069702 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d81fa5-7cfb-49d7-9a84-249f4f7eeff2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 18:07:51.076652 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-d2d81fa5-7cfb-49d7-9a84-249f4f7eeff2 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 18:07:51.078376 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 546/1104] 10.222.0.18 () {56 vars in 1123 bytes} [Tue Oct 12 18:07:51 2021] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:07:51.084829 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb6892-3bb8-4227-843e-545bc9829e9b None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:07:51.094100 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb6892-3bb8-4227-843e-545bc9829e9b None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:07:51.098571 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c8ac6-9960-4118-b38e-2ef8ffeb8454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:07:51.099214 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c8ac6-9960-4118-b38e-2ef8ffeb8454 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:07:51.099493 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c8ac6-9960-4118-b38e-2ef8ffeb8454 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:07:51.099764 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c8ac6-9960-4118-b38e-2ef8ffeb8454 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:07:51.100554 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580c8ac6-9960-4118-b38e-2ef8ffeb8454 admin admin] RBAC: Adding query filter params (name=service) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:07:51.100864 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580c8ac6-9960-4118-b38e-2ef8ffeb8454 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:07:51.102487 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580c8ac6-9960-4118-b38e-2ef8ffeb8454 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:07:51.110942 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 559/1105] 10.222.0.18 () {56 vars in 1124 bytes} [Tue Oct 12 18:07:51 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:07:51.117282 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d81fa5-7cfb-49d7-9a84-249f4f7eeff2 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:07:51.127262 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d81fa5-7cfb-49d7-9a84-249f4f7eeff2 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:07:51.131735 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b51b33-f3eb-4fde-9460-014ec57c44fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:07:51.132539 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b51b33-f3eb-4fde-9460-014ec57c44fe admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:07:51.132820 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b51b33-f3eb-4fde-9460-014ec57c44fe admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:07:51.133093 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b51b33-f3eb-4fde-9460-014ec57c44fe admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:07:51.143896 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b51b33-f3eb-4fde-9460-014ec57c44fe admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:07:51.145756 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b51b33-f3eb-4fde-9460-014ec57c44fe admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:07:51.163094 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-a4b51b33-f3eb-4fde-9460-014ec57c44fe admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 18:07:51.164241 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 547/1106] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:07:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:07:51.171272 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c8ac6-9960-4118-b38e-2ef8ffeb8454 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:07:51.180661 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c8ac6-9960-4118-b38e-2ef8ffeb8454 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:07:51.185171 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff6998e-931e-4dc3-89d6-540c1c880564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:07:51.185809 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6998e-931e-4dc3-89d6-540c1c880564 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:07:51.186087 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6998e-931e-4dc3-89d6-540c1c880564 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:07:51.186921 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6998e-931e-4dc3-89d6-540c1c880564 admin admin] PATH_INFO: `/v3/domains` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:07:51.187649 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff6998e-931e-4dc3-89d6-540c1c880564 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:07:51.187951 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff6998e-931e-4dc3-89d6-540c1c880564 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:07:51.189547 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff6998e-931e-4dc3-89d6-540c1c880564 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:07:51.200957 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 560/1107] 10.222.0.18 () {56 vars in 1130 bytes} [Tue Oct 12 18:07:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:07:51.207168 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b51b33-f3eb-4fde-9460-014ec57c44fe admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:07:51.216650 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b51b33-f3eb-4fde-9460-014ec57c44fe admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:07:51.221124 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f5ab90-12d4-4edd-899f-4c58a05ccb37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:07:51.221900 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f5ab90-12d4-4edd-899f-4c58a05ccb37 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:07:51.222364 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f5ab90-12d4-4edd-899f-4c58a05ccb37 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:07:51.222538 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f5ab90-12d4-4edd-899f-4c58a05ccb37 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:07:51.229768 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f5ab90-12d4-4edd-899f-4c58a05ccb37 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:07:51.231880 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f5ab90-12d4-4edd-899f-4c58a05ccb37 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:07:51.246486 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-35f5ab90-12d4-4edd-899f-4c58a05ccb37 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 12 18:07:51.247643 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 548/1108] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:07:51 2021] GET /identity/v3/users/placement => generated 87 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:07:51.254747 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff6998e-931e-4dc3-89d6-540c1c880564 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:07:51.264499 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff6998e-931e-4dc3-89d6-540c1c880564 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:07:51.269352 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9858f75-cac6-4bbf-abca-876da71d5303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:07:51.270002 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9858f75-cac6-4bbf-abca-876da71d5303 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:07:51.270285 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9858f75-cac6-4bbf-abca-876da71d5303 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:07:51.270587 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9858f75-cac6-4bbf-abca-876da71d5303 admin admin] PATH_INFO: `/v3/users` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:07:51.271411 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9858f75-cac6-4bbf-abca-876da71d5303 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:07:51.271721 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9858f75-cac6-4bbf-abca-876da71d5303 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:07:51.273608 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9858f75-cac6-4bbf-abca-876da71d5303 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:07:51.290833 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 561/1109] 10.222.0.18 () {56 vars in 1164 bytes} [Tue Oct 12 18:07:51 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:07:51.297627 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f5ab90-12d4-4edd-899f-4c58a05ccb37 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:07:51.307180 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f5ab90-12d4-4edd-899f-4c58a05ccb37 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:07:51.312220 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcff6e53-a981-4f67-a3a1-12948b120ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:07:51.312893 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcff6e53-a981-4f67-a3a1-12948b120ca4 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:07:51.313168 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcff6e53-a981-4f67-a3a1-12948b120ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:07:51.313433 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcff6e53-a981-4f67-a3a1-12948b120ca4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:07:51.321222 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcff6e53-a981-4f67-a3a1-12948b120ca4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:07:51.322980 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcff6e53-a981-4f67-a3a1-12948b120ca4 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:07:51.331777 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 549/1110] 10.222.0.18 () {58 vars in 1324 bytes} [Tue Oct 12 18:07:51 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:07:51.338057 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9858f75-cac6-4bbf-abca-876da71d5303 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:07:51.347621 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9858f75-cac6-4bbf-abca-876da71d5303 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:07:51.352150 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b3851e-b305-425d-923a-b06cafab3bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:07:51.352962 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3851e-b305-425d-923a-b06cafab3bad admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:07:51.353246 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3851e-b305-425d-923a-b06cafab3bad admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:07:51.353519 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3851e-b305-425d-923a-b06cafab3bad admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:07:51.364261 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b3851e-b305-425d-923a-b06cafab3bad admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:07:51.366134 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b3851e-b305-425d-923a-b06cafab3bad admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:07:51.383730 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-11b3851e-b305-425d-923a-b06cafab3bad admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 18:07:51.384921 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 562/1111] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:07:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:07:51.391657 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcff6e53-a981-4f67-a3a1-12948b120ca4 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:07:51.400803 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcff6e53-a981-4f67-a3a1-12948b120ca4 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:07:51.406082 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552c65e1-6ac2-43dd-878a-5aa1037b29d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:07:51.408247 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c65e1-6ac2-43dd-878a-5aa1037b29d8 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:07:51.408247 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c65e1-6ac2-43dd-878a-5aa1037b29d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:07:51.408247 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c65e1-6ac2-43dd-878a-5aa1037b29d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:07:51.408247 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552c65e1-6ac2-43dd-878a-5aa1037b29d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:07:51.408617 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552c65e1-6ac2-43dd-878a-5aa1037b29d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:07:51.409880 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552c65e1-6ac2-43dd-878a-5aa1037b29d8 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:07:51.421223 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 550/1112] 10.222.0.18 () {56 vars in 1130 bytes} [Tue Oct 12 18:07:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:07:51.427385 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b3851e-b305-425d-923a-b06cafab3bad admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:07:51.437059 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b3851e-b305-425d-923a-b06cafab3bad admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:07:51.441687 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fc1441-6f52-45d3-9253-fb3ae5e398a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:07:51.442458 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc1441-6f52-45d3-9253-fb3ae5e398a9 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:07:51.442742 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc1441-6f52-45d3-9253-fb3ae5e398a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:07:51.443019 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc1441-6f52-45d3-9253-fb3ae5e398a9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:07:51.449818 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fc1441-6f52-45d3-9253-fb3ae5e398a9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:07:51.451776 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fc1441-6f52-45d3-9253-fb3ae5e398a9 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:07:51.465233 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-f3fc1441-6f52-45d3-9253-fb3ae5e398a9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 18:07:51.466484 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 563/1113] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Oct 12 18:07:51 2021] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:07:51.473563 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552c65e1-6ac2-43dd-878a-5aa1037b29d8 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:07:51.483840 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552c65e1-6ac2-43dd-878a-5aa1037b29d8 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:07:51.488371 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2912d4-7841-4765-b345-2bc3206adee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:07:51.489168 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2912d4-7841-4765-b345-2bc3206adee9 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:07:51.489455 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2912d4-7841-4765-b345-2bc3206adee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:07:51.489731 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2912d4-7841-4765-b345-2bc3206adee9 admin admin] PATH_INFO: `/v3/projects` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:07:51.490527 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2912d4-7841-4765-b345-2bc3206adee9 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:07:51.490836 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2912d4-7841-4765-b345-2bc3206adee9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:07:51.492705 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2912d4-7841-4765-b345-2bc3206adee9 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:07:51.504870 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 551/1114] 10.222.0.18 () {56 vars in 1169 bytes} [Tue Oct 12 18:07:51 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:07:51.511537 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fc1441-6f52-45d3-9253-fb3ae5e398a9 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:07:51.522768 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fc1441-6f52-45d3-9253-fb3ae5e398a9 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:07:51.527406 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2889cdf6-c97c-4a87-ab66-70e95e6038d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:07:51.528037 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2889cdf6-c97c-4a87-ab66-70e95e6038d4 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:07:51.528317 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2889cdf6-c97c-4a87-ab66-70e95e6038d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:07:51.528622 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2889cdf6-c97c-4a87-ab66-70e95e6038d4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:07:51.529574 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2889cdf6-c97c-4a87-ab66-70e95e6038d4 admin admin] RBAC: Adding query filter params (role.id=24b43b2260b1455e832abdff63df40bd, scope.project.id=e843aaa9e5e44a8e98f7cc7412d9697b, user.id=4bd99e4f2d444a388ecde7ea3cb61089) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:07:51.529888 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2889cdf6-c97c-4a87-ab66-70e95e6038d4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:07:51.532273 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2889cdf6-c97c-4a87-ab66-70e95e6038d4 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:07:51.537836 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 564/1115] 10.222.0.18 () {56 vars in 1395 bytes} [Tue Oct 12 18:07:51 2021] GET /identity/v3/role_assignments?user.id=4bd99e4f2d444a388ecde7ea3cb61089&scope.project.id=e843aaa9e5e44a8e98f7cc7412d9697b&role.id=24b43b2260b1455e832abdff63df40bd => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:07:53.772315 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30828d4b-beb8-4755-963b-c94e5cfd9388 None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:07:53.772913 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30828d4b-beb8-4755-963b-c94e5cfd9388 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:07:53.772913 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30828d4b-beb8-4755-963b-c94e5cfd9388 None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:07:53.774639 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 552/1116] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:07:53 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:07:53.781206 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58bebd4-18b1-4f49-8ac7-f3cd21213545 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:07:53.781641 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58bebd4-18b1-4f49-8ac7-f3cd21213545 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:07:53.781763 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58bebd4-18b1-4f49-8ac7-f3cd21213545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:07:53.799107 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-a58bebd4-18b1-4f49-8ac7-f3cd21213545 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:07:53.800309 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-a58bebd4-18b1-4f49-8ac7-f3cd21213545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:07:53.807879 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 565/1117] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:07:53 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:07:53.832213 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30828d4b-beb8-4755-963b-c94e5cfd9388 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:07:53.844158 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30828d4b-beb8-4755-963b-c94e5cfd9388 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:07:53.848627 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358a5678-d4e7-4858-b9ca-b0fb6a1c7ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:07:53.849413 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a5678-d4e7-4858-b9ca-b0fb6a1c7ff8 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:07:53.849690 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a5678-d4e7-4858-b9ca-b0fb6a1c7ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:07:53.849962 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a5678-d4e7-4858-b9ca-b0fb6a1c7ff8 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:07:53.865594 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358a5678-d4e7-4858-b9ca-b0fb6a1c7ff8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 18:07:53.872590 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-358a5678-d4e7-4858-b9ca-b0fb6a1c7ff8 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 18:07:53.874245 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 553/1118] 10.222.0.18 () {56 vars in 1123 bytes} [Tue Oct 12 18:07:53 2021] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:07:53.881408 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58bebd4-18b1-4f49-8ac7-f3cd21213545 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:07:53.890965 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58bebd4-18b1-4f49-8ac7-f3cd21213545 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:07:53.896157 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1faf9eb-7678-4175-b8c6-a1012c9c0dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:07:53.896850 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1faf9eb-7678-4175-b8c6-a1012c9c0dae admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:07:53.897127 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1faf9eb-7678-4175-b8c6-a1012c9c0dae admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:07:53.897396 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1faf9eb-7678-4175-b8c6-a1012c9c0dae admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:07:53.898174 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1faf9eb-7678-4175-b8c6-a1012c9c0dae admin admin] RBAC: Adding query filter params (name=service) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:07:53.898475 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1faf9eb-7678-4175-b8c6-a1012c9c0dae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:07:53.900065 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1faf9eb-7678-4175-b8c6-a1012c9c0dae admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:07:53.908167 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 566/1119] 10.222.0.18 () {56 vars in 1124 bytes} [Tue Oct 12 18:07:53 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:07:53.914419 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358a5678-d4e7-4858-b9ca-b0fb6a1c7ff8 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:07:53.924538 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358a5678-d4e7-4858-b9ca-b0fb6a1c7ff8 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:07:53.928958 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc50a12-69d7-4228-9618-c02e138cd349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:07:53.929739 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc50a12-69d7-4228-9618-c02e138cd349 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:07:53.929990 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc50a12-69d7-4228-9618-c02e138cd349 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:07:53.930255 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc50a12-69d7-4228-9618-c02e138cd349 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:07:53.940962 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc50a12-69d7-4228-9618-c02e138cd349 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:07:53.942994 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc50a12-69d7-4228-9618-c02e138cd349 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:07:53.960350 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-ecc50a12-69d7-4228-9618-c02e138cd349 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 18:07:53.961543 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 554/1120] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:07:53 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:07:53.968228 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1faf9eb-7678-4175-b8c6-a1012c9c0dae admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:07:53.978211 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1faf9eb-7678-4175-b8c6-a1012c9c0dae admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:07:53.982783 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b2b0a7-12d3-4b39-bb56-6a5874fb438f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:07:53.983457 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2b0a7-12d3-4b39-bb56-6a5874fb438f admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:07:53.983735 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2b0a7-12d3-4b39-bb56-6a5874fb438f admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:07:53.984006 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2b0a7-12d3-4b39-bb56-6a5874fb438f admin admin] PATH_INFO: `/v3/domains` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:07:53.984767 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b2b0a7-12d3-4b39-bb56-6a5874fb438f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:07:53.985069 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b2b0a7-12d3-4b39-bb56-6a5874fb438f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:07:53.986843 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b2b0a7-12d3-4b39-bb56-6a5874fb438f admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:07:53.999529 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 567/1121] 10.222.0.18 () {56 vars in 1130 bytes} [Tue Oct 12 18:07:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:07:54.005860 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc50a12-69d7-4228-9618-c02e138cd349 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:07:54.015959 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc50a12-69d7-4228-9618-c02e138cd349 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:07:54.020864 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296e2e7b-6aeb-4402-b12c-8870d619a848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:07:54.021667 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e2e7b-6aeb-4402-b12c-8870d619a848 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:07:54.021928 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e2e7b-6aeb-4402-b12c-8870d619a848 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:07:54.022201 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e2e7b-6aeb-4402-b12c-8870d619a848 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:07:54.029403 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296e2e7b-6aeb-4402-b12c-8870d619a848 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:07:54.031407 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296e2e7b-6aeb-4402-b12c-8870d619a848 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:07:54.045247 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-296e2e7b-6aeb-4402-b12c-8870d619a848 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 12 18:07:54.046416 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 555/1122] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:07:54 2021] GET /identity/v3/users/placement => generated 87 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:07:54.052831 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b2b0a7-12d3-4b39-bb56-6a5874fb438f admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:07:54.063041 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b2b0a7-12d3-4b39-bb56-6a5874fb438f admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:07:54.067585 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be600ace-0419-43b2-992c-60620029820a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:07:54.068227 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be600ace-0419-43b2-992c-60620029820a admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:07:54.068544 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be600ace-0419-43b2-992c-60620029820a admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:07:54.068815 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be600ace-0419-43b2-992c-60620029820a admin admin] PATH_INFO: `/v3/users` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:07:54.069647 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be600ace-0419-43b2-992c-60620029820a admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:07:54.069950 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be600ace-0419-43b2-992c-60620029820a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:07:54.071784 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be600ace-0419-43b2-992c-60620029820a admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:07:54.089384 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 568/1123] 10.222.0.18 () {56 vars in 1164 bytes} [Tue Oct 12 18:07:54 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:07:54.095788 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296e2e7b-6aeb-4402-b12c-8870d619a848 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:07:54.105279 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296e2e7b-6aeb-4402-b12c-8870d619a848 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:07:54.109812 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e060ff-c24c-463a-ae72-ad5239c66335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:07:54.110583 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e060ff-c24c-463a-ae72-ad5239c66335 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:07:54.110862 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e060ff-c24c-463a-ae72-ad5239c66335 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:07:54.111142 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e060ff-c24c-463a-ae72-ad5239c66335 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:07:54.121291 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e060ff-c24c-463a-ae72-ad5239c66335 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:07:54.123167 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e060ff-c24c-463a-ae72-ad5239c66335 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:07:54.140876 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-69e060ff-c24c-463a-ae72-ad5239c66335 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 18:07:54.142027 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 556/1124] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:07:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:07:54.148868 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be600ace-0419-43b2-992c-60620029820a admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:07:54.159336 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be600ace-0419-43b2-992c-60620029820a admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:07:54.163934 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f12f371-7128-46ba-b32f-7a2b96e8a36c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:07:54.164614 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f12f371-7128-46ba-b32f-7a2b96e8a36c admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:07:54.164901 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f12f371-7128-46ba-b32f-7a2b96e8a36c admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:07:54.165172 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f12f371-7128-46ba-b32f-7a2b96e8a36c admin admin] PATH_INFO: `/v3/domains` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:07:54.165893 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f12f371-7128-46ba-b32f-7a2b96e8a36c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:07:54.166195 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f12f371-7128-46ba-b32f-7a2b96e8a36c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:07:54.167770 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f12f371-7128-46ba-b32f-7a2b96e8a36c admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:07:54.179831 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 569/1125] 10.222.0.18 () {56 vars in 1130 bytes} [Tue Oct 12 18:07:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:07:54.186323 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e060ff-c24c-463a-ae72-ad5239c66335 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:07:54.196501 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e060ff-c24c-463a-ae72-ad5239c66335 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:07:54.200966 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1509de34-9e11-4ddf-ac94-f0e06cc01c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:07:54.201763 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1509de34-9e11-4ddf-ac94-f0e06cc01c47 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:07:54.202044 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1509de34-9e11-4ddf-ac94-f0e06cc01c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:07:54.202316 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1509de34-9e11-4ddf-ac94-f0e06cc01c47 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:07:54.209091 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1509de34-9e11-4ddf-ac94-f0e06cc01c47 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:07:54.211030 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1509de34-9e11-4ddf-ac94-f0e06cc01c47 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:07:54.223893 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-1509de34-9e11-4ddf-ac94-f0e06cc01c47 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 18:07:54.230058 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 557/1126] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Oct 12 18:07:54 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:07:54.231673 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f12f371-7128-46ba-b32f-7a2b96e8a36c admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:07:54.241694 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f12f371-7128-46ba-b32f-7a2b96e8a36c admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:07:54.246135 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648fb8c7-0315-4949-8cf3-e789fab23b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:07:54.246771 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648fb8c7-0315-4949-8cf3-e789fab23b6c admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:07:54.247067 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648fb8c7-0315-4949-8cf3-e789fab23b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:07:54.247322 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648fb8c7-0315-4949-8cf3-e789fab23b6c admin admin] PATH_INFO: `/v3/projects` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:07:54.248106 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648fb8c7-0315-4949-8cf3-e789fab23b6c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:07:54.248434 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648fb8c7-0315-4949-8cf3-e789fab23b6c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:07:54.250846 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648fb8c7-0315-4949-8cf3-e789fab23b6c admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:07:54.262626 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 570/1127] 10.222.0.18 () {56 vars in 1169 bytes} [Tue Oct 12 18:07:54 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:07:54.269491 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1509de34-9e11-4ddf-ac94-f0e06cc01c47 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:07:54.279861 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1509de34-9e11-4ddf-ac94-f0e06cc01c47 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:07:54.284612 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e96734-911b-48c2-b19a-23c26e69b8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:07:54.285479 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e96734-911b-48c2-b19a-23c26e69b8fc admin admin] REQUEST_METHOD: `PUT` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:07:54.285763 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e96734-911b-48c2-b19a-23c26e69b8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:07:54.286040 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e96734-911b-48c2-b19a-23c26e69b8fc admin admin] PATH_INFO: `/v3/projects/e843aaa9e5e44a8e98f7cc7412d9697b/users/4bd99e4f2d444a388ecde7ea3cb61089/roles/24b43b2260b1455e832abdff63df40bd` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:07:54.300587 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e96734-911b-48c2-b19a-23c26e69b8fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e843aaa9e5e44a8e98f7cc7412d9697b, user_id=4bd99e4f2d444a388ecde7ea3cb61089, role_id=24b43b2260b1455e832abdff63df40bd)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:07:54.303235 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e96734-911b-48c2-b19a-23c26e69b8fc admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:07:54.594404 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 558/1128] 10.222.0.18 () {58 vars in 1460 bytes} [Tue Oct 12 18:07:54 2021] PUT /identity/v3/projects/e843aaa9e5e44a8e98f7cc7412d9697b/users/4bd99e4f2d444a388ecde7ea3cb61089/roles/24b43b2260b1455e832abdff63df40bd => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:07:56.815113 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6921bead-fc6d-4fad-8d18-c8c385716954 None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:07:56.815706 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6921bead-fc6d-4fad-8d18-c8c385716954 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:07:56.815706 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6921bead-fc6d-4fad-8d18-c8c385716954 None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:07:56.817517 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 571/1129] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:07:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:07:56.823621 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87808e9b-5fd0-48f6-a0c6-53e982e7dc7a None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:07:56.824035 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87808e9b-5fd0-48f6-a0c6-53e982e7dc7a None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:07:56.824224 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87808e9b-5fd0-48f6-a0c6-53e982e7dc7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:07:56.841763 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-87808e9b-5fd0-48f6-a0c6-53e982e7dc7a None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:07:56.843469 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-87808e9b-5fd0-48f6-a0c6-53e982e7dc7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:07:56.898970 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 559/1130] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:07:56 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:07:56.924355 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6921bead-fc6d-4fad-8d18-c8c385716954 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:07:56.936278 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6921bead-fc6d-4fad-8d18-c8c385716954 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:07:56.940930 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addeb087-8f51-4c5f-a040-242d5451bba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:07:56.941711 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addeb087-8f51-4c5f-a040-242d5451bba0 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:07:56.941989 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addeb087-8f51-4c5f-a040-242d5451bba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:07:56.942257 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addeb087-8f51-4c5f-a040-242d5451bba0 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:07:56.952224 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addeb087-8f51-4c5f-a040-242d5451bba0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 18:07:56.960134 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-addeb087-8f51-4c5f-a040-242d5451bba0 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 18:07:56.961329 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 572/1131] 10.222.0.18 () {56 vars in 1123 bytes} [Tue Oct 12 18:07:56 2021] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:07:56.968527 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87808e9b-5fd0-48f6-a0c6-53e982e7dc7a None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:07:56.977591 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87808e9b-5fd0-48f6-a0c6-53e982e7dc7a None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:07:56.982290 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4597ab83-f83a-4a0e-ba04-32f4fe3d6887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:07:56.982974 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4597ab83-f83a-4a0e-ba04-32f4fe3d6887 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:07:56.983893 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4597ab83-f83a-4a0e-ba04-32f4fe3d6887 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:07:56.984187 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4597ab83-f83a-4a0e-ba04-32f4fe3d6887 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:07:56.985022 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4597ab83-f83a-4a0e-ba04-32f4fe3d6887 admin admin] RBAC: Adding query filter params (name=service) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:07:56.985369 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4597ab83-f83a-4a0e-ba04-32f4fe3d6887 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:07:56.986972 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4597ab83-f83a-4a0e-ba04-32f4fe3d6887 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:07:56.995431 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 560/1132] 10.222.0.18 () {56 vars in 1124 bytes} [Tue Oct 12 18:07:56 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:07:57.001716 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addeb087-8f51-4c5f-a040-242d5451bba0 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:07:57.011734 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addeb087-8f51-4c5f-a040-242d5451bba0 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:07:57.016265 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c8dff-1463-4004-bfb1-ebcb41c98202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:07:57.017053 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c8dff-1463-4004-bfb1-ebcb41c98202 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:07:57.017592 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c8dff-1463-4004-bfb1-ebcb41c98202 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:07:57.017863 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c8dff-1463-4004-bfb1-ebcb41c98202 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:07:57.028230 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285c8dff-1463-4004-bfb1-ebcb41c98202 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:07:57.030756 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285c8dff-1463-4004-bfb1-ebcb41c98202 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:07:57.047450 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-285c8dff-1463-4004-bfb1-ebcb41c98202 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 18:07:57.048661 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 573/1133] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:07:57 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:07:57.055185 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4597ab83-f83a-4a0e-ba04-32f4fe3d6887 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:07:57.065245 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4597ab83-f83a-4a0e-ba04-32f4fe3d6887 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:07:57.069805 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f92562-e3ec-496d-8230-43ba170d56ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:07:57.070448 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f92562-e3ec-496d-8230-43ba170d56ab admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:07:57.070730 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f92562-e3ec-496d-8230-43ba170d56ab admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:07:57.071005 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f92562-e3ec-496d-8230-43ba170d56ab admin admin] PATH_INFO: `/v3/domains` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:07:57.071735 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f92562-e3ec-496d-8230-43ba170d56ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:07:57.072042 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f92562-e3ec-496d-8230-43ba170d56ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:07:57.073654 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f92562-e3ec-496d-8230-43ba170d56ab admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:07:57.086253 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 561/1134] 10.222.0.18 () {56 vars in 1130 bytes} [Tue Oct 12 18:07:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:07:57.092585 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c8dff-1463-4004-bfb1-ebcb41c98202 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:07:57.102229 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c8dff-1463-4004-bfb1-ebcb41c98202 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:07:57.106803 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39611072-f1a2-4d1d-9ce6-93aa37bf28b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:07:57.107591 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39611072-f1a2-4d1d-9ce6-93aa37bf28b0 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:07:57.107877 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39611072-f1a2-4d1d-9ce6-93aa37bf28b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:07:57.108156 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39611072-f1a2-4d1d-9ce6-93aa37bf28b0 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:07:57.115589 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39611072-f1a2-4d1d-9ce6-93aa37bf28b0 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:07:57.117656 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39611072-f1a2-4d1d-9ce6-93aa37bf28b0 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:07:57.132013 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-39611072-f1a2-4d1d-9ce6-93aa37bf28b0 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 12 18:07:57.133265 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 574/1135] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:07:57 2021] GET /identity/v3/users/placement => generated 87 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:07:57.140245 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f92562-e3ec-496d-8230-43ba170d56ab admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:07:57.150072 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f92562-e3ec-496d-8230-43ba170d56ab admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:07:57.154570 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef849f3-d0b8-4801-97b8-bd6e2a0164df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:07:57.155221 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef849f3-d0b8-4801-97b8-bd6e2a0164df admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:07:57.155500 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef849f3-d0b8-4801-97b8-bd6e2a0164df admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:07:57.155772 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef849f3-d0b8-4801-97b8-bd6e2a0164df admin admin] PATH_INFO: `/v3/users` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:07:57.156641 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef849f3-d0b8-4801-97b8-bd6e2a0164df admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:07:57.156946 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef849f3-d0b8-4801-97b8-bd6e2a0164df admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:07:57.158766 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef849f3-d0b8-4801-97b8-bd6e2a0164df admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:07:57.176164 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 562/1136] 10.222.0.18 () {56 vars in 1164 bytes} [Tue Oct 12 18:07:57 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:07:57.182493 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39611072-f1a2-4d1d-9ce6-93aa37bf28b0 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:07:57.192768 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39611072-f1a2-4d1d-9ce6-93aa37bf28b0 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:07:57.197262 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acee0e3-cc7d-4dda-88a1-7fb1234ee6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:07:57.197890 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acee0e3-cc7d-4dda-88a1-7fb1234ee6a2 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:07:57.198172 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acee0e3-cc7d-4dda-88a1-7fb1234ee6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:07:57.198481 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acee0e3-cc7d-4dda-88a1-7fb1234ee6a2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:07:57.207042 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acee0e3-cc7d-4dda-88a1-7fb1234ee6a2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:07:57.208900 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acee0e3-cc7d-4dda-88a1-7fb1234ee6a2 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:07:57.218357 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 575/1137] 10.222.0.18 () {58 vars in 1324 bytes} [Tue Oct 12 18:07:57 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:07:57.224750 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef849f3-d0b8-4801-97b8-bd6e2a0164df admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:07:57.234415 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef849f3-d0b8-4801-97b8-bd6e2a0164df admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:07:57.238967 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5536a26b-f85d-432b-973f-fd431d347ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:07:57.239753 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536a26b-f85d-432b-973f-fd431d347ed5 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:07:57.240035 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536a26b-f85d-432b-973f-fd431d347ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:07:57.240310 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536a26b-f85d-432b-973f-fd431d347ed5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:07:57.250563 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5536a26b-f85d-432b-973f-fd431d347ed5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:07:57.252433 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5536a26b-f85d-432b-973f-fd431d347ed5 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:07:57.270664 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-5536a26b-f85d-432b-973f-fd431d347ed5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 18:07:57.271833 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 563/1138] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:07:57 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:07:57.278049 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acee0e3-cc7d-4dda-88a1-7fb1234ee6a2 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:07:57.287686 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acee0e3-cc7d-4dda-88a1-7fb1234ee6a2 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:07:57.292299 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63981627-aa5c-4e0d-9fbf-b7e9de5660d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:07:57.292988 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63981627-aa5c-4e0d-9fbf-b7e9de5660d1 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:07:57.293274 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63981627-aa5c-4e0d-9fbf-b7e9de5660d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:07:57.293550 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63981627-aa5c-4e0d-9fbf-b7e9de5660d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:07:57.294270 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63981627-aa5c-4e0d-9fbf-b7e9de5660d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:07:57.294574 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63981627-aa5c-4e0d-9fbf-b7e9de5660d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:07:57.296294 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63981627-aa5c-4e0d-9fbf-b7e9de5660d1 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:07:57.307578 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 576/1139] 10.222.0.18 () {56 vars in 1130 bytes} [Tue Oct 12 18:07:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:07:57.313849 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5536a26b-f85d-432b-973f-fd431d347ed5 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:07:57.323449 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5536a26b-f85d-432b-973f-fd431d347ed5 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:07:57.328357 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dc0b97-b3ee-46d4-8d0d-737db02cfe24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:07:57.329156 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc0b97-b3ee-46d4-8d0d-737db02cfe24 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:07:57.329433 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc0b97-b3ee-46d4-8d0d-737db02cfe24 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:07:57.329776 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc0b97-b3ee-46d4-8d0d-737db02cfe24 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:07:57.336733 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dc0b97-b3ee-46d4-8d0d-737db02cfe24 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:07:57.338684 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dc0b97-b3ee-46d4-8d0d-737db02cfe24 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:07:57.352310 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-03dc0b97-b3ee-46d4-8d0d-737db02cfe24 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 18:07:57.353454 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 564/1140] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Oct 12 18:07:57 2021] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:07:57.360114 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63981627-aa5c-4e0d-9fbf-b7e9de5660d1 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:07:57.369759 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63981627-aa5c-4e0d-9fbf-b7e9de5660d1 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:07:57.374288 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab287691-46ea-4e62-ac5f-a146fd97f8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:07:57.374929 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab287691-46ea-4e62-ac5f-a146fd97f8bf admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:07:57.375209 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab287691-46ea-4e62-ac5f-a146fd97f8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:07:57.375484 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab287691-46ea-4e62-ac5f-a146fd97f8bf admin admin] PATH_INFO: `/v3/projects` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:07:57.376271 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab287691-46ea-4e62-ac5f-a146fd97f8bf admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:07:57.376609 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab287691-46ea-4e62-ac5f-a146fd97f8bf admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:07:57.378456 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab287691-46ea-4e62-ac5f-a146fd97f8bf admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:07:57.390951 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 577/1141] 10.222.0.18 () {56 vars in 1169 bytes} [Tue Oct 12 18:07:57 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:07:57.399871 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dc0b97-b3ee-46d4-8d0d-737db02cfe24 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:07:57.411523 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dc0b97-b3ee-46d4-8d0d-737db02cfe24 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:07:57.415972 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af014ec-4adf-4445-8405-88dfa42f2f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:07:57.416650 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af014ec-4adf-4445-8405-88dfa42f2f52 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:07:57.416931 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af014ec-4adf-4445-8405-88dfa42f2f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:07:57.417206 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af014ec-4adf-4445-8405-88dfa42f2f52 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:07:57.418037 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af014ec-4adf-4445-8405-88dfa42f2f52 admin admin] RBAC: Adding query filter params (role.id=24b43b2260b1455e832abdff63df40bd, scope.project.id=e843aaa9e5e44a8e98f7cc7412d9697b, user.id=4bd99e4f2d444a388ecde7ea3cb61089) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:07:57.418346 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af014ec-4adf-4445-8405-88dfa42f2f52 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:07:57.420170 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af014ec-4adf-4445-8405-88dfa42f2f52 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:07:57.425939 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 565/1142] 10.222.0.18 () {56 vars in 1395 bytes} [Tue Oct 12 18:07:57 2021] GET /identity/v3/role_assignments?user.id=4bd99e4f2d444a388ecde7ea3cb61089&scope.project.id=e843aaa9e5e44a8e98f7cc7412d9697b&role.id=24b43b2260b1455e832abdff63df40bd => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:07:59.745914 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39890055-b962-4258-b41a-523a7d8c34bb None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:07:59.746470 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39890055-b962-4258-b41a-523a7d8c34bb None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:07:59.746470 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39890055-b962-4258-b41a-523a7d8c34bb None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:07:59.748297 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 578/1143] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:07:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:07:59.754921 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986d3ee-0463-4c3e-8942-4ffe0e719867 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:07:59.755335 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986d3ee-0463-4c3e-8942-4ffe0e719867 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:07:59.755475 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986d3ee-0463-4c3e-8942-4ffe0e719867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:07:59.774920 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-a986d3ee-0463-4c3e-8942-4ffe0e719867 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:07:59.776203 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-a986d3ee-0463-4c3e-8942-4ffe0e719867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:07:59.784530 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 566/1144] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:07:59 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:07:59.809902 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39890055-b962-4258-b41a-523a7d8c34bb None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:07:59.823323 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39890055-b962-4258-b41a-523a7d8c34bb None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:07:59.827965 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7164c83-260a-40f6-be08-a8140dcdab45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:07:59.828801 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7164c83-260a-40f6-be08-a8140dcdab45 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:07:59.829089 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7164c83-260a-40f6-be08-a8140dcdab45 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:07:59.829367 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7164c83-260a-40f6-be08-a8140dcdab45 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:07:59.839645 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7164c83-260a-40f6-be08-a8140dcdab45 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 18:07:59.847072 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-a7164c83-260a-40f6-be08-a8140dcdab45 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 18:07:59.848258 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 579/1145] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Oct 12 18:07:59 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:07:59.854968 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a986d3ee-0463-4c3e-8942-4ffe0e719867 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:07:59.864376 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a986d3ee-0463-4c3e-8942-4ffe0e719867 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:07:59.868965 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a02dd5-ebbf-4023-93aa-2a8711c4a1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:07:59.869562 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a02dd5-ebbf-4023-93aa-2a8711c4a1dc admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:07:59.869836 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a02dd5-ebbf-4023-93aa-2a8711c4a1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:07:59.870104 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a02dd5-ebbf-4023-93aa-2a8711c4a1dc admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:07:59.870848 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a02dd5-ebbf-4023-93aa-2a8711c4a1dc admin admin] RBAC: Adding query filter params (name=admin) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:07:59.871147 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a02dd5-ebbf-4023-93aa-2a8711c4a1dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:07:59.872769 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a02dd5-ebbf-4023-93aa-2a8711c4a1dc admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:07:59.880974 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 567/1146] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Oct 12 18:07:59 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:07:59.887239 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7164c83-260a-40f6-be08-a8140dcdab45 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:07:59.897679 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7164c83-260a-40f6-be08-a8140dcdab45 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:07:59.902194 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d98a73-0205-46a5-b0a1-f27f42324a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:07:59.902952 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d98a73-0205-46a5-b0a1-f27f42324a37 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:07:59.903232 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d98a73-0205-46a5-b0a1-f27f42324a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:07:59.903500 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d98a73-0205-46a5-b0a1-f27f42324a37 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:07:59.913782 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d98a73-0205-46a5-b0a1-f27f42324a37 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:07:59.915633 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d98a73-0205-46a5-b0a1-f27f42324a37 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:07:59.932254 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-31d98a73-0205-46a5-b0a1-f27f42324a37 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 18:07:59.933409 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 580/1147] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:07:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:07:59.939817 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a02dd5-ebbf-4023-93aa-2a8711c4a1dc admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:07:59.949480 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a02dd5-ebbf-4023-93aa-2a8711c4a1dc admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:07:59.954014 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8215be1-ed64-4911-a094-bd79ed151431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:07:59.954655 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8215be1-ed64-4911-a094-bd79ed151431 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:07:59.954938 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8215be1-ed64-4911-a094-bd79ed151431 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:07:59.955213 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8215be1-ed64-4911-a094-bd79ed151431 admin admin] PATH_INFO: `/v3/domains` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:07:59.955944 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8215be1-ed64-4911-a094-bd79ed151431 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:07:59.956248 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8215be1-ed64-4911-a094-bd79ed151431 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:07:59.957862 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8215be1-ed64-4911-a094-bd79ed151431 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:07:59.969966 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 568/1148] 10.222.0.18 () {56 vars in 1130 bytes} [Tue Oct 12 18:07:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:07:59.976122 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d98a73-0205-46a5-b0a1-f27f42324a37 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:07:59.986173 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d98a73-0205-46a5-b0a1-f27f42324a37 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:07:59.991192 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bf1b8a-a089-47bb-827b-a9e2580bb401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:07:59.991956 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf1b8a-a089-47bb-827b-a9e2580bb401 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:07:59.992233 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf1b8a-a089-47bb-827b-a9e2580bb401 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:07:59.992524 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf1b8a-a089-47bb-827b-a9e2580bb401 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:07:59.999569 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bf1b8a-a089-47bb-827b-a9e2580bb401 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:08:00.001646 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bf1b8a-a089-47bb-827b-a9e2580bb401 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:08:00.016389 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-41bf1b8a-a089-47bb-827b-a9e2580bb401 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 12 18:08:00.018019 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 581/1149] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:07:59 2021] GET /identity/v3/users/placement => generated 87 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 18:08:00.024257 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8215be1-ed64-4911-a094-bd79ed151431 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:08:00.034426 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8215be1-ed64-4911-a094-bd79ed151431 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:08:00.039028 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06480ee3-819a-455a-98aa-0333a966b74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:08:00.039681 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06480ee3-819a-455a-98aa-0333a966b74e admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:08:00.039963 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06480ee3-819a-455a-98aa-0333a966b74e admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:08:00.040361 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06480ee3-819a-455a-98aa-0333a966b74e admin admin] PATH_INFO: `/v3/users` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:08:00.041239 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06480ee3-819a-455a-98aa-0333a966b74e admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:08:00.041548 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06480ee3-819a-455a-98aa-0333a966b74e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:08:00.043381 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06480ee3-819a-455a-98aa-0333a966b74e admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:08:00.061388 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 569/1150] 10.222.0.18 () {56 vars in 1164 bytes} [Tue Oct 12 18:08:00 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:08:00.067798 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bf1b8a-a089-47bb-827b-a9e2580bb401 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:08:00.077420 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bf1b8a-a089-47bb-827b-a9e2580bb401 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:08:00.082072 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb745d1-f793-4b60-8a09-d643b7f5b9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:08:00.082697 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb745d1-f793-4b60-8a09-d643b7f5b9ff admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:08:00.082977 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb745d1-f793-4b60-8a09-d643b7f5b9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:08:00.083250 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb745d1-f793-4b60-8a09-d643b7f5b9ff admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:08:00.090852 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb745d1-f793-4b60-8a09-d643b7f5b9ff admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:08:00.093126 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb745d1-f793-4b60-8a09-d643b7f5b9ff admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:08:00.101840 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 582/1151] 10.222.0.18 () {58 vars in 1324 bytes} [Tue Oct 12 18:08:00 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:08:00.108212 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06480ee3-819a-455a-98aa-0333a966b74e admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:08:00.118434 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06480ee3-819a-455a-98aa-0333a966b74e admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:08:00.123226 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6856460d-a05f-4ece-9676-16105edb622b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:08:00.123977 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6856460d-a05f-4ece-9676-16105edb622b admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:08:00.124254 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6856460d-a05f-4ece-9676-16105edb622b admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:08:00.124561 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6856460d-a05f-4ece-9676-16105edb622b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:08:00.134719 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6856460d-a05f-4ece-9676-16105edb622b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:08:00.136601 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6856460d-a05f-4ece-9676-16105edb622b admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:08:00.154402 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-6856460d-a05f-4ece-9676-16105edb622b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 18:08:00.156132 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 570/1152] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:08:00 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:08:00.162770 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb745d1-f793-4b60-8a09-d643b7f5b9ff admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:08:00.171592 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb745d1-f793-4b60-8a09-d643b7f5b9ff admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:08:00.176296 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35efc68-94d9-447f-b9b3-e44f8c6b7fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:08:00.176973 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35efc68-94d9-447f-b9b3-e44f8c6b7fee admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:08:00.178738 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35efc68-94d9-447f-b9b3-e44f8c6b7fee admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:08:00.178738 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35efc68-94d9-447f-b9b3-e44f8c6b7fee admin admin] PATH_INFO: `/v3/domains` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:08:00.178738 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35efc68-94d9-447f-b9b3-e44f8c6b7fee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:08:00.178738 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35efc68-94d9-447f-b9b3-e44f8c6b7fee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:08:00.180078 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35efc68-94d9-447f-b9b3-e44f8c6b7fee admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:08:00.191207 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 583/1153] 10.222.0.18 () {56 vars in 1130 bytes} [Tue Oct 12 18:08:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:08:00.197427 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6856460d-a05f-4ece-9676-16105edb622b admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:08:00.207508 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6856460d-a05f-4ece-9676-16105edb622b admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:08:00.211926 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570ac722-cd59-4003-a4c5-dd2c82706e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:08:00.212737 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ac722-cd59-4003-a4c5-dd2c82706e7f admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:08:00.213016 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ac722-cd59-4003-a4c5-dd2c82706e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:08:00.213288 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ac722-cd59-4003-a4c5-dd2c82706e7f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:08:00.220552 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570ac722-cd59-4003-a4c5-dd2c82706e7f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:08:00.222497 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570ac722-cd59-4003-a4c5-dd2c82706e7f admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:08:00.235071 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-570ac722-cd59-4003-a4c5-dd2c82706e7f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 18:08:00.236214 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 571/1154] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Oct 12 18:08:00 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 18:08:00.242944 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35efc68-94d9-447f-b9b3-e44f8c6b7fee admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:08:00.253036 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35efc68-94d9-447f-b9b3-e44f8c6b7fee admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:08:00.257578 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95cefdc-4585-4f7b-8926-4d2c2d6004d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:08:00.261484 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95cefdc-4585-4f7b-8926-4d2c2d6004d6 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:08:00.261484 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95cefdc-4585-4f7b-8926-4d2c2d6004d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:08:00.261484 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95cefdc-4585-4f7b-8926-4d2c2d6004d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:08:00.261484 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95cefdc-4585-4f7b-8926-4d2c2d6004d6 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:08:00.261484 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95cefdc-4585-4f7b-8926-4d2c2d6004d6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:08:00.262277 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95cefdc-4585-4f7b-8926-4d2c2d6004d6 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:08:00.276011 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 584/1155] 10.222.0.18 () {56 vars in 1169 bytes} [Tue Oct 12 18:08:00 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:08:00.283351 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570ac722-cd59-4003-a4c5-dd2c82706e7f admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:08:00.293802 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570ac722-cd59-4003-a4c5-dd2c82706e7f admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:08:00.298533 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a664bf-69ef-4ef5-993c-9102c5177c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:08:00.299170 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a664bf-69ef-4ef5-993c-9102c5177c06 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:08:00.299526 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a664bf-69ef-4ef5-993c-9102c5177c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:08:00.299792 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a664bf-69ef-4ef5-993c-9102c5177c06 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:08:00.300750 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a664bf-69ef-4ef5-993c-9102c5177c06 admin admin] RBAC: Adding query filter params (role.id=6c54f239944d46e3b027ccce97eb8b49, scope.project.id=e843aaa9e5e44a8e98f7cc7412d9697b, user.id=4bd99e4f2d444a388ecde7ea3cb61089) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:08:00.301057 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a664bf-69ef-4ef5-993c-9102c5177c06 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:08:00.302999 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a664bf-69ef-4ef5-993c-9102c5177c06 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:08:00.308572 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 572/1156] 10.222.0.18 () {56 vars in 1395 bytes} [Tue Oct 12 18:08:00 2021] GET /identity/v3/role_assignments?user.id=4bd99e4f2d444a388ecde7ea3cb61089&scope.project.id=e843aaa9e5e44a8e98f7cc7412d9697b&role.id=6c54f239944d46e3b027ccce97eb8b49 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:08:02.520947 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5df565-b32d-448f-a323-ca2bb612250b None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:08:02.521480 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5df565-b32d-448f-a323-ca2bb612250b None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:08:02.521480 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5df565-b32d-448f-a323-ca2bb612250b None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:08:02.523228 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 585/1157] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:08:02 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:08:02.529019 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d599e90e-ab69-4fd6-a68e-dc108e5c8863 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:08:02.529459 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d599e90e-ab69-4fd6-a68e-dc108e5c8863 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:08:02.529664 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d599e90e-ab69-4fd6-a68e-dc108e5c8863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:08:02.546911 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-d599e90e-ab69-4fd6-a68e-dc108e5c8863 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:08:02.548083 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-d599e90e-ab69-4fd6-a68e-dc108e5c8863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:08:02.555549 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 573/1158] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:08:02 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:08:02.579041 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5df565-b32d-448f-a323-ca2bb612250b None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:08:02.591076 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5df565-b32d-448f-a323-ca2bb612250b None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:08:02.595643 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb49a30-daca-498c-a0de-58977804efdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:08:02.596426 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb49a30-daca-498c-a0de-58977804efdd admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:08:02.596718 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb49a30-daca-498c-a0de-58977804efdd admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:08:02.596993 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb49a30-daca-498c-a0de-58977804efdd admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:08:02.607062 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb49a30-daca-498c-a0de-58977804efdd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 18:08:02.614463 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-cfb49a30-daca-498c-a0de-58977804efdd admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 18:08:02.615739 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 586/1159] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Oct 12 18:08:02 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:08:02.622368 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d599e90e-ab69-4fd6-a68e-dc108e5c8863 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:08:02.632445 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d599e90e-ab69-4fd6-a68e-dc108e5c8863 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:08:02.636947 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a89d07e-22b0-45be-ade4-ec7d35432b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:08:02.637606 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a89d07e-22b0-45be-ade4-ec7d35432b68 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:08:02.637885 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a89d07e-22b0-45be-ade4-ec7d35432b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:08:02.638391 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a89d07e-22b0-45be-ade4-ec7d35432b68 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:08:02.639200 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a89d07e-22b0-45be-ade4-ec7d35432b68 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:08:02.639503 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a89d07e-22b0-45be-ade4-ec7d35432b68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:08:02.641273 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a89d07e-22b0-45be-ade4-ec7d35432b68 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:08:02.650883 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 574/1160] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Oct 12 18:08:02 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:08:02.657695 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb49a30-daca-498c-a0de-58977804efdd admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:08:02.667600 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb49a30-daca-498c-a0de-58977804efdd admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:08:02.672709 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c97bdac-6011-4601-8509-421ee72d5924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:08:02.673490 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c97bdac-6011-4601-8509-421ee72d5924 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:08:02.673770 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c97bdac-6011-4601-8509-421ee72d5924 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:08:02.674043 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c97bdac-6011-4601-8509-421ee72d5924 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:08:02.684870 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c97bdac-6011-4601-8509-421ee72d5924 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:08:02.687319 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c97bdac-6011-4601-8509-421ee72d5924 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:08:02.703302 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-4c97bdac-6011-4601-8509-421ee72d5924 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 18:08:02.704473 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 587/1161] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:08:02 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:08:02.711182 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a89d07e-22b0-45be-ade4-ec7d35432b68 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:08:02.720910 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a89d07e-22b0-45be-ade4-ec7d35432b68 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:08:02.725574 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d74288-7725-41bd-a74b-7e52673dbc9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:08:02.726225 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d74288-7725-41bd-a74b-7e52673dbc9d admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:08:02.726509 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d74288-7725-41bd-a74b-7e52673dbc9d admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:08:02.726789 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d74288-7725-41bd-a74b-7e52673dbc9d admin admin] PATH_INFO: `/v3/domains` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:08:02.727523 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d74288-7725-41bd-a74b-7e52673dbc9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:08:02.727833 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d74288-7725-41bd-a74b-7e52673dbc9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:08:02.729474 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d74288-7725-41bd-a74b-7e52673dbc9d admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:08:02.741750 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 575/1162] 10.222.0.18 () {56 vars in 1130 bytes} [Tue Oct 12 18:08:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:08:02.747938 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c97bdac-6011-4601-8509-421ee72d5924 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:08:02.758003 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c97bdac-6011-4601-8509-421ee72d5924 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:08:02.765817 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578cef7a-bdeb-485a-a034-60dcad27058d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:08:02.765817 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578cef7a-bdeb-485a-a034-60dcad27058d admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:08:02.765817 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578cef7a-bdeb-485a-a034-60dcad27058d admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:08:02.765817 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578cef7a-bdeb-485a-a034-60dcad27058d admin admin] PATH_INFO: `/v3/users/placement` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:08:02.772879 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578cef7a-bdeb-485a-a034-60dcad27058d admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:08:02.774858 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578cef7a-bdeb-485a-a034-60dcad27058d admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:08:02.788831 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-578cef7a-bdeb-485a-a034-60dcad27058d admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 12 18:08:02.790007 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 588/1163] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:08:02 2021] GET /identity/v3/users/placement => generated 87 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:08:02.798814 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d74288-7725-41bd-a74b-7e52673dbc9d admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:08:02.810418 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d74288-7725-41bd-a74b-7e52673dbc9d admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:08:02.816179 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8690b757-8d84-4530-9ce8-27eb66391318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:08:02.816896 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8690b757-8d84-4530-9ce8-27eb66391318 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:08:02.817173 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8690b757-8d84-4530-9ce8-27eb66391318 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:08:02.817444 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8690b757-8d84-4530-9ce8-27eb66391318 admin admin] PATH_INFO: `/v3/users` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:08:02.818288 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8690b757-8d84-4530-9ce8-27eb66391318 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:08:02.818597 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8690b757-8d84-4530-9ce8-27eb66391318 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:08:02.820469 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8690b757-8d84-4530-9ce8-27eb66391318 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:08:02.838329 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 576/1164] 10.222.0.18 () {56 vars in 1164 bytes} [Tue Oct 12 18:08:02 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:08:02.844882 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578cef7a-bdeb-485a-a034-60dcad27058d admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:08:02.854444 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578cef7a-bdeb-485a-a034-60dcad27058d admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:08:02.859187 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f992a3-783a-4c9d-9ecd-dc83008e29e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:08:02.859960 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f992a3-783a-4c9d-9ecd-dc83008e29e7 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:08:02.867030 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f992a3-783a-4c9d-9ecd-dc83008e29e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:08:02.867030 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f992a3-783a-4c9d-9ecd-dc83008e29e7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:08:02.871724 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f992a3-783a-4c9d-9ecd-dc83008e29e7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:08:02.874116 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f992a3-783a-4c9d-9ecd-dc83008e29e7 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:08:02.894023 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-33f992a3-783a-4c9d-9ecd-dc83008e29e7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 18:08:02.895224 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 589/1165] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:08:02 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:08:02.901887 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8690b757-8d84-4530-9ce8-27eb66391318 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:08:02.911608 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8690b757-8d84-4530-9ce8-27eb66391318 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:08:02.916206 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64104707-edc8-4071-b441-5f3e16299e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:08:02.916910 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64104707-edc8-4071-b441-5f3e16299e68 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:08:02.917194 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64104707-edc8-4071-b441-5f3e16299e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:08:02.917471 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64104707-edc8-4071-b441-5f3e16299e68 admin admin] PATH_INFO: `/v3/domains` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:08:02.918271 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64104707-edc8-4071-b441-5f3e16299e68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:08:02.918578 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64104707-edc8-4071-b441-5f3e16299e68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:08:02.920166 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64104707-edc8-4071-b441-5f3e16299e68 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:08:02.931410 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 577/1166] 10.222.0.18 () {56 vars in 1130 bytes} [Tue Oct 12 18:08:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:08:02.938209 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f992a3-783a-4c9d-9ecd-dc83008e29e7 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:08:02.948015 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f992a3-783a-4c9d-9ecd-dc83008e29e7 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:08:02.953288 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5af9ae3-351e-4663-b3d9-000ccd9a0e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:08:02.954093 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af9ae3-351e-4663-b3d9-000ccd9a0e6f admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:08:02.954356 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af9ae3-351e-4663-b3d9-000ccd9a0e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:08:02.954632 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af9ae3-351e-4663-b3d9-000ccd9a0e6f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:08:02.961680 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5af9ae3-351e-4663-b3d9-000ccd9a0e6f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:08:02.963706 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5af9ae3-351e-4663-b3d9-000ccd9a0e6f admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:08:02.977369 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-c5af9ae3-351e-4663-b3d9-000ccd9a0e6f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 18:08:02.978513 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 590/1167] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Oct 12 18:08:02 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:08:02.985124 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64104707-edc8-4071-b441-5f3e16299e68 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:08:02.994830 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64104707-edc8-4071-b441-5f3e16299e68 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:08:03.016156 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeb2c51-a8f9-4478-badb-6bf88b7e0c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:08:03.016156 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb2c51-a8f9-4478-badb-6bf88b7e0c7a admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:08:03.016156 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb2c51-a8f9-4478-badb-6bf88b7e0c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:08:03.016156 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb2c51-a8f9-4478-badb-6bf88b7e0c7a admin admin] PATH_INFO: `/v3/projects` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:08:03.016583 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeb2c51-a8f9-4478-badb-6bf88b7e0c7a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:08:03.016583 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeb2c51-a8f9-4478-badb-6bf88b7e0c7a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:08:03.016583 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeb2c51-a8f9-4478-badb-6bf88b7e0c7a admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:08:03.016805 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 578/1168] 10.222.0.18 () {56 vars in 1169 bytes} [Tue Oct 12 18:08:02 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:08:03.023649 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5af9ae3-351e-4663-b3d9-000ccd9a0e6f admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:08:03.033861 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5af9ae3-351e-4663-b3d9-000ccd9a0e6f admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:08:03.038499 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ffabb9-87ad-4ac7-9af8-7760e41b6c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:08:03.039467 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ffabb9-87ad-4ac7-9af8-7760e41b6c98 admin admin] REQUEST_METHOD: `PUT` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:08:03.039746 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ffabb9-87ad-4ac7-9af8-7760e41b6c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:08:03.040025 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ffabb9-87ad-4ac7-9af8-7760e41b6c98 admin admin] PATH_INFO: `/v3/projects/e843aaa9e5e44a8e98f7cc7412d9697b/users/4bd99e4f2d444a388ecde7ea3cb61089/roles/6c54f239944d46e3b027ccce97eb8b49` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:08:03.042031 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ffabb9-87ad-4ac7-9af8-7760e41b6c98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e843aaa9e5e44a8e98f7cc7412d9697b, user_id=4bd99e4f2d444a388ecde7ea3cb61089, role_id=6c54f239944d46e3b027ccce97eb8b49)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:08:03.044793 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ffabb9-87ad-4ac7-9af8-7760e41b6c98 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:08:03.325854 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 591/1169] 10.222.0.18 () {58 vars in 1460 bytes} [Tue Oct 12 18:08:03 2021] PUT /identity/v3/projects/e843aaa9e5e44a8e98f7cc7412d9697b/users/4bd99e4f2d444a388ecde7ea3cb61089/roles/6c54f239944d46e3b027ccce97eb8b49 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:08:05.559140 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58087d1a-6850-497c-95d1-61ad04f083a0 None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:08:05.559686 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58087d1a-6850-497c-95d1-61ad04f083a0 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:08:05.559686 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58087d1a-6850-497c-95d1-61ad04f083a0 None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:08:05.561516 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 579/1170] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:08:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:08:05.567541 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69125eed-5313-4443-a082-15bb40885967 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:08:05.567952 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69125eed-5313-4443-a082-15bb40885967 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:08:05.568113 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69125eed-5313-4443-a082-15bb40885967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:08:05.586214 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-69125eed-5313-4443-a082-15bb40885967 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:08:05.587461 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-69125eed-5313-4443-a082-15bb40885967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:08:05.644417 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 592/1171] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:08:05 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:08:05.669654 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58087d1a-6850-497c-95d1-61ad04f083a0 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:08:05.681536 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58087d1a-6850-497c-95d1-61ad04f083a0 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:08:05.686022 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e081d9-7d23-4675-9bcd-3d1f1366afbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:08:05.686791 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e081d9-7d23-4675-9bcd-3d1f1366afbf admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:08:05.687068 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e081d9-7d23-4675-9bcd-3d1f1366afbf admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:08:05.687339 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e081d9-7d23-4675-9bcd-3d1f1366afbf admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:08:05.697647 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e081d9-7d23-4675-9bcd-3d1f1366afbf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 18:08:05.705178 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-83e081d9-7d23-4675-9bcd-3d1f1366afbf admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 18:08:05.706307 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 580/1172] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Oct 12 18:08:05 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:08:05.712967 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69125eed-5313-4443-a082-15bb40885967 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:08:05.722536 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69125eed-5313-4443-a082-15bb40885967 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:08:05.727148 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390f88b4-68f1-456c-bb98-df493c9f61f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:08:05.727790 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f88b4-68f1-456c-bb98-df493c9f61f0 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:08:05.728117 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f88b4-68f1-456c-bb98-df493c9f61f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:08:05.728462 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f88b4-68f1-456c-bb98-df493c9f61f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:08:05.729213 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390f88b4-68f1-456c-bb98-df493c9f61f0 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:08:05.729527 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390f88b4-68f1-456c-bb98-df493c9f61f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:08:05.731130 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390f88b4-68f1-456c-bb98-df493c9f61f0 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:08:05.739295 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 593/1173] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Oct 12 18:08:05 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:08:05.745662 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e081d9-7d23-4675-9bcd-3d1f1366afbf admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:08:05.755779 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e081d9-7d23-4675-9bcd-3d1f1366afbf admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:08:05.760341 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d1a53b-f6b1-46d9-b744-a68aded409b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:08:05.761125 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1a53b-f6b1-46d9-b744-a68aded409b1 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:08:05.761401 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1a53b-f6b1-46d9-b744-a68aded409b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:08:05.764644 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1a53b-f6b1-46d9-b744-a68aded409b1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:08:05.772571 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d1a53b-f6b1-46d9-b744-a68aded409b1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:08:05.774381 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d1a53b-f6b1-46d9-b744-a68aded409b1 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:08:05.791185 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-d5d1a53b-f6b1-46d9-b744-a68aded409b1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 18:08:05.792321 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 581/1174] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:08:05 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 18:08:05.798838 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390f88b4-68f1-456c-bb98-df493c9f61f0 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:08:05.808499 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390f88b4-68f1-456c-bb98-df493c9f61f0 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:08:05.813733 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b359c00-be01-4fe5-b88e-6763ad1b0a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:08:05.814314 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b359c00-be01-4fe5-b88e-6763ad1b0a10 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:08:05.814596 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b359c00-be01-4fe5-b88e-6763ad1b0a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:08:05.814874 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b359c00-be01-4fe5-b88e-6763ad1b0a10 admin admin] PATH_INFO: `/v3/domains` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:08:05.815597 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b359c00-be01-4fe5-b88e-6763ad1b0a10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:08:05.815903 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b359c00-be01-4fe5-b88e-6763ad1b0a10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:08:05.817666 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b359c00-be01-4fe5-b88e-6763ad1b0a10 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:08:05.830945 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 594/1175] 10.222.0.18 () {56 vars in 1130 bytes} [Tue Oct 12 18:08:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:08:05.840050 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d1a53b-f6b1-46d9-b744-a68aded409b1 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:08:05.854105 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d1a53b-f6b1-46d9-b744-a68aded409b1 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:08:05.858632 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808a42f3-1b8d-49cc-94d0-fb1c6a340239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:08:05.859405 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a42f3-1b8d-49cc-94d0-fb1c6a340239 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:08:05.859684 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a42f3-1b8d-49cc-94d0-fb1c6a340239 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:08:05.867959 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a42f3-1b8d-49cc-94d0-fb1c6a340239 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:08:05.867959 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808a42f3-1b8d-49cc-94d0-fb1c6a340239 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:08:05.869113 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808a42f3-1b8d-49cc-94d0-fb1c6a340239 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:08:05.883198 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-808a42f3-1b8d-49cc-94d0-fb1c6a340239 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 12 18:08:05.884341 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 582/1176] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:08:05 2021] GET /identity/v3/users/placement => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:08:05.891419 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b359c00-be01-4fe5-b88e-6763ad1b0a10 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:08:05.901365 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b359c00-be01-4fe5-b88e-6763ad1b0a10 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:08:05.905910 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e43e25-39ee-4667-a8a8-830f018cb375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:08:05.906563 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e43e25-39ee-4667-a8a8-830f018cb375 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:08:05.906849 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e43e25-39ee-4667-a8a8-830f018cb375 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:08:05.907129 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e43e25-39ee-4667-a8a8-830f018cb375 admin admin] PATH_INFO: `/v3/users` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:08:05.908563 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e43e25-39ee-4667-a8a8-830f018cb375 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:08:05.909132 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e43e25-39ee-4667-a8a8-830f018cb375 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:08:05.911535 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e43e25-39ee-4667-a8a8-830f018cb375 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:08:05.931169 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 595/1177] 10.222.0.18 () {56 vars in 1164 bytes} [Tue Oct 12 18:08:05 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:08:05.938242 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808a42f3-1b8d-49cc-94d0-fb1c6a340239 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:08:05.947857 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808a42f3-1b8d-49cc-94d0-fb1c6a340239 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:08:05.952921 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a4a0a0-740c-4610-ad51-f264cca01861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:08:05.953540 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a4a0a0-740c-4610-ad51-f264cca01861 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:08:05.953817 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a4a0a0-740c-4610-ad51-f264cca01861 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:08:05.954085 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a4a0a0-740c-4610-ad51-f264cca01861 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:08:05.961567 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a4a0a0-740c-4610-ad51-f264cca01861 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:08:05.963287 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a4a0a0-740c-4610-ad51-f264cca01861 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:08:05.971921 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 583/1178] 10.222.0.18 () {58 vars in 1324 bytes} [Tue Oct 12 18:08:05 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:08:05.978259 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e43e25-39ee-4667-a8a8-830f018cb375 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:08:05.987778 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e43e25-39ee-4667-a8a8-830f018cb375 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:08:05.992275 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3851c955-4fa5-43f8-ae40-4321504f0093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:08:05.993074 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851c955-4fa5-43f8-ae40-4321504f0093 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:08:05.993358 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851c955-4fa5-43f8-ae40-4321504f0093 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:08:05.993635 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851c955-4fa5-43f8-ae40-4321504f0093 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:08:06.004110 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3851c955-4fa5-43f8-ae40-4321504f0093 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:08:06.005990 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3851c955-4fa5-43f8-ae40-4321504f0093 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:08:06.022617 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-3851c955-4fa5-43f8-ae40-4321504f0093 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 18:08:06.023761 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 596/1179] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 12 18:08:05 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:08:06.030702 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a4a0a0-740c-4610-ad51-f264cca01861 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:08:06.039498 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a4a0a0-740c-4610-ad51-f264cca01861 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:08:06.043956 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba157d1c-f551-4c6b-a935-b4e32e179f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:08:06.044728 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba157d1c-f551-4c6b-a935-b4e32e179f2f admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:08:06.044974 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba157d1c-f551-4c6b-a935-b4e32e179f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:08:06.045792 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba157d1c-f551-4c6b-a935-b4e32e179f2f admin admin] PATH_INFO: `/v3/domains` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:08:06.046520 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba157d1c-f551-4c6b-a935-b4e32e179f2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:08:06.046833 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba157d1c-f551-4c6b-a935-b4e32e179f2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:08:06.048381 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba157d1c-f551-4c6b-a935-b4e32e179f2f admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:08:06.060955 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 584/1180] 10.222.0.18 () {56 vars in 1130 bytes} [Tue Oct 12 18:08:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:08:06.067209 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3851c955-4fa5-43f8-ae40-4321504f0093 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:08:06.076763 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3851c955-4fa5-43f8-ae40-4321504f0093 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:08:06.081410 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b8f411-a4bb-4850-b796-62edbe1e0fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:08:06.082176 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b8f411-a4bb-4850-b796-62edbe1e0fe3 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:08:06.082458 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b8f411-a4bb-4850-b796-62edbe1e0fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:08:06.082733 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b8f411-a4bb-4850-b796-62edbe1e0fe3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:08:06.089386 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b8f411-a4bb-4850-b796-62edbe1e0fe3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:08:06.091333 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b8f411-a4bb-4850-b796-62edbe1e0fe3 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:08:06.104592 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING keystone.server.flask.application [None req-35b8f411-a4bb-4850-b796-62edbe1e0fe3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 18:08:06.105707 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 597/1181] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Oct 12 18:08:06 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:08:06.112528 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba157d1c-f551-4c6b-a935-b4e32e179f2f admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:08:06.121932 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba157d1c-f551-4c6b-a935-b4e32e179f2f admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:08:06.126442 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd061a20-306e-4ffd-9c06-3b05e8c30706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:08:06.127068 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd061a20-306e-4ffd-9c06-3b05e8c30706 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:08:06.127345 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd061a20-306e-4ffd-9c06-3b05e8c30706 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:08:06.127612 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd061a20-306e-4ffd-9c06-3b05e8c30706 admin admin] PATH_INFO: `/v3/projects` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:08:06.128388 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd061a20-306e-4ffd-9c06-3b05e8c30706 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:08:06.128720 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd061a20-306e-4ffd-9c06-3b05e8c30706 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:08:06.130576 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd061a20-306e-4ffd-9c06-3b05e8c30706 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:08:06.144197 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 585/1182] 10.222.0.18 () {56 vars in 1169 bytes} [Tue Oct 12 18:08:06 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:08:06.150614 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b8f411-a4bb-4850-b796-62edbe1e0fe3 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:08:06.161753 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b8f411-a4bb-4850-b796-62edbe1e0fe3 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:08:06.166283 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d1f851-035f-4ec0-b597-5806aa77e8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:08:06.166901 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d1f851-035f-4ec0-b597-5806aa77e8a9 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:08:06.167178 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d1f851-035f-4ec0-b597-5806aa77e8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:08:06.167447 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d1f851-035f-4ec0-b597-5806aa77e8a9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:08:06.168294 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d1f851-035f-4ec0-b597-5806aa77e8a9 admin admin] RBAC: Adding query filter params (role.id=6c54f239944d46e3b027ccce97eb8b49, scope.project.id=e843aaa9e5e44a8e98f7cc7412d9697b, user.id=4bd99e4f2d444a388ecde7ea3cb61089) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:08:06.168632 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d1f851-035f-4ec0-b597-5806aa77e8a9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:08:06.170543 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d1f851-035f-4ec0-b597-5806aa77e8a9 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:08:06.176484 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 598/1183] 10.222.0.18 () {56 vars in 1395 bytes} [Tue Oct 12 18:08:06 2021] GET /identity/v3/role_assignments?user.id=4bd99e4f2d444a388ecde7ea3cb61089&scope.project.id=e843aaa9e5e44a8e98f7cc7412d9697b&role.id=6c54f239944d46e3b027ccce97eb8b49 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:08:08.435130 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95603752-735d-45d2-9e77-124824ac55b7 None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:08:08.435684 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95603752-735d-45d2-9e77-124824ac55b7 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:08:08.435780 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95603752-735d-45d2-9e77-124824ac55b7 None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:08:08.437502 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 586/1184] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:08:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:08:08.443324 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8549ecf1-b950-47c6-a3af-24ae14e7ea24 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:08:08.443696 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8549ecf1-b950-47c6-a3af-24ae14e7ea24 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:08:08.443958 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8549ecf1-b950-47c6-a3af-24ae14e7ea24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:08:08.462396 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-8549ecf1-b950-47c6-a3af-24ae14e7ea24 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:08:08.463592 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-8549ecf1-b950-47c6-a3af-24ae14e7ea24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:08:08.471882 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 599/1185] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:08:08 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:08:08.495023 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95603752-735d-45d2-9e77-124824ac55b7 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:08:08.507172 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95603752-735d-45d2-9e77-124824ac55b7 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:08:08.511614 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c582772a-3e7b-4b49-9380-a9eedbb61e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:08:08.512391 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c582772a-3e7b-4b49-9380-a9eedbb61e71 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:08:08.512695 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c582772a-3e7b-4b49-9380-a9eedbb61e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:08:08.512963 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c582772a-3e7b-4b49-9380-a9eedbb61e71 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:08:08.513619 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c582772a-3e7b-4b49-9380-a9eedbb61e71 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:08:08.515716 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c582772a-3e7b-4b49-9380-a9eedbb61e71 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:08:08.526828 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-c582772a-3e7b-4b49-9380-a9eedbb61e71 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 12 18:08:08.527937 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 587/1186] 10.222.0.18 () {56 vars in 1138 bytes} [Tue Oct 12 18:08:08 2021] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:08:08.535088 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8549ecf1-b950-47c6-a3af-24ae14e7ea24 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:08:08.545603 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8549ecf1-b950-47c6-a3af-24ae14e7ea24 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:08:08.550223 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab4900-2a95-4d20-b4ef-88a069c0c2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:08:08.558978 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab4900-2a95-4d20-b4ef-88a069c0c2b9 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:08:08.558978 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab4900-2a95-4d20-b4ef-88a069c0c2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:08:08.558978 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab4900-2a95-4d20-b4ef-88a069c0c2b9 admin admin] PATH_INFO: `/v3/services` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:08:08.558978 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cab4900-2a95-4d20-b4ef-88a069c0c2b9 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:08:08.558978 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cab4900-2a95-4d20-b4ef-88a069c0c2b9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:08:08.558978 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cab4900-2a95-4d20-b4ef-88a069c0c2b9 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:08:08.559602 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 600/1187] 10.222.0.18 () {56 vars in 1137 bytes} [Tue Oct 12 18:08:08 2021] GET /identity/v3/services?name=placement => generated 126 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:08:08.565306 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c582772a-3e7b-4b49-9380-a9eedbb61e71 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:08:08.574770 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c582772a-3e7b-4b49-9380-a9eedbb61e71 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:08:08.579898 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d09c74-34a5-48a7-96af-0ccea6487e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:08:08.580576 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d09c74-34a5-48a7-96af-0ccea6487e06 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:08:08.580860 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d09c74-34a5-48a7-96af-0ccea6487e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:08:08.581133 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d09c74-34a5-48a7-96af-0ccea6487e06 admin admin] PATH_INFO: `/v3/services` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:08:08.581843 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d09c74-34a5-48a7-96af-0ccea6487e06 admin admin] RBAC: Adding query filter params (type=placement) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:08:08.582146 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d09c74-34a5-48a7-96af-0ccea6487e06 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:08:08.583710 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d09c74-34a5-48a7-96af-0ccea6487e06 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:08:08.588280 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 588/1188] 10.222.0.18 () {56 vars in 1137 bytes} [Tue Oct 12 18:08:08 2021] GET /identity/v3/services?type=placement => generated 126 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:08:10.842842 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb86741a-4116-48f1-9ca8-501cad9894a8 None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:08:10.843402 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb86741a-4116-48f1-9ca8-501cad9894a8 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:08:10.843402 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb86741a-4116-48f1-9ca8-501cad9894a8 None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:08:10.845224 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 601/1189] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:08:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:08:10.851136 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd96e277-9282-4925-99e5-f4733d396a7e None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:08:10.851561 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd96e277-9282-4925-99e5-f4733d396a7e None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:08:10.851683 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd96e277-9282-4925-99e5-f4733d396a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:08:10.869671 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-cd96e277-9282-4925-99e5-f4733d396a7e None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:08:10.870785 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-cd96e277-9282-4925-99e5-f4733d396a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:08:10.879779 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 589/1190] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:08:10 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:08:10.904057 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb86741a-4116-48f1-9ca8-501cad9894a8 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:08:10.916144 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb86741a-4116-48f1-9ca8-501cad9894a8 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:08:10.921048 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89227bb9-0732-465b-a27a-71117dd76195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:08:10.921693 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89227bb9-0732-465b-a27a-71117dd76195 admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:08:10.921974 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89227bb9-0732-465b-a27a-71117dd76195 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:08:10.922249 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89227bb9-0732-465b-a27a-71117dd76195 admin admin] PATH_INFO: `/v3/services` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:08:10.928255 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89227bb9-0732-465b-a27a-71117dd76195 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:08:10.928255 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89227bb9-0732-465b-a27a-71117dd76195 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:08:11.023792 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 602/1191] 10.222.0.18 () {60 vars in 1162 bytes} [Tue Oct 12 18:08:10 2021] POST /identity/v3/services => generated 246 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:08:13.272964 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d907fc3a-b46f-42d0-87e1-22b219f0d29c None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:08:13.273551 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d907fc3a-b46f-42d0-87e1-22b219f0d29c None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:08:13.273551 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d907fc3a-b46f-42d0-87e1-22b219f0d29c None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:08:13.275253 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 590/1192] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:08:13 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:08:13.281848 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe63839f-77e7-4774-bd76-cc30870457d5 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:08:13.282292 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe63839f-77e7-4774-bd76-cc30870457d5 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:08:13.282394 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe63839f-77e7-4774-bd76-cc30870457d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:08:13.300602 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-fe63839f-77e7-4774-bd76-cc30870457d5 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:08:13.301788 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-fe63839f-77e7-4774-bd76-cc30870457d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:08:13.318977 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 603/1193] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:08:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:08:13.343314 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d907fc3a-b46f-42d0-87e1-22b219f0d29c None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:08:13.355383 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d907fc3a-b46f-42d0-87e1-22b219f0d29c None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:08:13.360487 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc386a36-71bb-4ac9-aa62-960b6eb6affb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:08:13.361263 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc386a36-71bb-4ac9-aa62-960b6eb6affb admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:08:13.361539 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc386a36-71bb-4ac9-aa62-960b6eb6affb admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:08:13.361809 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc386a36-71bb-4ac9-aa62-960b6eb6affb admin admin] PATH_INFO: `/v3/services/placement` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:08:13.362476 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc386a36-71bb-4ac9-aa62-960b6eb6affb admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:08:13.364054 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc386a36-71bb-4ac9-aa62-960b6eb6affb admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:08:13.374911 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-fc386a36-71bb-4ac9-aa62-960b6eb6affb admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 12 18:08:13.376114 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 591/1194] 10.222.0.18 () {56 vars in 1138 bytes} [Tue Oct 12 18:08:13 2021] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:08:13.383363 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe63839f-77e7-4774-bd76-cc30870457d5 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:08:13.393132 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe63839f-77e7-4774-bd76-cc30870457d5 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:08:13.397843 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cbe2ff-69f6-4319-a758-846a4fa8a79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:08:13.398494 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cbe2ff-69f6-4319-a758-846a4fa8a79b admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:08:13.398770 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cbe2ff-69f6-4319-a758-846a4fa8a79b admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:08:13.399039 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cbe2ff-69f6-4319-a758-846a4fa8a79b admin admin] PATH_INFO: `/v3/services` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:08:13.409994 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cbe2ff-69f6-4319-a758-846a4fa8a79b admin admin] RBAC: Adding query filter params (name=placement) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:08:13.409994 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cbe2ff-69f6-4319-a758-846a4fa8a79b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:08:13.409994 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cbe2ff-69f6-4319-a758-846a4fa8a79b admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:08:13.409994 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 604/1195] 10.222.0.18 () {56 vars in 1137 bytes} [Tue Oct 12 18:08:13 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:08:13.414087 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc386a36-71bb-4ac9-aa62-960b6eb6affb admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:08:13.424312 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc386a36-71bb-4ac9-aa62-960b6eb6affb admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:08:13.428972 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d3bbbc-0344-4746-9167-4a27d787ded7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:08:13.429618 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3bbbc-0344-4746-9167-4a27d787ded7 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:08:13.429898 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3bbbc-0344-4746-9167-4a27d787ded7 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:08:13.430171 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3bbbc-0344-4746-9167-4a27d787ded7 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:08:13.430967 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d3bbbc-0344-4746-9167-4a27d787ded7 admin admin] RBAC: Adding query filter params (interface=public, service_id=da1cebcf0f60496fa54b9b81d3217190, region_id=RegionOne) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:08:13.431322 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d3bbbc-0344-4746-9167-4a27d787ded7 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:08:13.432920 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d3bbbc-0344-4746-9167-4a27d787ded7 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:08:13.438063 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 592/1196] 10.222.0.18 () {56 vars in 1272 bytes} [Tue Oct 12 18:08:13 2021] GET /identity/v3/endpoints?service_id=da1cebcf0f60496fa54b9b81d3217190&interface=public®ion_id=RegionOne => generated 194 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:08:13.444743 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cbe2ff-69f6-4319-a758-846a4fa8a79b admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:08:13.454633 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cbe2ff-69f6-4319-a758-846a4fa8a79b admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:08:13.461523 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4265747-b5c0-421b-9d90-1c8112a510db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:08:13.462193 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4265747-b5c0-421b-9d90-1c8112a510db admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:08:13.462508 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4265747-b5c0-421b-9d90-1c8112a510db admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:08:13.462781 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4265747-b5c0-421b-9d90-1c8112a510db admin admin] PATH_INFO: `/v3/services` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:08:13.463469 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4265747-b5c0-421b-9d90-1c8112a510db admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:08:13.465140 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4265747-b5c0-421b-9d90-1c8112a510db admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:08:13.474855 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 605/1197] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 12 18:08:13 2021] GET /identity/v3/services => generated 2191 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:08:15.768804 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166814c-1b16-4500-bc5c-a77fd0e856ff None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:08:15.769330 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166814c-1b16-4500-bc5c-a77fd0e856ff None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:08:15.769330 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166814c-1b16-4500-bc5c-a77fd0e856ff None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:08:15.771072 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 593/1198] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:08:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 18:08:15.777033 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f453bba-875f-4386-a223-1d2f45378d83 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:08:15.777462 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f453bba-875f-4386-a223-1d2f45378d83 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:08:15.777875 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f453bba-875f-4386-a223-1d2f45378d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:08:15.794929 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-4f453bba-875f-4386-a223-1d2f45378d83 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:08:15.796089 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-4f453bba-875f-4386-a223-1d2f45378d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:08:15.803855 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 606/1199] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:08:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:08:15.828621 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9166814c-1b16-4500-bc5c-a77fd0e856ff None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:08:15.840793 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9166814c-1b16-4500-bc5c-a77fd0e856ff None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:08:15.845349 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b390705-0413-4a4a-9714-5c1ef7e2a9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:08:15.846138 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b390705-0413-4a4a-9714-5c1ef7e2a9e9 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:08:15.846489 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b390705-0413-4a4a-9714-5c1ef7e2a9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:08:15.846676 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b390705-0413-4a4a-9714-5c1ef7e2a9e9 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:08:15.847337 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b390705-0413-4a4a-9714-5c1ef7e2a9e9 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:08:15.849962 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b390705-0413-4a4a-9714-5c1ef7e2a9e9 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:08:15.860047 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING keystone.server.flask.application [None req-0b390705-0413-4a4a-9714-5c1ef7e2a9e9 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 12 18:08:15.861210 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 594/1200] 10.222.0.18 () {56 vars in 1138 bytes} [Tue Oct 12 18:08:15 2021] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 18:08:15.868043 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f453bba-875f-4386-a223-1d2f45378d83 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:08:15.877311 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f453bba-875f-4386-a223-1d2f45378d83 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:08:15.881837 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e11e3b-286b-4c96-be91-816e149943d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:08:15.882482 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e11e3b-286b-4c96-be91-816e149943d9 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:08:15.882758 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e11e3b-286b-4c96-be91-816e149943d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:08:15.883025 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e11e3b-286b-4c96-be91-816e149943d9 admin admin] PATH_INFO: `/v3/services` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:08:15.883730 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e11e3b-286b-4c96-be91-816e149943d9 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:08:15.884055 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e11e3b-286b-4c96-be91-816e149943d9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:08:15.885747 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e11e3b-286b-4c96-be91-816e149943d9 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:08:15.890836 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 607/1201] 10.222.0.18 () {56 vars in 1137 bytes} [Tue Oct 12 18:08:15 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:08:15.897955 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b390705-0413-4a4a-9714-5c1ef7e2a9e9 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:08:15.907663 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b390705-0413-4a4a-9714-5c1ef7e2a9e9 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:08:15.912599 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27e562b-90f6-43fd-b885-68d5d6c21904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:08:15.913245 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e562b-90f6-43fd-b885-68d5d6c21904 admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:08:15.913523 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e562b-90f6-43fd-b885-68d5d6c21904 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:08:15.913793 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e562b-90f6-43fd-b885-68d5d6c21904 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:08:15.914541 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27e562b-90f6-43fd-b885-68d5d6c21904 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:08:15.916161 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27e562b-90f6-43fd-b885-68d5d6c21904 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:08:16.013656 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 595/1202] 10.222.0.18 () {60 vars in 1165 bytes} [Tue Oct 12 18:08:15 2021] POST /identity/v3/endpoints => generated 331 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:17:07.906491 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e030c4-6cec-46f6-8e0c-7aceed2eb459 None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:17:07.906983 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e030c4-6cec-46f6-8e0c-7aceed2eb459 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:17:07.907210 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e030c4-6cec-46f6-8e0c-7aceed2eb459 None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:17:07.923351 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 608/1203] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:17:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:17:07.923913 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f04e312-6e4a-49b3-95ee-5b8584c9f05c None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:17:07.923913 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f04e312-6e4a-49b3-95ee-5b8584c9f05c None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:17:07.923913 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f04e312-6e4a-49b3-95ee-5b8584c9f05c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:17:08.092256 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-1f04e312-6e4a-49b3-95ee-5b8584c9f05c None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:17:08.100804 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-1f04e312-6e4a-49b3-95ee-5b8584c9f05c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:17:08.262978 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 596/1204] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:17:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:17:08.287589 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e030c4-6cec-46f6-8e0c-7aceed2eb459 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:17:08.289719 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-37e030c4-6cec-46f6-8e0c-7aceed2eb459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:17:08.438968 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e030c4-6cec-46f6-8e0c-7aceed2eb459 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:17:08.536519 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eec2fb-ff3f-498a-8a6d-edbbaded8cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:17:08.537191 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eec2fb-ff3f-498a-8a6d-edbbaded8cde admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:17:08.537473 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eec2fb-ff3f-498a-8a6d-edbbaded8cde admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:17:08.537746 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eec2fb-ff3f-498a-8a6d-edbbaded8cde admin admin] PATH_INFO: `/v3/projects` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:17:08.538486 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eec2fb-ff3f-498a-8a6d-edbbaded8cde admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:17:08.540345 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eec2fb-ff3f-498a-8a6d-edbbaded8cde admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:17:08.568453 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 609/1205] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 12 18:17:08 2021] GET /identity/v3/projects => generated 2553 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:17:10.923713 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d30bb1-1ded-47e7-9226-b5d7e30aa06f None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:17:10.924230 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d30bb1-1ded-47e7-9226-b5d7e30aa06f None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:17:10.924230 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d30bb1-1ded-47e7-9226-b5d7e30aa06f None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:17:10.925955 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 597/1206] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:17:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:17:10.932028 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d1676-c521-49e4-b248-e726e402d14e None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:17:10.932474 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d1676-c521-49e4-b248-e726e402d14e None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:17:10.932624 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d1676-c521-49e4-b248-e726e402d14e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:17:11.000244 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-483d1676-c521-49e4-b248-e726e402d14e None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:17:11.001478 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-483d1676-c521-49e4-b248-e726e402d14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:17:11.098879 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 610/1207] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:17:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:17:11.153318 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53f9b5-9885-458a-ab04-8ba761e526e9 None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:17:11.153602 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53f9b5-9885-458a-ab04-8ba761e526e9 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:17:11.153879 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53f9b5-9885-458a-ab04-8ba761e526e9 None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:17:11.155672 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 598/1208] 10.222.0.18 () {54 vars in 963 bytes} [Tue Oct 12 18:17:11 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:17:11.162142 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59450953-2ade-411e-80c1-3b218e6d9bc2 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:17:11.162436 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59450953-2ade-411e-80c1-3b218e6d9bc2 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:17:11.162715 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59450953-2ade-411e-80c1-3b218e6d9bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:17:11.241382 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-59450953-2ade-411e-80c1-3b218e6d9bc2 None None] MFA Rules not processed for user `9a1ea6f47a7c41aba102ad481f5ad5c8`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:17:11.242538 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-59450953-2ade-411e-80c1-3b218e6d9bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:17:11.318483 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 611/1209] 10.222.0.18 () {58 vars in 1060 bytes} [Tue Oct 12 18:17:11 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:17:11.328416 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b53f9b5-9885-458a-ab04-8ba761e526e9 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:17:11.329929 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-5b53f9b5-9885-458a-ab04-8ba761e526e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:17:11.427702 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b53f9b5-9885-458a-ab04-8ba761e526e9 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:17:11.506549 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92a0820-989f-4c43-b34e-588067291d3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:17:11.507104 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a0820-989f-4c43-b34e-588067291d3c service neutron] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:17:11.507382 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a0820-989f-4c43-b34e-588067291d3c service neutron] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:17:11.507651 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a0820-989f-4c43-b34e-588067291d3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:17:11.509384 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-b92a0820-989f-4c43-b34e-588067291d3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:17:11.624375 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92a0820-989f-4c43-b34e-588067291d3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:17:11.626094 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92a0820-989f-4c43-b34e-588067291d3c service neutron] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:17:11.644554 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 599/1210] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:17:11 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:17:14.142509 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba9425e-e5d2-4705-be91-98b2db5e1690 None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:17:14.143049 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba9425e-e5d2-4705-be91-98b2db5e1690 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:17:14.143049 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba9425e-e5d2-4705-be91-98b2db5e1690 None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:17:14.144874 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 612/1211] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:17:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:17:14.151267 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d79354-39a6-4078-a595-9dbedf574ee8 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:17:14.151708 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d79354-39a6-4078-a595-9dbedf574ee8 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:17:14.151799 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d79354-39a6-4078-a595-9dbedf574ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:17:14.214483 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-f0d79354-39a6-4078-a595-9dbedf574ee8 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:17:14.215681 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-f0d79354-39a6-4078-a595-9dbedf574ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:17:14.309585 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 600/1212] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:17:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:17:14.348697 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba9425e-e5d2-4705-be91-98b2db5e1690 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:17:14.350243 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-dba9425e-e5d2-4705-be91-98b2db5e1690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:17:14.451586 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba9425e-e5d2-4705-be91-98b2db5e1690 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:17:14.521684 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e2038-bbb0-4ad5-a2fa-d49de3e18ef8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:17:14.522317 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e2038-bbb0-4ad5-a2fa-d49de3e18ef8 service neutron] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:17:14.522591 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e2038-bbb0-4ad5-a2fa-d49de3e18ef8 service neutron] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:17:14.522856 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e2038-bbb0-4ad5-a2fa-d49de3e18ef8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:17:14.524502 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-ca8e2038-bbb0-4ad5-a2fa-d49de3e18ef8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:17:14.627017 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8e2038-bbb0-4ad5-a2fa-d49de3e18ef8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:17:14.628499 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8e2038-bbb0-4ad5-a2fa-d49de3e18ef8 service neutron] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:17:14.647882 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 613/1213] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:17:14 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:17:17.533751 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e489d-aa01-4ed5-a9df-fc18e5cd0daa None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:17:17.534297 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e489d-aa01-4ed5-a9df-fc18e5cd0daa None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:17:17.534297 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e489d-aa01-4ed5-a9df-fc18e5cd0daa None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:17:17.536102 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 601/1214] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:17:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:17:17.542374 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600223cb-5b6f-4cfe-95c3-7027d008d2a7 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:17:17.542929 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600223cb-5b6f-4cfe-95c3-7027d008d2a7 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:17:17.542929 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600223cb-5b6f-4cfe-95c3-7027d008d2a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:17:17.605303 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-600223cb-5b6f-4cfe-95c3-7027d008d2a7 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:17:17.606490 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-600223cb-5b6f-4cfe-95c3-7027d008d2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:17:17.703098 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 614/1215] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:17:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:17:17.739293 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e489d-aa01-4ed5-a9df-fc18e5cd0daa None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:17:17.740923 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-fa6e489d-aa01-4ed5-a9df-fc18e5cd0daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:17:17.863846 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e489d-aa01-4ed5-a9df-fc18e5cd0daa None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:17:17.956889 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e9614-cd88-419e-ad04-de642610f84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:17:17.957728 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e9614-cd88-419e-ad04-de642610f84d admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:17:17.958000 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e9614-cd88-419e-ad04-de642610f84d admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:17:17.958265 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e9614-cd88-419e-ad04-de642610f84d admin admin] PATH_INFO: `/v3/projects/1065667c5e62410e8db95ee2e1b98135` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:17:17.967819 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840e9614-cd88-419e-ad04-de642610f84d admin admin] RBAC: Authorizing `identity:get_project(project_id=1065667c5e62410e8db95ee2e1b98135)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:17:17.969889 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840e9614-cd88-419e-ad04-de642610f84d admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:17:17.971559 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 602/1216] 10.222.0.18 () {56 vars in 1207 bytes} [Tue Oct 12 18:17:17 2021] GET /identity/v3/projects/1065667c5e62410e8db95ee2e1b98135 => generated 298 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:17:17.984135 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600223cb-5b6f-4cfe-95c3-7027d008d2a7 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:17:17.985390 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-600223cb-5b6f-4cfe-95c3-7027d008d2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:17:18.081293 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600223cb-5b6f-4cfe-95c3-7027d008d2a7 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:17:18.157486 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246b9b47-e7e4-4219-ae80-bd107133b36d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:17:18.158129 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b9b47-e7e4-4219-ae80-bd107133b36d service neutron] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:17:18.158413 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b9b47-e7e4-4219-ae80-bd107133b36d service neutron] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:17:18.158684 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b9b47-e7e4-4219-ae80-bd107133b36d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:17:18.160317 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-246b9b47-e7e4-4219-ae80-bd107133b36d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:17:18.270481 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246b9b47-e7e4-4219-ae80-bd107133b36d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:17:18.272189 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246b9b47-e7e4-4219-ae80-bd107133b36d service neutron] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:17:18.290425 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 615/1217] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:17:17 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:17:21.450632 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b682899-f41a-49ee-adbd-faa501bb7568 None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:17:21.451176 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b682899-f41a-49ee-adbd-faa501bb7568 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:17:21.451268 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b682899-f41a-49ee-adbd-faa501bb7568 None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:17:21.453091 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 603/1218] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:17:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:17:21.459241 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84271ef5-ac97-41a2-bef0-e0a2fa45f0c1 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:17:21.459712 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84271ef5-ac97-41a2-bef0-e0a2fa45f0c1 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:17:21.459805 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84271ef5-ac97-41a2-bef0-e0a2fa45f0c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:17:21.530405 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-84271ef5-ac97-41a2-bef0-e0a2fa45f0c1 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:17:21.531624 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-84271ef5-ac97-41a2-bef0-e0a2fa45f0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:17:21.630917 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 616/1219] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:17:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:17:21.666941 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b682899-f41a-49ee-adbd-faa501bb7568 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:17:21.668509 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-7b682899-f41a-49ee-adbd-faa501bb7568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:17:21.790393 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b682899-f41a-49ee-adbd-faa501bb7568 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:17:21.882612 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ef2d06-25d7-420f-9cce-630b0e53f608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:17:21.884120 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef2d06-25d7-420f-9cce-630b0e53f608 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:17:21.884393 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef2d06-25d7-420f-9cce-630b0e53f608 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:17:21.884689 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef2d06-25d7-420f-9cce-630b0e53f608 admin admin] PATH_INFO: `/v3/projects/1065667c5e62410e8db95ee2e1b98135` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:17:21.894975 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ef2d06-25d7-420f-9cce-630b0e53f608 admin admin] RBAC: Authorizing `identity:get_project(project_id=1065667c5e62410e8db95ee2e1b98135)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:17:21.897376 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ef2d06-25d7-420f-9cce-630b0e53f608 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:17:21.899189 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 604/1220] 10.222.0.18 () {56 vars in 1207 bytes} [Tue Oct 12 18:17:21 2021] GET /identity/v3/projects/1065667c5e62410e8db95ee2e1b98135 => generated 298 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:17:21.925146 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca9150-dd21-4e2a-b508-bff064c36130 None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:17:21.925427 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca9150-dd21-4e2a-b508-bff064c36130 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:17:21.925700 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca9150-dd21-4e2a-b508-bff064c36130 None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:17:21.927484 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 617/1221] 10.222.0.18 () {54 vars in 963 bytes} [Tue Oct 12 18:17:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:17:21.934103 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00217d73-9d52-4015-83d2-a20789466136 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:17:21.934391 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00217d73-9d52-4015-83d2-a20789466136 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:17:21.934671 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00217d73-9d52-4015-83d2-a20789466136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:17:22.009922 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-00217d73-9d52-4015-83d2-a20789466136 None None] MFA Rules not processed for user `9a1ea6f47a7c41aba102ad481f5ad5c8`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:17:22.011116 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-00217d73-9d52-4015-83d2-a20789466136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:17:22.085459 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 605/1222] 10.222.0.18 () {58 vars in 1060 bytes} [Tue Oct 12 18:17:21 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:17:22.094951 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ca9150-dd21-4e2a-b508-bff064c36130 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:17:22.096557 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-b1ca9150-dd21-4e2a-b508-bff064c36130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:17:22.199594 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ca9150-dd21-4e2a-b508-bff064c36130 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:17:22.272354 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cc01ee-f8bc-42fd-b4eb-9b8aa2f934c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:17:22.273081 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cc01ee-f8bc-42fd-b4eb-9b8aa2f934c3 service neutron] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:17:22.273365 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cc01ee-f8bc-42fd-b4eb-9b8aa2f934c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:17:22.273640 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cc01ee-f8bc-42fd-b4eb-9b8aa2f934c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:17:22.275356 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-c0cc01ee-f8bc-42fd-b4eb-9b8aa2f934c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:17:22.383232 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cc01ee-f8bc-42fd-b4eb-9b8aa2f934c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:17:22.384654 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cc01ee-f8bc-42fd-b4eb-9b8aa2f934c3 service neutron] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:17:22.404148 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 618/1223] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:17:22 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:17:26.445141 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f36aae8-07f2-485c-abc3-52b384f2a44a None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:17:26.446200 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f36aae8-07f2-485c-abc3-52b384f2a44a None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:17:26.446307 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f36aae8-07f2-485c-abc3-52b384f2a44a None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:17:26.448030 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 606/1224] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:17:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:17:26.454018 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3383edaf-b8a5-450e-8c21-c6085aa33e9f None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:17:26.454454 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3383edaf-b8a5-450e-8c21-c6085aa33e9f None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:17:26.454549 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3383edaf-b8a5-450e-8c21-c6085aa33e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:17:26.525840 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-3383edaf-b8a5-450e-8c21-c6085aa33e9f None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:17:26.527264 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-3383edaf-b8a5-450e-8c21-c6085aa33e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:17:26.639947 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 619/1225] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:17:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:17:26.677979 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f36aae8-07f2-485c-abc3-52b384f2a44a None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:17:26.679509 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-8f36aae8-07f2-485c-abc3-52b384f2a44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:17:26.806167 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f36aae8-07f2-485c-abc3-52b384f2a44a None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:17:26.881992 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fab9432-fb7e-4246-8568-7c05f4290c7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:17:26.882632 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab9432-fb7e-4246-8568-7c05f4290c7a service neutron] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:17:26.882957 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab9432-fb7e-4246-8568-7c05f4290c7a service neutron] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:17:26.883282 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab9432-fb7e-4246-8568-7c05f4290c7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:17:26.884960 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-9fab9432-fb7e-4246-8568-7c05f4290c7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:17:27.001664 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fab9432-fb7e-4246-8568-7c05f4290c7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:17:27.003014 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fab9432-fb7e-4246-8568-7c05f4290c7a service neutron] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:17:27.021025 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 607/1226] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:17:26 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:17:29.366871 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24736f13-d277-45db-a4dd-f8c28cbcff47 None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:17:29.367432 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24736f13-d277-45db-a4dd-f8c28cbcff47 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:17:29.367432 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24736f13-d277-45db-a4dd-f8c28cbcff47 None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:17:29.369239 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 620/1227] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:17:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:17:29.375471 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf267f1f-93d6-4caf-951d-a73bed4e03be None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:17:29.383029 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf267f1f-93d6-4caf-951d-a73bed4e03be None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:17:29.383029 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf267f1f-93d6-4caf-951d-a73bed4e03be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:17:29.442275 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-cf267f1f-93d6-4caf-951d-a73bed4e03be None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:17:29.443483 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-cf267f1f-93d6-4caf-951d-a73bed4e03be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:17:29.541845 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 608/1228] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:17:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:17:29.579069 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24736f13-d277-45db-a4dd-f8c28cbcff47 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:17:29.580840 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-24736f13-d277-45db-a4dd-f8c28cbcff47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:17:29.683414 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24736f13-d277-45db-a4dd-f8c28cbcff47 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:17:29.754002 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b265cb5-67bf-4a27-bbae-aca0ede341d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:17:29.754558 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b265cb5-67bf-4a27-bbae-aca0ede341d7 service neutron] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:17:29.754843 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b265cb5-67bf-4a27-bbae-aca0ede341d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:17:29.755111 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b265cb5-67bf-4a27-bbae-aca0ede341d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:17:29.756763 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-9b265cb5-67bf-4a27-bbae-aca0ede341d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:17:29.864990 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b265cb5-67bf-4a27-bbae-aca0ede341d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:17:29.866460 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b265cb5-67bf-4a27-bbae-aca0ede341d7 service neutron] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:17:29.886153 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 621/1229] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:17:29 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:17:32.256909 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fae081-e688-44b4-bc52-5e9082b1fc64 None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:17:32.257457 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fae081-e688-44b4-bc52-5e9082b1fc64 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:17:32.257457 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fae081-e688-44b4-bc52-5e9082b1fc64 None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:17:32.259284 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 609/1230] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:17:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:17:32.269628 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d3cc36-558c-4e31-a2ee-c62506b951e8 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:17:32.270116 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d3cc36-558c-4e31-a2ee-c62506b951e8 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:17:32.270202 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d3cc36-558c-4e31-a2ee-c62506b951e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:17:32.337518 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-45d3cc36-558c-4e31-a2ee-c62506b951e8 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:17:32.338717 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-45d3cc36-558c-4e31-a2ee-c62506b951e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:17:32.436287 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 622/1231] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:17:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:17:32.471315 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fae081-e688-44b4-bc52-5e9082b1fc64 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:17:32.472944 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-60fae081-e688-44b4-bc52-5e9082b1fc64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:17:32.598833 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fae081-e688-44b4-bc52-5e9082b1fc64 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:17:32.692138 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da64c78-296c-4c41-a641-8adce42ce954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:17:32.693013 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da64c78-296c-4c41-a641-8adce42ce954 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:17:32.693321 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da64c78-296c-4c41-a641-8adce42ce954 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:17:32.693542 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da64c78-296c-4c41-a641-8adce42ce954 admin admin] PATH_INFO: `/v3/projects/1065667c5e62410e8db95ee2e1b98135` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:17:32.703682 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da64c78-296c-4c41-a641-8adce42ce954 admin admin] RBAC: Authorizing `identity:get_project(project_id=1065667c5e62410e8db95ee2e1b98135)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:17:32.705758 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da64c78-296c-4c41-a641-8adce42ce954 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:17:32.707582 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 610/1232] 10.222.0.18 () {56 vars in 1207 bytes} [Tue Oct 12 18:17:32 2021] GET /identity/v3/projects/1065667c5e62410e8db95ee2e1b98135 => generated 298 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:17:32.720326 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d3cc36-558c-4e31-a2ee-c62506b951e8 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:17:32.721623 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-45d3cc36-558c-4e31-a2ee-c62506b951e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:17:32.807913 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d3cc36-558c-4e31-a2ee-c62506b951e8 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:17:32.876429 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66b94ac-ac80-4368-914a-850f5846fa5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:17:32.876993 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66b94ac-ac80-4368-914a-850f5846fa5f service neutron] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:17:32.877274 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66b94ac-ac80-4368-914a-850f5846fa5f service neutron] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:17:32.877545 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66b94ac-ac80-4368-914a-850f5846fa5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:17:32.879148 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-b66b94ac-ac80-4368-914a-850f5846fa5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:17:32.997514 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66b94ac-ac80-4368-914a-850f5846fa5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:17:32.998974 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66b94ac-ac80-4368-914a-850f5846fa5f service neutron] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:17:33.019011 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 623/1233] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:17:32 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:17:36.151011 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab45e5-1b46-4479-9ee1-1e21488f5d31 None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:17:36.151562 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab45e5-1b46-4479-9ee1-1e21488f5d31 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:17:36.151562 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab45e5-1b46-4479-9ee1-1e21488f5d31 None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:17:36.153331 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 611/1234] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:17:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:17:36.159700 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235765e0-f4e1-4d4c-893d-2323831ff6b1 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:17:36.160172 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235765e0-f4e1-4d4c-893d-2323831ff6b1 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:17:36.160274 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235765e0-f4e1-4d4c-893d-2323831ff6b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:17:36.222744 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-235765e0-f4e1-4d4c-893d-2323831ff6b1 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:17:36.223977 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-235765e0-f4e1-4d4c-893d-2323831ff6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:17:36.314662 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 624/1235] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:17:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:17:36.352647 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eab45e5-1b46-4479-9ee1-1e21488f5d31 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:17:36.354237 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-9eab45e5-1b46-4479-9ee1-1e21488f5d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:17:36.462380 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eab45e5-1b46-4479-9ee1-1e21488f5d31 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:17:36.565510 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e059267e-a148-413c-91f1-3759c7351fcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:17:36.566147 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e059267e-a148-413c-91f1-3759c7351fcc service neutron] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:17:36.566422 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e059267e-a148-413c-91f1-3759c7351fcc service neutron] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:17:36.566690 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e059267e-a148-413c-91f1-3759c7351fcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:17:36.569517 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-e059267e-a148-413c-91f1-3759c7351fcc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:17:36.675933 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e059267e-a148-413c-91f1-3759c7351fcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:17:36.677397 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e059267e-a148-413c-91f1-3759c7351fcc service neutron] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:17:36.696096 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 612/1236] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:17:36 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:17:39.026453 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29692d2-0d93-4a44-8bc9-7b61c9f07603 None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:17:39.027074 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29692d2-0d93-4a44-8bc9-7b61c9f07603 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:17:39.027074 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29692d2-0d93-4a44-8bc9-7b61c9f07603 None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:17:39.028804 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 625/1237] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:17:39 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:17:39.034688 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f7060-c634-4a25-86ad-f2c47bad20ba None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:17:39.035113 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f7060-c634-4a25-86ad-f2c47bad20ba None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:17:39.035223 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f7060-c634-4a25-86ad-f2c47bad20ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:17:39.110003 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-004f7060-c634-4a25-86ad-f2c47bad20ba None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:17:39.111196 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-004f7060-c634-4a25-86ad-f2c47bad20ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:17:39.211513 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 613/1238] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:17:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:17:39.253282 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29692d2-0d93-4a44-8bc9-7b61c9f07603 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:17:39.255484 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-d29692d2-0d93-4a44-8bc9-7b61c9f07603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:17:39.346652 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29692d2-0d93-4a44-8bc9-7b61c9f07603 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:17:39.350123 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623aecc0-fed6-4453-b63c-8b7d33fa4880 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:17:39.350760 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623aecc0-fed6-4453-b63c-8b7d33fa4880 service neutron] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:17:39.351042 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623aecc0-fed6-4453-b63c-8b7d33fa4880 service neutron] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:17:39.351809 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623aecc0-fed6-4453-b63c-8b7d33fa4880 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:17:39.360473 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623aecc0-fed6-4453-b63c-8b7d33fa4880 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:17:39.361904 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623aecc0-fed6-4453-b63c-8b7d33fa4880 service neutron] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:17:39.371583 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 626/1239] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:17:39 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:17:42.326782 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e591cff-c0f9-4bc8-b7af-c3201936b08e None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:17:42.327360 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e591cff-c0f9-4bc8-b7af-c3201936b08e None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:17:42.327360 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e591cff-c0f9-4bc8-b7af-c3201936b08e None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:17:42.329164 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 614/1240] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:17:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:17:42.335100 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac23c9e8-ed64-40a7-b170-12cd89f59f34 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:17:42.336036 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac23c9e8-ed64-40a7-b170-12cd89f59f34 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:17:42.336286 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac23c9e8-ed64-40a7-b170-12cd89f59f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:17:42.354001 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-ac23c9e8-ed64-40a7-b170-12cd89f59f34 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:17:42.355206 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-ac23c9e8-ed64-40a7-b170-12cd89f59f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:17:42.363176 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 627/1241] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:17:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:17:42.401773 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e591cff-c0f9-4bc8-b7af-c3201936b08e None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:17:42.412383 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e591cff-c0f9-4bc8-b7af-c3201936b08e None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:17:42.416086 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81704766-0bb4-4624-8c35-22e2bb2f9a91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:17:42.417144 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81704766-0bb4-4624-8c35-22e2bb2f9a91 service neutron] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:17:42.417144 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81704766-0bb4-4624-8c35-22e2bb2f9a91 service neutron] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:17:42.417360 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81704766-0bb4-4624-8c35-22e2bb2f9a91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:17:42.430344 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81704766-0bb4-4624-8c35-22e2bb2f9a91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:17:42.431858 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81704766-0bb4-4624-8c35-22e2bb2f9a91 service neutron] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:17:42.441392 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 615/1242] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:17:42 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:17:47.430354 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db4550-97f9-4347-999d-f958530bd29c None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:17:47.430885 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db4550-97f9-4347-999d-f958530bd29c None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:17:47.430885 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db4550-97f9-4347-999d-f958530bd29c None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:17:47.432684 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 628/1243] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:17:47 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:17:47.439180 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3302dd70-8da1-4ced-b29c-1ca07d9af6d0 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:17:47.439635 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3302dd70-8da1-4ced-b29c-1ca07d9af6d0 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:17:47.439724 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3302dd70-8da1-4ced-b29c-1ca07d9af6d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:17:47.458440 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-3302dd70-8da1-4ced-b29c-1ca07d9af6d0 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:17:47.459634 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-3302dd70-8da1-4ced-b29c-1ca07d9af6d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:17:47.468209 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 616/1244] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:17:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:17:47.513542 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29db4550-97f9-4347-999d-f958530bd29c None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:17:47.525351 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29db4550-97f9-4347-999d-f958530bd29c None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:17:47.529186 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b086306-2887-439f-863a-9e3d1b8dd2a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:17:47.529558 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b086306-2887-439f-863a-9e3d1b8dd2a0 service neutron] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:17:47.529838 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b086306-2887-439f-863a-9e3d1b8dd2a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:17:47.530144 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b086306-2887-439f-863a-9e3d1b8dd2a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:17:47.539233 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b086306-2887-439f-863a-9e3d1b8dd2a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:17:47.540707 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b086306-2887-439f-863a-9e3d1b8dd2a0 service neutron] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:17:47.550316 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 629/1245] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:17:47 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:17:51.311083 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6421af-2cd3-4532-a677-cd9de5931425 None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:17:51.311849 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6421af-2cd3-4532-a677-cd9de5931425 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:17:51.311849 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6421af-2cd3-4532-a677-cd9de5931425 None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:17:51.313541 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 617/1246] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:17:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 18:17:51.319768 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac46ca2-e8d7-4f72-a375-1a091a58c0f5 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:17:51.320286 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac46ca2-e8d7-4f72-a375-1a091a58c0f5 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:17:51.320450 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac46ca2-e8d7-4f72-a375-1a091a58c0f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:17:51.339654 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-bac46ca2-e8d7-4f72-a375-1a091a58c0f5 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:17:51.340902 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-bac46ca2-e8d7-4f72-a375-1a091a58c0f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:17:51.348811 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 630/1247] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:17:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:17:51.390734 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6421af-2cd3-4532-a677-cd9de5931425 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:17:51.392849 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-ba6421af-2cd3-4532-a677-cd9de5931425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:17:51.405446 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6421af-2cd3-4532-a677-cd9de5931425 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:17:51.409105 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df020813-ed83-4cb5-a770-c39bdeeba6ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:17:51.409752 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df020813-ed83-4cb5-a770-c39bdeeba6ce service neutron] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:17:51.410026 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df020813-ed83-4cb5-a770-c39bdeeba6ce service neutron] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:17:51.410292 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df020813-ed83-4cb5-a770-c39bdeeba6ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:17:51.420307 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df020813-ed83-4cb5-a770-c39bdeeba6ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:17:51.421772 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df020813-ed83-4cb5-a770-c39bdeeba6ce service neutron] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:17:51.432669 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 618/1248] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:17:51 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:17:56.491706 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db2434-3d13-4c14-801c-34a25c2d9d9a None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:17:56.492663 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db2434-3d13-4c14-801c-34a25c2d9d9a None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:17:56.493155 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db2434-3d13-4c14-801c-34a25c2d9d9a None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:17:56.497613 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 631/1249] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:17:56 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:17:56.501679 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f48f85e-f4d8-4c50-aeaa-868e895fbb94 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:17:56.502552 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f48f85e-f4d8-4c50-aeaa-868e895fbb94 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:17:56.502552 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f48f85e-f4d8-4c50-aeaa-868e895fbb94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:17:56.521351 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-1f48f85e-f4d8-4c50-aeaa-868e895fbb94 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:17:56.522926 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-1f48f85e-f4d8-4c50-aeaa-868e895fbb94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:17:56.531122 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 619/1250] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:17:56 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:17:56.571267 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09db2434-3d13-4c14-801c-34a25c2d9d9a None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:17:56.582221 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09db2434-3d13-4c14-801c-34a25c2d9d9a None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:17:56.586050 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712bf6f3-5f1b-412f-afc3-b8ef37ce9ebc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:17:56.586696 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712bf6f3-5f1b-412f-afc3-b8ef37ce9ebc service neutron] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:17:56.586971 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712bf6f3-5f1b-412f-afc3-b8ef37ce9ebc service neutron] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:17:56.587243 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712bf6f3-5f1b-412f-afc3-b8ef37ce9ebc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:17:56.597271 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712bf6f3-5f1b-412f-afc3-b8ef37ce9ebc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:17:56.598732 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712bf6f3-5f1b-412f-afc3-b8ef37ce9ebc service neutron] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:17:56.609343 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 632/1251] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:17:56 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:18:01.739388 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc9178-d224-4c64-b81a-d0e0b9197cb3 None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:18:01.750023 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc9178-d224-4c64-b81a-d0e0b9197cb3 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:18:01.750023 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc9178-d224-4c64-b81a-d0e0b9197cb3 None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:18:01.750023 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 620/1252] 10.222.0.18 () {54 vars in 921 bytes} [Tue Oct 12 18:18:01 2021] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:18:01.755264 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca70dd7-024f-47eb-ba5b-2c542d651e0f None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:18:01.755814 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca70dd7-024f-47eb-ba5b-2c542d651e0f None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:18:01.756081 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca70dd7-024f-47eb-ba5b-2c542d651e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:18:01.860921 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-8ca70dd7-024f-47eb-ba5b-2c542d651e0f None None] MFA Rules not processed for user `4bd99e4f2d444a388ecde7ea3cb61089`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:18:01.862198 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-8ca70dd7-024f-47eb-ba5b-2c542d651e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:18:01.938106 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 633/1253] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Oct 12 18:18:01 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:18:06.612250 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793508bd-52b6-45cc-bfa8-e61788b8ed69 None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:18:06.613233 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793508bd-52b6-45cc-bfa8-e61788b8ed69 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:18:06.613745 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793508bd-52b6-45cc-bfa8-e61788b8ed69 None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:18:06.619110 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 621/1254] 10.222.0.18 () {54 vars in 921 bytes} [Tue Oct 12 18:18:06 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:18:06.625813 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd1cec0-5334-408c-9a7c-73e1cf1f9966 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:18:06.626862 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd1cec0-5334-408c-9a7c-73e1cf1f9966 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:18:06.627486 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd1cec0-5334-408c-9a7c-73e1cf1f9966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:18:06.649354 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-ebd1cec0-5334-408c-9a7c-73e1cf1f9966 None None] MFA Rules not processed for user `4bd99e4f2d444a388ecde7ea3cb61089`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:18:06.651128 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-ebd1cec0-5334-408c-9a7c-73e1cf1f9966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:18:06.660487 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 634/1255] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Oct 12 18:18:06 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:18:08.002952 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d21bcf9-a5fa-45bd-be53-aa754a38eed3 None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:18:08.003474 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d21bcf9-a5fa-45bd-be53-aa754a38eed3 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:18:08.003474 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d21bcf9-a5fa-45bd-be53-aa754a38eed3 None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:18:08.005223 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 622/1256] 10.222.0.18 () {54 vars in 921 bytes} [Tue Oct 12 18:18:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:18:08.011495 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61070d67-5474-48fb-b240-591b3865c04a None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:18:08.015144 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61070d67-5474-48fb-b240-591b3865c04a None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:18:08.015144 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61070d67-5474-48fb-b240-591b3865c04a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:18:08.031957 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-61070d67-5474-48fb-b240-591b3865c04a None None] MFA Rules not processed for user `4bd99e4f2d444a388ecde7ea3cb61089`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:18:08.033188 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-61070d67-5474-48fb-b240-591b3865c04a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:18:08.042605 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 635/1257] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Oct 12 18:18:08 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:18:12.012070 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa59356-960e-4cdd-aeab-d64e7c03e19c None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:18:12.012654 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa59356-960e-4cdd-aeab-d64e7c03e19c None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:18:12.012654 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa59356-960e-4cdd-aeab-d64e7c03e19c None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:18:12.014395 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 623/1258] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:18:12 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:18:12.020647 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff54c8e-1115-4042-828e-e6602935eece None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:18:12.021100 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff54c8e-1115-4042-828e-e6602935eece None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:18:12.021193 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff54c8e-1115-4042-828e-e6602935eece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:18:12.041654 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-8ff54c8e-1115-4042-828e-e6602935eece None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:18:12.042858 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-8ff54c8e-1115-4042-828e-e6602935eece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:18:12.053222 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 636/1259] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:18:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:18:12.106677 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e5c357-21a4-4562-a25c-6ff21298dc9b None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:18:12.107423 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e5c357-21a4-4562-a25c-6ff21298dc9b None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:18:12.107710 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e5c357-21a4-4562-a25c-6ff21298dc9b None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:18:12.110208 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 624/1260] 10.222.0.18 () {54 vars in 960 bytes} [Tue Oct 12 18:18:12 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:18:12.116218 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa100ce-813d-4987-836a-48019a3f7649 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:18:12.116651 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa100ce-813d-4987-836a-48019a3f7649 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:18:12.116934 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa100ce-813d-4987-836a-48019a3f7649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:18:12.169849 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-afa100ce-813d-4987-836a-48019a3f7649 None None] MFA Rules not processed for user `3417097a280b499086b36df9a2548239`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:18:12.171008 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-afa100ce-813d-4987-836a-48019a3f7649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:18:12.258365 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 637/1261] 10.222.0.18 () {58 vars in 1057 bytes} [Tue Oct 12 18:18:12 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:18:12.266837 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e5c357-21a4-4562-a25c-6ff21298dc9b None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:18:12.282170 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e5c357-21a4-4562-a25c-6ff21298dc9b None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:18:12.287746 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f43ea24-7b92-47b6-9b2a-dee233aec5b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3417097a280b499086b36df9a2548239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:18:12.288390 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43ea24-7b92-47b6-9b2a-dee233aec5b8 service nova] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:18:12.288792 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43ea24-7b92-47b6-9b2a-dee233aec5b8 service nova] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:18:12.289068 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43ea24-7b92-47b6-9b2a-dee233aec5b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:18:12.297727 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f43ea24-7b92-47b6-9b2a-dee233aec5b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:18:12.299314 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f43ea24-7b92-47b6-9b2a-dee233aec5b8 service nova] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:18:12.324627 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 625/1262] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:18:12 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:18:14.872978 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb4860-952e-46a6-862f-012929449268 None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:18:14.873916 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb4860-952e-46a6-862f-012929449268 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:18:14.874198 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb4860-952e-46a6-862f-012929449268 None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:18:14.876161 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 638/1263] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:18:14 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:18:14.884791 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9777830f-0ee1-4e32-9e40-726a67af4e3d None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:18:14.885381 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9777830f-0ee1-4e32-9e40-726a67af4e3d None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:18:14.885710 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9777830f-0ee1-4e32-9e40-726a67af4e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:18:14.905680 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-9777830f-0ee1-4e32-9e40-726a67af4e3d None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:18:14.906921 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-9777830f-0ee1-4e32-9e40-726a67af4e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:18:14.914902 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 626/1264] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:18:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:18:14.961714 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bb4860-952e-46a6-862f-012929449268 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:18:14.975918 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bb4860-952e-46a6-862f-012929449268 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:18:14.981396 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0220a6-76e8-45a0-a4c4-9a5e679eb240 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3417097a280b499086b36df9a2548239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:18:14.982150 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0220a6-76e8-45a0-a4c4-9a5e679eb240 service nova] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:18:14.982528 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0220a6-76e8-45a0-a4c4-9a5e679eb240 service nova] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:18:14.982899 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0220a6-76e8-45a0-a4c4-9a5e679eb240 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:18:14.992650 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0220a6-76e8-45a0-a4c4-9a5e679eb240 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:18:14.994362 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0220a6-76e8-45a0-a4c4-9a5e679eb240 service nova] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:18:15.005278 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 639/1265] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:18:14 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:18:17.845879 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae72b1e-4d54-49ba-bff7-3d1f3090080c None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:18:17.846972 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae72b1e-4d54-49ba-bff7-3d1f3090080c None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:18:17.846972 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae72b1e-4d54-49ba-bff7-3d1f3090080c None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:18:17.848154 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 627/1266] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:18:17 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:18:17.855745 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a39359-ec0b-499b-a994-b6e28410b46a None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:18:17.856177 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a39359-ec0b-499b-a994-b6e28410b46a None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:18:17.856298 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a39359-ec0b-499b-a994-b6e28410b46a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:18:17.892304 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-55a39359-ec0b-499b-a994-b6e28410b46a None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:18:17.893639 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-55a39359-ec0b-499b-a994-b6e28410b46a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:18:17.902758 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 640/1267] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:18:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:18:17.953036 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04d107-2acc-4aa3-8414-d6f91deb8d6c None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:18:17.954709 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04d107-2acc-4aa3-8414-d6f91deb8d6c None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:18:17.954709 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04d107-2acc-4aa3-8414-d6f91deb8d6c None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:18:17.956732 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 628/1268] 10.222.0.18 () {54 vars in 960 bytes} [Tue Oct 12 18:18:17 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:18:17.963618 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e44c2e7-a1d4-4d95-9b76-a92a3220742b None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:18:17.964153 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e44c2e7-a1d4-4d95-9b76-a92a3220742b None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:18:17.964607 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e44c2e7-a1d4-4d95-9b76-a92a3220742b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:18:17.985413 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-4e44c2e7-a1d4-4d95-9b76-a92a3220742b None None] MFA Rules not processed for user `3417097a280b499086b36df9a2548239`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:18:17.986843 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-4e44c2e7-a1d4-4d95-9b76-a92a3220742b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:18:17.997402 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 641/1269] 10.222.0.18 () {58 vars in 1057 bytes} [Tue Oct 12 18:18:17 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:18:18.005889 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef04d107-2acc-4aa3-8414-d6f91deb8d6c None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:18:18.020448 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef04d107-2acc-4aa3-8414-d6f91deb8d6c None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:18:18.026668 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ba01fe-cd33-48ad-bde7-ef3436d79415 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3417097a280b499086b36df9a2548239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:18:18.027565 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba01fe-cd33-48ad-bde7-ef3436d79415 service nova] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:18:18.027851 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba01fe-cd33-48ad-bde7-ef3436d79415 service nova] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:18:18.028131 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba01fe-cd33-48ad-bde7-ef3436d79415 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:18:18.041190 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ba01fe-cd33-48ad-bde7-ef3436d79415 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:18:18.043089 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ba01fe-cd33-48ad-bde7-ef3436d79415 service nova] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:18:18.054535 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 629/1270] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:18:18 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:18:20.290317 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd9ef33-f75c-47ee-8fa5-70452f0fb566 None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:18:20.290978 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd9ef33-f75c-47ee-8fa5-70452f0fb566 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:18:20.290978 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd9ef33-f75c-47ee-8fa5-70452f0fb566 None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:18:20.292925 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 642/1271] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:18:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:18:20.299259 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a82c59-0f14-4b37-b4aa-36e5d3233ec8 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:18:20.300011 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a82c59-0f14-4b37-b4aa-36e5d3233ec8 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:18:20.300011 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a82c59-0f14-4b37-b4aa-36e5d3233ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:18:20.318997 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-b3a82c59-0f14-4b37-b4aa-36e5d3233ec8 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:18:20.320180 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-b3a82c59-0f14-4b37-b4aa-36e5d3233ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:18:20.328631 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 630/1272] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:18:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:18:20.385420 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367b2a42-33b6-4ab1-ad66-63e76a7145f0 None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:18:20.385701 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367b2a42-33b6-4ab1-ad66-63e76a7145f0 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:18:20.386154 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367b2a42-33b6-4ab1-ad66-63e76a7145f0 None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:18:20.387954 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 643/1273] 10.222.0.18 () {54 vars in 962 bytes} [Tue Oct 12 18:18:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:18:20.394119 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef06d3-3486-428b-aee7-46daddd81745 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:18:20.394469 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef06d3-3486-428b-aee7-46daddd81745 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:18:20.394714 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef06d3-3486-428b-aee7-46daddd81745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:18:20.463333 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-b8ef06d3-3486-428b-aee7-46daddd81745 None None] MFA Rules not processed for user `f6966ce0774f4437a9b688494e9d0574`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:18:20.464593 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-b8ef06d3-3486-428b-aee7-46daddd81745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:18:20.534369 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 631/1274] 10.222.0.18 () {58 vars in 1059 bytes} [Tue Oct 12 18:18:20 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:18:20.543737 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367b2a42-33b6-4ab1-ad66-63e76a7145f0 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:18:20.555397 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367b2a42-33b6-4ab1-ad66-63e76a7145f0 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:18:20.559021 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8b2fd7-683b-4023-9e95-ae155121fde5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6966ce0774f4437a9b688494e9d0574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:18:20.559699 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b2fd7-683b-4023-9e95-ae155121fde5 service cinder] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:18:20.559983 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b2fd7-683b-4023-9e95-ae155121fde5 service cinder] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:18:20.560261 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b2fd7-683b-4023-9e95-ae155121fde5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:18:20.569918 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8b2fd7-683b-4023-9e95-ae155121fde5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:18:20.571368 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8b2fd7-683b-4023-9e95-ae155121fde5 service cinder] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:18:20.582599 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 644/1275] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:18:20 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 18:18:20.732305 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e1244-5b31-4582-8aef-f0ae1a02603d None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:18:20.732626 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e1244-5b31-4582-8aef-f0ae1a02603d None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:18:20.733086 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e1244-5b31-4582-8aef-f0ae1a02603d None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:18:20.734874 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 632/1276] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:18:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:18:20.741898 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bfd961-ab1f-4b52-b6cf-bffc3cfbc2b7 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:18:20.742516 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bfd961-ab1f-4b52-b6cf-bffc3cfbc2b7 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:18:20.742825 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bfd961-ab1f-4b52-b6cf-bffc3cfbc2b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:18:20.764101 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-f3bfd961-ab1f-4b52-b6cf-bffc3cfbc2b7 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:18:20.765360 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-f3bfd961-ab1f-4b52-b6cf-bffc3cfbc2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:18:20.775528 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 645/1277] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:18:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:18:20.825266 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451e1244-5b31-4582-8aef-f0ae1a02603d None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:18:20.842159 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451e1244-5b31-4582-8aef-f0ae1a02603d None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:18:20.848654 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1867f4-71a2-404a-8e74-4efda82496c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3417097a280b499086b36df9a2548239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:18:20.850086 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1867f4-71a2-404a-8e74-4efda82496c4 service nova] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:18:20.850657 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1867f4-71a2-404a-8e74-4efda82496c4 service nova] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:18:20.851031 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1867f4-71a2-404a-8e74-4efda82496c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:18:20.861095 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1867f4-71a2-404a-8e74-4efda82496c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:18:20.862871 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1867f4-71a2-404a-8e74-4efda82496c4 service nova] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:18:20.874725 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 633/1278] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:18:20 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:18:23.418751 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08304fd7-f93a-4836-828f-ca066d1cec8b None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:18:23.419311 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08304fd7-f93a-4836-828f-ca066d1cec8b None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:18:23.419311 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08304fd7-f93a-4836-828f-ca066d1cec8b None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:18:23.421596 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 646/1279] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:18:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:18:23.431825 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d72653-6495-480d-b9c3-5111194f9f90 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:18:23.433042 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d72653-6495-480d-b9c3-5111194f9f90 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:18:23.433359 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d72653-6495-480d-b9c3-5111194f9f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:18:23.455923 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-70d72653-6495-480d-b9c3-5111194f9f90 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:18:23.457169 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-70d72653-6495-480d-b9c3-5111194f9f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:18:23.481439 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 634/1280] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:18:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:18:23.523297 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08304fd7-f93a-4836-828f-ca066d1cec8b None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:18:23.538122 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08304fd7-f93a-4836-828f-ca066d1cec8b None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:18:23.543877 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b88f7ef-d546-44f6-856c-d475a49e6905 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3417097a280b499086b36df9a2548239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:18:23.544554 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b88f7ef-d546-44f6-856c-d475a49e6905 service nova] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:18:23.544830 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b88f7ef-d546-44f6-856c-d475a49e6905 service nova] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:18:23.545102 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b88f7ef-d546-44f6-856c-d475a49e6905 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:18:23.554172 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b88f7ef-d546-44f6-856c-d475a49e6905 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:18:23.556310 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b88f7ef-d546-44f6-856c-d475a49e6905 service nova] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:18:23.567909 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 647/1281] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:18:23 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:18:26.140197 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b060d6-2332-4686-ab28-dad50c30ffbb None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:18:26.141079 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b060d6-2332-4686-ab28-dad50c30ffbb None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:18:26.141520 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b060d6-2332-4686-ab28-dad50c30ffbb None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:18:26.143703 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 635/1282] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:18:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:18:26.149860 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b455359-bb32-43c8-a277-126344aaec42 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:18:26.150334 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b455359-bb32-43c8-a277-126344aaec42 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:18:26.150620 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b455359-bb32-43c8-a277-126344aaec42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:18:26.169201 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-1b455359-bb32-43c8-a277-126344aaec42 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:18:26.170389 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-1b455359-bb32-43c8-a277-126344aaec42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:18:26.180191 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 648/1283] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:18:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:18:26.227980 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b060d6-2332-4686-ab28-dad50c30ffbb None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:18:26.248030 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b060d6-2332-4686-ab28-dad50c30ffbb None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:18:26.253459 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9220b2-e1f4-4c4b-97a5-694823dd4de8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3417097a280b499086b36df9a2548239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:18:26.254091 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9220b2-e1f4-4c4b-97a5-694823dd4de8 service nova] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:18:26.254367 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9220b2-e1f4-4c4b-97a5-694823dd4de8 service nova] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:18:26.254634 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9220b2-e1f4-4c4b-97a5-694823dd4de8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:18:26.264059 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9220b2-e1f4-4c4b-97a5-694823dd4de8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:18:26.265661 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9220b2-e1f4-4c4b-97a5-694823dd4de8 service nova] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:18:26.275795 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 636/1284] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:18:26 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:18:29.092639 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb765fc-2a19-4a9d-9c6a-8b07c37d2f44 None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:18:29.093198 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb765fc-2a19-4a9d-9c6a-8b07c37d2f44 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:18:29.093734 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb765fc-2a19-4a9d-9c6a-8b07c37d2f44 None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:18:29.097150 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 649/1285] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:18:29 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:18:29.103824 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af4f6d1-f342-4e05-b468-022f21f986fe None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:18:29.104720 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af4f6d1-f342-4e05-b468-022f21f986fe None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:18:29.104720 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af4f6d1-f342-4e05-b468-022f21f986fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:18:29.124378 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-3af4f6d1-f342-4e05-b468-022f21f986fe None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:18:29.125822 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-3af4f6d1-f342-4e05-b468-022f21f986fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:18:29.136212 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 637/1286] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:18:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:18:29.181629 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb765fc-2a19-4a9d-9c6a-8b07c37d2f44 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:18:29.197284 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb765fc-2a19-4a9d-9c6a-8b07c37d2f44 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:18:29.202845 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01899e8-2bbb-45fa-9304-f6e241948d74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3417097a280b499086b36df9a2548239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:18:29.203476 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01899e8-2bbb-45fa-9304-f6e241948d74 service nova] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:18:29.203757 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01899e8-2bbb-45fa-9304-f6e241948d74 service nova] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:18:29.204030 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01899e8-2bbb-45fa-9304-f6e241948d74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:18:29.212274 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01899e8-2bbb-45fa-9304-f6e241948d74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:18:29.213879 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01899e8-2bbb-45fa-9304-f6e241948d74 service nova] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:18:29.223327 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 650/1287] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:18:29 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:18:31.508739 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2518c93-19c5-44c1-94e9-27e9e3b5e440 None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:18:31.509312 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2518c93-19c5-44c1-94e9-27e9e3b5e440 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:18:31.509312 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2518c93-19c5-44c1-94e9-27e9e3b5e440 None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:18:31.511047 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 638/1288] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:18:31 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:18:31.517180 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99678074-84f2-416b-bc1f-4a8b4a810a37 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:18:31.517599 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99678074-84f2-416b-bc1f-4a8b4a810a37 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:18:31.517735 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99678074-84f2-416b-bc1f-4a8b4a810a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:18:31.536466 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-99678074-84f2-416b-bc1f-4a8b4a810a37 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:18:31.537667 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-99678074-84f2-416b-bc1f-4a8b4a810a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:18:31.546073 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 651/1289] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:18:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:18:31.597086 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2518c93-19c5-44c1-94e9-27e9e3b5e440 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:18:31.613077 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2518c93-19c5-44c1-94e9-27e9e3b5e440 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:18:31.619975 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3c60ce-dc72-4d1e-8d25-8cf27deb6c31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3417097a280b499086b36df9a2548239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:18:31.620708 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c60ce-dc72-4d1e-8d25-8cf27deb6c31 service nova] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:18:31.621000 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c60ce-dc72-4d1e-8d25-8cf27deb6c31 service nova] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:18:31.621268 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c60ce-dc72-4d1e-8d25-8cf27deb6c31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:18:31.631597 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3c60ce-dc72-4d1e-8d25-8cf27deb6c31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:18:31.638504 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3c60ce-dc72-4d1e-8d25-8cf27deb6c31 service nova] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:18:31.643559 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 639/1290] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:18:31 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:18:34.595371 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9a440-040e-4163-87f6-ef202819cdb0 None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:18:34.595915 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9a440-040e-4163-87f6-ef202819cdb0 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:18:34.595915 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9a440-040e-4163-87f6-ef202819cdb0 None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:18:34.597744 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 652/1291] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:18:34 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:18:34.604210 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcadf72-8a59-402e-a1a7-1595f589aabe None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:18:34.604697 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcadf72-8a59-402e-a1a7-1595f589aabe None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:18:34.604793 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcadf72-8a59-402e-a1a7-1595f589aabe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:18:34.624995 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-fdcadf72-8a59-402e-a1a7-1595f589aabe None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:18:34.626262 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-fdcadf72-8a59-402e-a1a7-1595f589aabe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:18:34.634285 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 640/1292] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:18:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:18:34.681507 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e9a440-040e-4163-87f6-ef202819cdb0 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:18:34.696103 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e9a440-040e-4163-87f6-ef202819cdb0 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:18:34.701540 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe0a295-5562-4490-8d3e-d6f416c0a50e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3417097a280b499086b36df9a2548239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:18:34.702177 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0a295-5562-4490-8d3e-d6f416c0a50e service nova] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:18:34.702461 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0a295-5562-4490-8d3e-d6f416c0a50e service nova] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:18:34.702731 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0a295-5562-4490-8d3e-d6f416c0a50e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:18:34.711805 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe0a295-5562-4490-8d3e-d6f416c0a50e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:18:34.713440 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe0a295-5562-4490-8d3e-d6f416c0a50e service nova] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:18:34.722871 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 653/1293] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:18:34 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:18:36.266474 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c3fcb6-1352-4d49-9d4a-ad22b16c163a None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:18:36.267366 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c3fcb6-1352-4d49-9d4a-ad22b16c163a None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:18:36.267366 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c3fcb6-1352-4d49-9d4a-ad22b16c163a None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:18:36.268963 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 641/1294] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:18:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:18:36.276526 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d999e9-7fd4-49e4-8952-e3c32c4160e3 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:18:36.277128 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d999e9-7fd4-49e4-8952-e3c32c4160e3 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:18:36.277128 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d999e9-7fd4-49e4-8952-e3c32c4160e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:18:36.295479 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-b8d999e9-7fd4-49e4-8952-e3c32c4160e3 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:18:36.296689 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-b8d999e9-7fd4-49e4-8952-e3c32c4160e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:18:36.304452 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 654/1295] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:18:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:18:36.362993 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da10800a-f332-4688-b0b3-f38a176f4778 None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:18:36.363277 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da10800a-f332-4688-b0b3-f38a176f4778 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:18:36.363552 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da10800a-f332-4688-b0b3-f38a176f4778 None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:18:36.365580 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 642/1296] 10.222.0.18 () {54 vars in 961 bytes} [Tue Oct 12 18:18:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:18:36.371399 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacac6a5-21b3-4f0e-9b96-a0f499e7cb09 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:18:36.371682 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacac6a5-21b3-4f0e-9b96-a0f499e7cb09 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:18:36.371952 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacac6a5-21b3-4f0e-9b96-a0f499e7cb09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:18:36.422002 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-eacac6a5-21b3-4f0e-9b96-a0f499e7cb09 None None] MFA Rules not processed for user `7a3d3e5a5cfc4ac3afcece4e55f23552`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:18:36.423210 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-eacac6a5-21b3-4f0e-9b96-a0f499e7cb09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:18:36.486628 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 655/1297] 10.222.0.18 () {58 vars in 1058 bytes} [Tue Oct 12 18:18:36 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:18:36.494618 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da10800a-f332-4688-b0b3-f38a176f4778 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:18:36.506048 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da10800a-f332-4688-b0b3-f38a176f4778 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:18:36.510044 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af7771a-3a73-4f3d-a12a-0270c2512a24 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a3d3e5a5cfc4ac3afcece4e55f23552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:18:36.510732 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af7771a-3a73-4f3d-a12a-0270c2512a24 service glance] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:18:36.511013 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af7771a-3a73-4f3d-a12a-0270c2512a24 service glance] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:18:36.511287 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af7771a-3a73-4f3d-a12a-0270c2512a24 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:18:36.520287 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af7771a-3a73-4f3d-a12a-0270c2512a24 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:18:36.522510 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af7771a-3a73-4f3d-a12a-0270c2512a24 service glance] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:18:36.531797 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 643/1298] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:18:36 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:18:37.185181 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253606df-feaf-467e-b44f-f56246d92df5 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:18:37.185581 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253606df-feaf-467e-b44f-f56246d92df5 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:18:37.185930 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253606df-feaf-467e-b44f-f56246d92df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:18:37.239958 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-253606df-feaf-467e-b44f-f56246d92df5 None None] MFA Rules not processed for user `8f6a3a7064754fb79a0a06b3ad4a7d05`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:18:37.241306 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-253606df-feaf-467e-b44f-f56246d92df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:18:37.306600 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 656/1299] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Oct 12 18:18:37 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:18:37.354101 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00923421-78bd-4696-9d81-5cef1d986755 None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:18:37.354615 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00923421-78bd-4696-9d81-5cef1d986755 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:18:37.354699 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00923421-78bd-4696-9d81-5cef1d986755 None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:18:37.356482 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 644/1300] 10.222.0.18 () {54 vars in 942 bytes} [Tue Oct 12 18:18:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:18:37.363477 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39917471-3e66-4453-956a-70266a1964d8 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:18:37.363868 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39917471-3e66-4453-956a-70266a1964d8 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:18:37.364209 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39917471-3e66-4453-956a-70266a1964d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:18:37.370798 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b67e4-25b4-4b06-a160-eb1dfe49eacb None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:18:37.371087 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b67e4-25b4-4b06-a160-eb1dfe49eacb None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:18:37.371368 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b67e4-25b4-4b06-a160-eb1dfe49eacb None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:18:37.373197 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 645/1301] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:18:37 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 18:18:37.378936 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86626ed4-c6da-4776-aa8c-f32b22c0c7b3 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:18:37.379216 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86626ed4-c6da-4776-aa8c-f32b22c0c7b3 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:18:37.379489 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86626ed4-c6da-4776-aa8c-f32b22c0c7b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:18:37.398062 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-86626ed4-c6da-4776-aa8c-f32b22c0c7b3 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:18:37.399298 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-86626ed4-c6da-4776-aa8c-f32b22c0c7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:18:37.407925 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 646/1302] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:18:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:18:37.414578 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-39917471-3e66-4453-956a-70266a1964d8 None None] MFA Rules not processed for user `7f527f925af24eba8cabffe457fceb09`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:18:37.415792 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-39917471-3e66-4453-956a-70266a1964d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:18:37.454069 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86626ed4-c6da-4776-aa8c-f32b22c0c7b3 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:18:37.466742 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86626ed4-c6da-4776-aa8c-f32b22c0c7b3 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:18:37.472109 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1c32cb-cda7-454a-900e-08799fdfefa3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3417097a280b499086b36df9a2548239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:18:37.472780 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1c32cb-cda7-454a-900e-08799fdfefa3 service nova] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:18:37.473056 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1c32cb-cda7-454a-900e-08799fdfefa3 service nova] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:18:37.473353 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1c32cb-cda7-454a-900e-08799fdfefa3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:18:37.482209 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1c32cb-cda7-454a-900e-08799fdfefa3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:18:37.483779 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1c32cb-cda7-454a-900e-08799fdfefa3 service nova] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:18:37.487719 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 657/1303] 10.222.0.18 () {58 vars in 1039 bytes} [Tue Oct 12 18:18:37 2021] POST /identity/v3/auth/tokens => generated 3447 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:18:37.493659 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 647/1304] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:18:37 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 18:18:37.498616 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39917471-3e66-4453-956a-70266a1964d8 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:18:37.509310 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39917471-3e66-4453-956a-70266a1964d8 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:18:37.515292 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0fe6cc-78fa-4128-b2ab-f695a045a863 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f527f925af24eba8cabffe457fceb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:18:37.516626 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0fe6cc-78fa-4128-b2ab-f695a045a863 service swift] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:18:37.516626 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0fe6cc-78fa-4128-b2ab-f695a045a863 service swift] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:18:37.516626 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0fe6cc-78fa-4128-b2ab-f695a045a863 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:18:37.525296 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0fe6cc-78fa-4128-b2ab-f695a045a863 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:18:37.526866 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0fe6cc-78fa-4128-b2ab-f695a045a863 service swift] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:18:37.534674 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 658/1305] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Oct 12 18:18:37 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 18:18:40.033426 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d557faa3-6bfc-4749-abaa-9ec18b806abc None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:18:40.033989 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d557faa3-6bfc-4749-abaa-9ec18b806abc None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:18:40.033989 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d557faa3-6bfc-4749-abaa-9ec18b806abc None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:18:40.035711 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 648/1306] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:18:40 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:18:40.042007 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e6ec8-40f0-4650-a9d7-a37895051a36 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:18:40.043065 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e6ec8-40f0-4650-a9d7-a37895051a36 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:18:40.043500 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e6ec8-40f0-4650-a9d7-a37895051a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:18:40.063101 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-c72e6ec8-40f0-4650-a9d7-a37895051a36 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:18:40.063101 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-c72e6ec8-40f0-4650-a9d7-a37895051a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:18:40.073120 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 659/1307] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:18:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:18:40.121475 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d557faa3-6bfc-4749-abaa-9ec18b806abc None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:18:40.162326 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d557faa3-6bfc-4749-abaa-9ec18b806abc None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:18:40.162326 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7c3a85-20c4-473a-8617-bba03991a591 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3417097a280b499086b36df9a2548239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:18:40.162326 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c3a85-20c4-473a-8617-bba03991a591 service nova] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:18:40.162326 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c3a85-20c4-473a-8617-bba03991a591 service nova] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:18:40.163174 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c3a85-20c4-473a-8617-bba03991a591 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:18:40.163174 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7c3a85-20c4-473a-8617-bba03991a591 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:18:40.166505 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7c3a85-20c4-473a-8617-bba03991a591 service nova] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:18:40.195931 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 649/1308] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:18:40 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:18:43.467673 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c8bf96-a34d-4b85-8c62-8881daf51e32 None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:18:43.468262 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c8bf96-a34d-4b85-8c62-8881daf51e32 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:18:43.468262 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c8bf96-a34d-4b85-8c62-8881daf51e32 None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:18:43.470415 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 660/1309] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:18:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:18:43.477010 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e18733-dc5b-4f6b-b71c-bcc6287bdec1 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:18:43.477512 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e18733-dc5b-4f6b-b71c-bcc6287bdec1 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:18:43.477700 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e18733-dc5b-4f6b-b71c-bcc6287bdec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:18:43.496130 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-59e18733-dc5b-4f6b-b71c-bcc6287bdec1 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:18:43.497455 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-59e18733-dc5b-4f6b-b71c-bcc6287bdec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:18:43.507435 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 650/1310] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:18:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:18:43.554489 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c8bf96-a34d-4b85-8c62-8881daf51e32 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:18:43.570070 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c8bf96-a34d-4b85-8c62-8881daf51e32 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:18:43.575758 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee3f9e3-8d21-4c97-8c4c-4262e9cfb728 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3417097a280b499086b36df9a2548239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:18:43.576426 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee3f9e3-8d21-4c97-8c4c-4262e9cfb728 service nova] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:18:43.576713 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee3f9e3-8d21-4c97-8c4c-4262e9cfb728 service nova] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:18:43.576990 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee3f9e3-8d21-4c97-8c4c-4262e9cfb728 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:18:43.586490 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee3f9e3-8d21-4c97-8c4c-4262e9cfb728 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:18:43.588095 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee3f9e3-8d21-4c97-8c4c-4262e9cfb728 service nova] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:18:43.597935 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 661/1311] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:18:43 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:18:57.096239 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e00785-a3df-4dd3-a3d3-6da7a193d49f None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:18:57.097094 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e00785-a3df-4dd3-a3d3-6da7a193d49f None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:18:57.097281 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e00785-a3df-4dd3-a3d3-6da7a193d49f None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:18:57.099120 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 651/1312] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:18:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:18:57.105308 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f038e2aa-a355-43c4-9470-e95a5b0a4b0c None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:18:57.105745 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f038e2aa-a355-43c4-9470-e95a5b0a4b0c None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:18:57.105864 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f038e2aa-a355-43c4-9470-e95a5b0a4b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:18:57.123481 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-f038e2aa-a355-43c4-9470-e95a5b0a4b0c None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:18:57.124718 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-f038e2aa-a355-43c4-9470-e95a5b0a4b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:18:57.133440 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 662/1313] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:18:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:18:57.158950 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e00785-a3df-4dd3-a3d3-6da7a193d49f None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:18:57.171367 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e00785-a3df-4dd3-a3d3-6da7a193d49f None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:18:57.175850 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ff541c-4ee6-49ef-b111-65182a0e276b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:18:57.176523 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff541c-4ee6-49ef-b111-65182a0e276b admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:18:57.176806 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff541c-4ee6-49ef-b111-65182a0e276b admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:18:57.177199 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff541c-4ee6-49ef-b111-65182a0e276b admin admin] PATH_INFO: `/v3/projects` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:18:57.177940 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ff541c-4ee6-49ef-b111-65182a0e276b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:18:57.179789 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ff541c-4ee6-49ef-b111-65182a0e276b admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:18:57.198750 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 652/1314] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 12 18:18:57 2021] GET /identity/v3/projects => generated 2553 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:18:59.416366 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbdca5c-d7b7-4275-abae-ca70e80fa965 None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:18:59.417011 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbdca5c-d7b7-4275-abae-ca70e80fa965 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:18:59.417011 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbdca5c-d7b7-4275-abae-ca70e80fa965 None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:18:59.418747 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 663/1315] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:18:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:18:59.424942 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d63c2c2-3829-4ec2-9ce9-5831543c85fe None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:18:59.425425 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d63c2c2-3829-4ec2-9ce9-5831543c85fe None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:18:59.425527 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d63c2c2-3829-4ec2-9ce9-5831543c85fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:18:59.444835 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-3d63c2c2-3829-4ec2-9ce9-5831543c85fe None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:18:59.446046 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-3d63c2c2-3829-4ec2-9ce9-5831543c85fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:18:59.453917 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 653/1316] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:18:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:18:59.478401 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbdca5c-d7b7-4275-abae-ca70e80fa965 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:18:59.491313 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbdca5c-d7b7-4275-abae-ca70e80fa965 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:18:59.495742 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032acb66-b029-488b-9e29-7cf68eb989b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:18:59.496658 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032acb66-b029-488b-9e29-7cf68eb989b9 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:18:59.496884 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032acb66-b029-488b-9e29-7cf68eb989b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:18:59.497196 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032acb66-b029-488b-9e29-7cf68eb989b9 admin admin] PATH_INFO: `/v3/projects/1065667c5e62410e8db95ee2e1b98135` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:18:59.508190 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032acb66-b029-488b-9e29-7cf68eb989b9 admin admin] RBAC: Authorizing `identity:get_project(project_id=1065667c5e62410e8db95ee2e1b98135)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:18:59.511079 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032acb66-b029-488b-9e29-7cf68eb989b9 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:18:59.512889 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 664/1317] 10.222.0.18 () {56 vars in 1207 bytes} [Tue Oct 12 18:18:59 2021] GET /identity/v3/projects/1065667c5e62410e8db95ee2e1b98135 => generated 298 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:18:59.519631 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d63c2c2-3829-4ec2-9ce9-5831543c85fe None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:18:59.529063 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d63c2c2-3829-4ec2-9ce9-5831543c85fe None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:18:59.533746 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79953211-799a-40ea-923e-222faae191ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:18:59.534390 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79953211-799a-40ea-923e-222faae191ed admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:18:59.534668 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79953211-799a-40ea-923e-222faae191ed admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:18:59.534936 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79953211-799a-40ea-923e-222faae191ed admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:18:59.535710 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79953211-799a-40ea-923e-222faae191ed admin admin] RBAC: Adding query filter params (scope.project.id=1065667c5e62410e8db95ee2e1b98135) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:18:59.536010 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79953211-799a-40ea-923e-222faae191ed admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:18:59.537909 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79953211-799a-40ea-923e-222faae191ed admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:18:59.545862 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 654/1318] 10.222.0.18 () {56 vars in 1231 bytes} [Tue Oct 12 18:18:59 2021] GET /identity/v3/role_assignments?scope.project.id=1065667c5e62410e8db95ee2e1b98135 => generated 1934 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:18:59.552977 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032acb66-b029-488b-9e29-7cf68eb989b9 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:18:59.563107 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032acb66-b029-488b-9e29-7cf68eb989b9 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:18:59.568277 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9842cef8-d7b0-4040-ab76-8e7d2ab4647d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:18:59.569195 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9842cef8-d7b0-4040-ab76-8e7d2ab4647d admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:18:59.569454 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9842cef8-d7b0-4040-ab76-8e7d2ab4647d admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:18:59.569727 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9842cef8-d7b0-4040-ab76-8e7d2ab4647d admin admin] PATH_INFO: `/v3/users/f7cf3b0b3886414d8205a6258403e8e2` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:18:59.583757 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9842cef8-d7b0-4040-ab76-8e7d2ab4647d admin admin] RBAC: Authorizing `identity:get_user(user_id=f7cf3b0b3886414d8205a6258403e8e2)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:18:59.585934 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9842cef8-d7b0-4040-ab76-8e7d2ab4647d admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:18:59.587653 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 665/1319] 10.222.0.18 () {56 vars in 1198 bytes} [Tue Oct 12 18:18:59 2021] GET /identity/v3/users/f7cf3b0b3886414d8205a6258403e8e2 => generated 275 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:18:59.594135 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79953211-799a-40ea-923e-222faae191ed admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:18:59.604060 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79953211-799a-40ea-923e-222faae191ed admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:18:59.608808 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3baefff-77e7-4f25-b36a-8664d085263a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:18:59.609673 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3baefff-77e7-4f25-b36a-8664d085263a admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:18:59.609952 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3baefff-77e7-4f25-b36a-8664d085263a admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:18:59.610224 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3baefff-77e7-4f25-b36a-8664d085263a admin admin] PATH_INFO: `/v3/users/31651079c8d04df8a5fb70d40851475c` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:18:59.611438 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3baefff-77e7-4f25-b36a-8664d085263a admin admin] RBAC: Authorizing `identity:get_user(user_id=31651079c8d04df8a5fb70d40851475c)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:18:59.613295 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3baefff-77e7-4f25-b36a-8664d085263a admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:18:59.615436 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 655/1320] 10.222.0.18 () {56 vars in 1198 bytes} [Tue Oct 12 18:18:59 2021] GET /identity/v3/users/31651079c8d04df8a5fb70d40851475c => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:19:01.995526 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8231b74-bbc0-47ef-b5d8-9a4440e14f78 None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:01.996089 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8231b74-bbc0-47ef-b5d8-9a4440e14f78 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:01.996089 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8231b74-bbc0-47ef-b5d8-9a4440e14f78 None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:01.997865 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 666/1321] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:19:01 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:19:02.004722 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c2257-2b92-465f-9e1c-d8d89e667620 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:02.005215 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c2257-2b92-465f-9e1c-d8d89e667620 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:02.005309 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c2257-2b92-465f-9e1c-d8d89e667620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:02.023556 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-3f0c2257-2b92-465f-9e1c-d8d89e667620 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:19:02.024782 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-3f0c2257-2b92-465f-9e1c-d8d89e667620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:19:02.032544 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 656/1322] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:19:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:19:02.057542 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8231b74-bbc0-47ef-b5d8-9a4440e14f78 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:19:02.078079 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8231b74-bbc0-47ef-b5d8-9a4440e14f78 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:19:02.082507 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ca8a09-2428-49ea-bf77-9c17e5cedc28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:19:02.083342 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca8a09-2428-49ea-bf77-9c17e5cedc28 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:02.083617 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca8a09-2428-49ea-bf77-9c17e5cedc28 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:02.083885 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca8a09-2428-49ea-bf77-9c17e5cedc28 admin admin] PATH_INFO: `/v3/projects/3d16c56719034966bc6ffb0bd9ef6a88` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:02.094691 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ca8a09-2428-49ea-bf77-9c17e5cedc28 admin admin] RBAC: Authorizing `identity:get_project(project_id=3d16c56719034966bc6ffb0bd9ef6a88)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:19:02.096802 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ca8a09-2428-49ea-bf77-9c17e5cedc28 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:19:02.099097 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 667/1323] 10.222.0.18 () {56 vars in 1207 bytes} [Tue Oct 12 18:19:02 2021] GET /identity/v3/projects/3d16c56719034966bc6ffb0bd9ef6a88 => generated 311 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:19:02.105912 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0c2257-2b92-465f-9e1c-d8d89e667620 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:19:02.115554 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0c2257-2b92-465f-9e1c-d8d89e667620 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:19:02.120089 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1644e0e9-764f-4eaf-b57a-0b5d9433ac1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:19:02.120772 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1644e0e9-764f-4eaf-b57a-0b5d9433ac1f admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:02.121045 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1644e0e9-764f-4eaf-b57a-0b5d9433ac1f admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:02.121313 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1644e0e9-764f-4eaf-b57a-0b5d9433ac1f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:02.122117 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1644e0e9-764f-4eaf-b57a-0b5d9433ac1f admin admin] RBAC: Adding query filter params (scope.project.id=3d16c56719034966bc6ffb0bd9ef6a88) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:19:02.122407 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1644e0e9-764f-4eaf-b57a-0b5d9433ac1f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:19:02.124245 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1644e0e9-764f-4eaf-b57a-0b5d9433ac1f admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:19:02.130282 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 657/1324] 10.222.0.18 () {56 vars in 1231 bytes} [Tue Oct 12 18:19:02 2021] GET /identity/v3/role_assignments?scope.project.id=3d16c56719034966bc6ffb0bd9ef6a88 => generated 877 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:19:02.137010 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ca8a09-2428-49ea-bf77-9c17e5cedc28 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:19:02.147204 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ca8a09-2428-49ea-bf77-9c17e5cedc28 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:19:02.151828 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bb23a5-0f67-4830-9ffb-ab611a89533c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:19:02.152728 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb23a5-0f67-4830-9ffb-ab611a89533c admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:02.153029 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb23a5-0f67-4830-9ffb-ab611a89533c admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:02.153291 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb23a5-0f67-4830-9ffb-ab611a89533c admin admin] PATH_INFO: `/v3/users/b7e0d3627d9e46f18ac8313af9a6f39c` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:02.168538 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bb23a5-0f67-4830-9ffb-ab611a89533c admin admin] RBAC: Authorizing `identity:get_user(user_id=b7e0d3627d9e46f18ac8313af9a6f39c)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:19:02.170637 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bb23a5-0f67-4830-9ffb-ab611a89533c admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:19:02.172369 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 668/1325] 10.222.0.18 () {56 vars in 1198 bytes} [Tue Oct 12 18:19:02 2021] GET /identity/v3/users/b7e0d3627d9e46f18ac8313af9a6f39c => generated 286 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:19:02.179426 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1644e0e9-764f-4eaf-b57a-0b5d9433ac1f admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:19:02.189297 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1644e0e9-764f-4eaf-b57a-0b5d9433ac1f admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:19:02.193785 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd9a2f8-aa31-4027-8e89-d49658fa800f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:19:02.194639 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd9a2f8-aa31-4027-8e89-d49658fa800f admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:02.194915 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd9a2f8-aa31-4027-8e89-d49658fa800f admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:02.195183 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd9a2f8-aa31-4027-8e89-d49658fa800f admin admin] PATH_INFO: `/v3/users/cd82e48799464251a0b9b7bee15b43d8` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:02.208795 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd9a2f8-aa31-4027-8e89-d49658fa800f admin admin] RBAC: Authorizing `identity:get_user(user_id=cd82e48799464251a0b9b7bee15b43d8)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:19:02.211070 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd9a2f8-aa31-4027-8e89-d49658fa800f admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:19:02.212937 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 658/1326] 10.222.0.18 () {56 vars in 1198 bytes} [Tue Oct 12 18:19:02 2021] GET /identity/v3/users/cd82e48799464251a0b9b7bee15b43d8 => generated 285 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:19:04.567306 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb4d3ac-d27a-43bf-93ee-e88dc71849a6 None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:04.567877 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb4d3ac-d27a-43bf-93ee-e88dc71849a6 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:04.567877 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb4d3ac-d27a-43bf-93ee-e88dc71849a6 None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:04.569630 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 669/1327] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:19:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:19:04.576094 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc89b9f7-5a6b-4147-b820-af984c0e89f2 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:04.576564 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc89b9f7-5a6b-4147-b820-af984c0e89f2 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:04.576706 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc89b9f7-5a6b-4147-b820-af984c0e89f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:04.595310 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-cc89b9f7-5a6b-4147-b820-af984c0e89f2 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:19:04.596552 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-cc89b9f7-5a6b-4147-b820-af984c0e89f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:19:04.604518 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 659/1328] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:19:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:19:04.630107 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb4d3ac-d27a-43bf-93ee-e88dc71849a6 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:19:04.642547 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb4d3ac-d27a-43bf-93ee-e88dc71849a6 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:19:04.647985 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4fafc4-1fc2-4a1b-8286-b6bf0357dda7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:19:04.648945 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4fafc4-1fc2-4a1b-8286-b6bf0357dda7 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:04.649596 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4fafc4-1fc2-4a1b-8286-b6bf0357dda7 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:04.649596 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4fafc4-1fc2-4a1b-8286-b6bf0357dda7 admin admin] PATH_INFO: `/v3/projects/67ff77f836454a978a72b88b0a6c417d` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:04.659843 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4fafc4-1fc2-4a1b-8286-b6bf0357dda7 admin admin] RBAC: Authorizing `identity:get_project(project_id=67ff77f836454a978a72b88b0a6c417d)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:19:04.661993 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4fafc4-1fc2-4a1b-8286-b6bf0357dda7 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:19:04.663749 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 670/1329] 10.222.0.18 () {56 vars in 1207 bytes} [Tue Oct 12 18:19:04 2021] GET /identity/v3/projects/67ff77f836454a978a72b88b0a6c417d => generated 361 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:19:04.670727 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc89b9f7-5a6b-4147-b820-af984c0e89f2 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:19:04.680016 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc89b9f7-5a6b-4147-b820-af984c0e89f2 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:19:04.684618 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e6c9eb-8acc-4d5c-8701-8cfdfd0494b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:19:04.685260 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e6c9eb-8acc-4d5c-8701-8cfdfd0494b1 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:04.685538 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e6c9eb-8acc-4d5c-8701-8cfdfd0494b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:04.685809 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e6c9eb-8acc-4d5c-8701-8cfdfd0494b1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:04.686612 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e6c9eb-8acc-4d5c-8701-8cfdfd0494b1 admin admin] RBAC: Adding query filter params (scope.project.id=67ff77f836454a978a72b88b0a6c417d) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:19:04.686912 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e6c9eb-8acc-4d5c-8701-8cfdfd0494b1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:19:04.688794 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e6c9eb-8acc-4d5c-8701-8cfdfd0494b1 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:19:04.695032 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 660/1330] 10.222.0.18 () {56 vars in 1231 bytes} [Tue Oct 12 18:19:04 2021] GET /identity/v3/role_assignments?scope.project.id=67ff77f836454a978a72b88b0a6c417d => generated 526 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:19:04.701594 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4fafc4-1fc2-4a1b-8286-b6bf0357dda7 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:19:04.712035 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4fafc4-1fc2-4a1b-8286-b6bf0357dda7 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:19:04.716670 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f615b6d1-c20e-4665-a8a3-92fd440e44cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:19:04.717527 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f615b6d1-c20e-4665-a8a3-92fd440e44cc admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:04.717804 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f615b6d1-c20e-4665-a8a3-92fd440e44cc admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:04.718076 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f615b6d1-c20e-4665-a8a3-92fd440e44cc admin admin] PATH_INFO: `/v3/users/8acc6f35e1414692a8a2b35792bb5350` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:04.732280 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f615b6d1-c20e-4665-a8a3-92fd440e44cc admin admin] RBAC: Authorizing `identity:get_user(user_id=8acc6f35e1414692a8a2b35792bb5350)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:19:04.734455 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f615b6d1-c20e-4665-a8a3-92fd440e44cc admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:19:04.736147 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 671/1331] 10.222.0.18 () {56 vars in 1198 bytes} [Tue Oct 12 18:19:04 2021] GET /identity/v3/users/8acc6f35e1414692a8a2b35792bb5350 => generated 311 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:19:07.060355 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f34d7-dcf8-4c44-b538-c4b9a8dbb520 None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:07.060957 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f34d7-dcf8-4c44-b538-c4b9a8dbb520 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:07.060957 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f34d7-dcf8-4c44-b538-c4b9a8dbb520 None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:07.062978 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 661/1332] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:19:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:19:07.069446 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10d0a6-f2e8-44fc-a1d2-4983eb615204 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:07.069937 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10d0a6-f2e8-44fc-a1d2-4983eb615204 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:07.070039 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10d0a6-f2e8-44fc-a1d2-4983eb615204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:07.088102 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-ef10d0a6-f2e8-44fc-a1d2-4983eb615204 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:19:07.089317 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-ef10d0a6-f2e8-44fc-a1d2-4983eb615204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:19:07.097053 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 672/1333] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:19:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:19:07.122133 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570f34d7-dcf8-4c44-b538-c4b9a8dbb520 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:19:07.137077 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570f34d7-dcf8-4c44-b538-c4b9a8dbb520 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:19:07.141637 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5117623-2f84-4d66-a89b-4da6105ec869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:19:07.142502 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5117623-2f84-4d66-a89b-4da6105ec869 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:07.142782 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5117623-2f84-4d66-a89b-4da6105ec869 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:07.143055 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5117623-2f84-4d66-a89b-4da6105ec869 admin admin] PATH_INFO: `/v3/projects/93e289af362942d0b18d319165d0e31e` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:07.158652 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5117623-2f84-4d66-a89b-4da6105ec869 admin admin] RBAC: Authorizing `identity:get_project(project_id=93e289af362942d0b18d319165d0e31e)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:19:07.162568 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5117623-2f84-4d66-a89b-4da6105ec869 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:19:07.163199 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 662/1334] 10.222.0.18 () {56 vars in 1207 bytes} [Tue Oct 12 18:19:07 2021] GET /identity/v3/projects/93e289af362942d0b18d319165d0e31e => generated 312 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:19:07.170013 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef10d0a6-f2e8-44fc-a1d2-4983eb615204 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:19:07.179242 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef10d0a6-f2e8-44fc-a1d2-4983eb615204 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:19:07.183855 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca82c6a-70fa-4ab5-bd0c-1a09371ea0f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:19:07.184567 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca82c6a-70fa-4ab5-bd0c-1a09371ea0f9 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:07.184850 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca82c6a-70fa-4ab5-bd0c-1a09371ea0f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:07.185118 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca82c6a-70fa-4ab5-bd0c-1a09371ea0f9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:07.185893 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca82c6a-70fa-4ab5-bd0c-1a09371ea0f9 admin admin] RBAC: Adding query filter params (scope.project.id=93e289af362942d0b18d319165d0e31e) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:19:07.186194 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca82c6a-70fa-4ab5-bd0c-1a09371ea0f9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:19:07.188040 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca82c6a-70fa-4ab5-bd0c-1a09371ea0f9 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:19:07.195129 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 673/1335] 10.222.0.18 () {56 vars in 1231 bytes} [Tue Oct 12 18:19:07 2021] GET /identity/v3/role_assignments?scope.project.id=93e289af362942d0b18d319165d0e31e => generated 526 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:19:07.202142 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5117623-2f84-4d66-a89b-4da6105ec869 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:19:07.212730 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5117623-2f84-4d66-a89b-4da6105ec869 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:19:07.217759 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680e2319-383c-4b1b-8d02-71be49013a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:19:07.218658 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e2319-383c-4b1b-8d02-71be49013a46 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:07.218936 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e2319-383c-4b1b-8d02-71be49013a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:07.219211 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e2319-383c-4b1b-8d02-71be49013a46 admin admin] PATH_INFO: `/v3/users/f7cf3b0b3886414d8205a6258403e8e2` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:07.220468 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680e2319-383c-4b1b-8d02-71be49013a46 admin admin] RBAC: Authorizing `identity:get_user(user_id=f7cf3b0b3886414d8205a6258403e8e2)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:19:07.241816 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680e2319-383c-4b1b-8d02-71be49013a46 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:19:07.241816 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 663/1336] 10.222.0.18 () {56 vars in 1198 bytes} [Tue Oct 12 18:19:07 2021] GET /identity/v3/users/f7cf3b0b3886414d8205a6258403e8e2 => generated 275 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:19:09.539105 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6391b18-f0df-4362-9dd1-2e96c2c0a157 None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:09.539709 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6391b18-f0df-4362-9dd1-2e96c2c0a157 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:09.539709 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6391b18-f0df-4362-9dd1-2e96c2c0a157 None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:09.541454 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 674/1337] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:19:09 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:19:09.548115 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8499b-195e-4971-8d97-4750f0fd2c21 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:09.548617 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8499b-195e-4971-8d97-4750f0fd2c21 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:09.548710 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8499b-195e-4971-8d97-4750f0fd2c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:09.566419 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-a1a8499b-195e-4971-8d97-4750f0fd2c21 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:19:09.567614 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-a1a8499b-195e-4971-8d97-4750f0fd2c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:19:09.575792 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 664/1338] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:19:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:19:09.601445 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6391b18-f0df-4362-9dd1-2e96c2c0a157 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:19:09.614360 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6391b18-f0df-4362-9dd1-2e96c2c0a157 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:19:09.619381 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5265b76f-7327-4870-9849-5b0a10fe2449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:19:09.620249 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5265b76f-7327-4870-9849-5b0a10fe2449 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:09.620561 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5265b76f-7327-4870-9849-5b0a10fe2449 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:09.620834 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5265b76f-7327-4870-9849-5b0a10fe2449 admin admin] PATH_INFO: `/v3/projects/d8f9072509b7489eba91457dfb47e439` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:09.633691 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5265b76f-7327-4870-9849-5b0a10fe2449 admin admin] RBAC: Authorizing `identity:get_project(project_id=d8f9072509b7489eba91457dfb47e439)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:19:09.635786 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5265b76f-7327-4870-9849-5b0a10fe2449 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:19:09.637605 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 675/1339] 10.222.0.18 () {56 vars in 1207 bytes} [Tue Oct 12 18:19:09 2021] GET /identity/v3/projects/d8f9072509b7489eba91457dfb47e439 => generated 302 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:19:09.645028 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a8499b-195e-4971-8d97-4750f0fd2c21 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:19:09.654557 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a8499b-195e-4971-8d97-4750f0fd2c21 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:19:09.659232 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb1079a-c32b-4bf3-b0fc-8bd94b485b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:19:09.662235 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1079a-c32b-4bf3-b0fc-8bd94b485b35 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:09.662235 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1079a-c32b-4bf3-b0fc-8bd94b485b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:09.662235 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1079a-c32b-4bf3-b0fc-8bd94b485b35 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:09.662235 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb1079a-c32b-4bf3-b0fc-8bd94b485b35 admin admin] RBAC: Adding query filter params (scope.project.id=d8f9072509b7489eba91457dfb47e439) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:19:09.662235 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb1079a-c32b-4bf3-b0fc-8bd94b485b35 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:19:09.663441 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb1079a-c32b-4bf3-b0fc-8bd94b485b35 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:19:09.670448 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 665/1340] 10.222.0.18 () {56 vars in 1231 bytes} [Tue Oct 12 18:19:09 2021] GET /identity/v3/role_assignments?scope.project.id=d8f9072509b7489eba91457dfb47e439 => generated 1934 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:19:09.677083 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5265b76f-7327-4870-9849-5b0a10fe2449 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:19:09.686947 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5265b76f-7327-4870-9849-5b0a10fe2449 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:19:09.692005 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cdb7ee-59dc-49ba-9b02-04eee7339530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:19:09.692885 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cdb7ee-59dc-49ba-9b02-04eee7339530 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:09.693163 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cdb7ee-59dc-49ba-9b02-04eee7339530 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:09.693430 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cdb7ee-59dc-49ba-9b02-04eee7339530 admin admin] PATH_INFO: `/v3/users/b8f935bd2a784b8d8c0b396f1556b5f5` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:09.707668 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cdb7ee-59dc-49ba-9b02-04eee7339530 admin admin] RBAC: Authorizing `identity:get_user(user_id=b8f935bd2a784b8d8c0b396f1556b5f5)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:19:09.710019 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cdb7ee-59dc-49ba-9b02-04eee7339530 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:19:09.711700 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 676/1341] 10.222.0.18 () {56 vars in 1198 bytes} [Tue Oct 12 18:19:09 2021] GET /identity/v3/users/b8f935bd2a784b8d8c0b396f1556b5f5 => generated 283 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:19:09.718271 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb1079a-c32b-4bf3-b0fc-8bd94b485b35 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:19:09.727952 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb1079a-c32b-4bf3-b0fc-8bd94b485b35 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:19:09.732467 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf96b55e-fc97-4186-bd46-fb047dbeb0c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:19:09.733309 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96b55e-fc97-4186-bd46-fb047dbeb0c7 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:09.733583 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96b55e-fc97-4186-bd46-fb047dbeb0c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:09.733853 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96b55e-fc97-4186-bd46-fb047dbeb0c7 admin admin] PATH_INFO: `/v3/users/31651079c8d04df8a5fb70d40851475c` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:09.735031 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf96b55e-fc97-4186-bd46-fb047dbeb0c7 admin admin] RBAC: Authorizing `identity:get_user(user_id=31651079c8d04df8a5fb70d40851475c)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:19:09.736858 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf96b55e-fc97-4186-bd46-fb047dbeb0c7 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:19:09.738416 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 666/1342] 10.222.0.18 () {56 vars in 1198 bytes} [Tue Oct 12 18:19:09 2021] GET /identity/v3/users/31651079c8d04df8a5fb70d40851475c => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:19:12.130201 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15132a33-4d14-4f2b-841c-f3c6abf1e916 None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:12.130844 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15132a33-4d14-4f2b-841c-f3c6abf1e916 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:12.130844 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15132a33-4d14-4f2b-841c-f3c6abf1e916 None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:12.132543 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 677/1343] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:19:12 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:19:12.138785 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bcf977-98c4-4371-8de0-634369d3d8f6 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:12.139284 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bcf977-98c4-4371-8de0-634369d3d8f6 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:12.139386 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bcf977-98c4-4371-8de0-634369d3d8f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:12.157993 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-03bcf977-98c4-4371-8de0-634369d3d8f6 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:19:12.159208 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-03bcf977-98c4-4371-8de0-634369d3d8f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:19:12.167946 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 667/1344] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:19:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:19:12.192512 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15132a33-4d14-4f2b-841c-f3c6abf1e916 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:19:12.205108 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15132a33-4d14-4f2b-841c-f3c6abf1e916 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:19:12.209741 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ac9390-15ba-4bcd-831e-9a1126d9c8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:19:12.210575 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ac9390-15ba-4bcd-831e-9a1126d9c8e8 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:12.211118 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ac9390-15ba-4bcd-831e-9a1126d9c8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:12.211444 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ac9390-15ba-4bcd-831e-9a1126d9c8e8 admin admin] PATH_INFO: `/v3/projects/e340b2a295714eb294f0cebe48fde56d` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:12.212645 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ac9390-15ba-4bcd-831e-9a1126d9c8e8 admin admin] RBAC: Authorizing `identity:get_project(project_id=e340b2a295714eb294f0cebe48fde56d)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:19:12.214514 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ac9390-15ba-4bcd-831e-9a1126d9c8e8 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:19:12.216518 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 678/1345] 10.222.0.18 () {56 vars in 1207 bytes} [Tue Oct 12 18:19:12 2021] GET /identity/v3/projects/e340b2a295714eb294f0cebe48fde56d => generated 344 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:19:12.223844 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bcf977-98c4-4371-8de0-634369d3d8f6 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:19:12.233092 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bcf977-98c4-4371-8de0-634369d3d8f6 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:19:12.237706 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580be3ab-9d0f-43ac-957f-f1709a962c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:19:12.238950 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580be3ab-9d0f-43ac-957f-f1709a962c87 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:12.239229 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580be3ab-9d0f-43ac-957f-f1709a962c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:12.239497 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580be3ab-9d0f-43ac-957f-f1709a962c87 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:12.240296 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580be3ab-9d0f-43ac-957f-f1709a962c87 admin admin] RBAC: Adding query filter params (scope.project.id=e340b2a295714eb294f0cebe48fde56d) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:19:12.240631 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580be3ab-9d0f-43ac-957f-f1709a962c87 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:19:12.242685 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580be3ab-9d0f-43ac-957f-f1709a962c87 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:19:12.249811 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 668/1346] 10.222.0.18 () {56 vars in 1231 bytes} [Tue Oct 12 18:19:12 2021] GET /identity/v3/role_assignments?scope.project.id=e340b2a295714eb294f0cebe48fde56d => generated 879 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:19:12.255751 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ac9390-15ba-4bcd-831e-9a1126d9c8e8 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:19:12.265856 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ac9390-15ba-4bcd-831e-9a1126d9c8e8 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:19:12.270959 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390b4d12-acd5-4e25-bca1-b8a16049835a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:19:12.272079 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390b4d12-acd5-4e25-bca1-b8a16049835a admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:12.272357 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390b4d12-acd5-4e25-bca1-b8a16049835a admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:12.272680 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390b4d12-acd5-4e25-bca1-b8a16049835a admin admin] PATH_INFO: `/v3/users/31651079c8d04df8a5fb70d40851475c` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:12.273889 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390b4d12-acd5-4e25-bca1-b8a16049835a admin admin] RBAC: Authorizing `identity:get_user(user_id=31651079c8d04df8a5fb70d40851475c)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:19:12.275718 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390b4d12-acd5-4e25-bca1-b8a16049835a admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:19:12.277387 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 679/1347] 10.222.0.18 () {56 vars in 1198 bytes} [Tue Oct 12 18:19:12 2021] GET /identity/v3/users/31651079c8d04df8a5fb70d40851475c => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:19:14.569625 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d258317-760c-4a52-a65c-56e46988b9c1 None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:14.570289 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d258317-760c-4a52-a65c-56e46988b9c1 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:14.570289 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d258317-760c-4a52-a65c-56e46988b9c1 None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:14.571987 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 669/1348] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:19:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:19:14.578954 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee81bc-9fc4-470c-918b-4d5f37aa5516 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:14.579440 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee81bc-9fc4-470c-918b-4d5f37aa5516 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:14.579782 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee81bc-9fc4-470c-918b-4d5f37aa5516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:14.597852 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-f8ee81bc-9fc4-470c-918b-4d5f37aa5516 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:19:14.599070 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-f8ee81bc-9fc4-470c-918b-4d5f37aa5516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:19:14.608764 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 680/1349] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:19:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:19:14.633582 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d258317-760c-4a52-a65c-56e46988b9c1 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:19:14.646003 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d258317-760c-4a52-a65c-56e46988b9c1 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:19:14.651169 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667f9665-4ccc-4031-baab-f61131347855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:19:14.652107 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f9665-4ccc-4031-baab-f61131347855 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:14.652385 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f9665-4ccc-4031-baab-f61131347855 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:14.652686 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f9665-4ccc-4031-baab-f61131347855 admin admin] PATH_INFO: `/v3/projects/e89512133bbe4e5f96bbe98dfb380a3c` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:14.663962 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667f9665-4ccc-4031-baab-f61131347855 admin admin] RBAC: Authorizing `identity:get_project(project_id=e89512133bbe4e5f96bbe98dfb380a3c)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:19:14.666059 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667f9665-4ccc-4031-baab-f61131347855 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:19:14.667864 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 670/1350] 10.222.0.18 () {56 vars in 1207 bytes} [Tue Oct 12 18:19:14 2021] GET /identity/v3/projects/e89512133bbe4e5f96bbe98dfb380a3c => generated 311 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:19:14.674736 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ee81bc-9fc4-470c-918b-4d5f37aa5516 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:19:14.684413 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ee81bc-9fc4-470c-918b-4d5f37aa5516 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:19:14.689238 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa04f570-b2f8-4c50-8e75-6f84cdf4cae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:19:14.689919 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa04f570-b2f8-4c50-8e75-6f84cdf4cae2 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:14.690195 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa04f570-b2f8-4c50-8e75-6f84cdf4cae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:14.690495 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa04f570-b2f8-4c50-8e75-6f84cdf4cae2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:14.691934 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa04f570-b2f8-4c50-8e75-6f84cdf4cae2 admin admin] RBAC: Adding query filter params (scope.project.id=e89512133bbe4e5f96bbe98dfb380a3c) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:19:14.692239 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa04f570-b2f8-4c50-8e75-6f84cdf4cae2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:19:14.694206 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa04f570-b2f8-4c50-8e75-6f84cdf4cae2 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:19:14.700112 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 681/1351] 10.222.0.18 () {56 vars in 1231 bytes} [Tue Oct 12 18:19:14 2021] GET /identity/v3/role_assignments?scope.project.id=e89512133bbe4e5f96bbe98dfb380a3c => generated 526 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:19:14.706910 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667f9665-4ccc-4031-baab-f61131347855 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:19:14.716950 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667f9665-4ccc-4031-baab-f61131347855 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:19:14.721483 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0dac60-3e80-481c-b708-893b62c78233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:19:14.722375 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0dac60-3e80-481c-b708-893b62c78233 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:14.722657 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0dac60-3e80-481c-b708-893b62c78233 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:14.722928 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0dac60-3e80-481c-b708-893b62c78233 admin admin] PATH_INFO: `/v3/users/2e14365ac57349aca2057e7383679b46` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:14.737582 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0dac60-3e80-481c-b708-893b62c78233 admin admin] RBAC: Authorizing `identity:get_user(user_id=2e14365ac57349aca2057e7383679b46)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:19:14.741315 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0dac60-3e80-481c-b708-893b62c78233 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:19:14.743037 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 671/1352] 10.222.0.18 () {56 vars in 1198 bytes} [Tue Oct 12 18:19:14 2021] GET /identity/v3/users/2e14365ac57349aca2057e7383679b46 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:19:20.153800 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a2afb-f7fd-4c77-a3bf-41f16cc6138b None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:20.154370 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a2afb-f7fd-4c77-a3bf-41f16cc6138b None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:20.154370 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a2afb-f7fd-4c77-a3bf-41f16cc6138b None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:20.156115 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 682/1353] 10.222.0.18 () {54 vars in 918 bytes} [Tue Oct 12 18:19:20 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:19:20.162102 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d332b005-c1ad-4218-a951-e55407a9173f None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:20.162570 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d332b005-c1ad-4218-a951-e55407a9173f None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:20.162679 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d332b005-c1ad-4218-a951-e55407a9173f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:20.180109 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-d332b005-c1ad-4218-a951-e55407a9173f None None] MFA Rules not processed for user `4bd99e4f2d444a388ecde7ea3cb61089`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:19:20.181254 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-d332b005-c1ad-4218-a951-e55407a9173f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:19:20.190174 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 672/1354] 10.222.0.18 () {58 vars in 1015 bytes} [Tue Oct 12 18:19:20 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:19:20.207374 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4521b9af-f3f5-4032-a112-8fe5346df8c9 None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:20.207665 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4521b9af-f3f5-4032-a112-8fe5346df8c9 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:20.207964 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4521b9af-f3f5-4032-a112-8fe5346df8c9 None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:20.209760 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 683/1355] 10.222.0.18 () {54 vars in 918 bytes} [Tue Oct 12 18:19:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:19:20.215366 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248f01f-114f-4bcb-a2c0-194ba336b2c5 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:20.215653 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248f01f-114f-4bcb-a2c0-194ba336b2c5 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:20.215928 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248f01f-114f-4bcb-a2c0-194ba336b2c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:20.234113 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-3248f01f-114f-4bcb-a2c0-194ba336b2c5 None None] MFA Rules not processed for user `3417097a280b499086b36df9a2548239`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:19:20.235307 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-3248f01f-114f-4bcb-a2c0-194ba336b2c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:19:20.248106 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 673/1356] 10.222.0.18 () {58 vars in 1015 bytes} [Tue Oct 12 18:19:20 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:19:23.174918 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7e22e8-1e3d-40f4-83b0-ee04c7c0f26f None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:23.175470 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7e22e8-1e3d-40f4-83b0-ee04c7c0f26f None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:23.175470 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7e22e8-1e3d-40f4-83b0-ee04c7c0f26f None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:23.177288 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 684/1357] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:19:23 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:19:23.183498 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2175a871-0589-4906-8224-5d51c34eba60 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:23.183960 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2175a871-0589-4906-8224-5d51c34eba60 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:23.184068 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2175a871-0589-4906-8224-5d51c34eba60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:23.202350 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-2175a871-0589-4906-8224-5d51c34eba60 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:19:23.203537 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-2175a871-0589-4906-8224-5d51c34eba60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:19:23.212077 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 674/1358] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:19:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:19:23.255942 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7e22e8-1e3d-40f4-83b0-ee04c7c0f26f None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:19:23.270503 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7e22e8-1e3d-40f4-83b0-ee04c7c0f26f None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:19:23.276155 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb4d411-bc19-405d-9486-8fbabf78e889 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3417097a280b499086b36df9a2548239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:19:23.276831 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb4d411-bc19-405d-9486-8fbabf78e889 service nova] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:23.277110 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb4d411-bc19-405d-9486-8fbabf78e889 service nova] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:23.277379 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb4d411-bc19-405d-9486-8fbabf78e889 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:23.285841 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb4d411-bc19-405d-9486-8fbabf78e889 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:19:23.287422 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb4d411-bc19-405d-9486-8fbabf78e889 service nova] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:19:23.297394 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 685/1359] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:19:23 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:19:24.820692 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e7e51a-91f7-4f1e-a194-6022d89b3559 None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:24.821267 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e7e51a-91f7-4f1e-a194-6022d89b3559 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:24.821267 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e7e51a-91f7-4f1e-a194-6022d89b3559 None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:24.823023 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 675/1360] 10.222.0.18 () {54 vars in 911 bytes} [Tue Oct 12 18:19:24 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:19:24.828583 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e70bfc-d72d-4212-9c1e-c1f649598408 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:24.828982 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e70bfc-d72d-4212-9c1e-c1f649598408 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:24.829133 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e70bfc-d72d-4212-9c1e-c1f649598408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:24.847298 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-c1e70bfc-d72d-4212-9c1e-c1f649598408 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:19:24.848535 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-c1e70bfc-d72d-4212-9c1e-c1f649598408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:19:24.856436 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 686/1361] 10.222.0.18 () {58 vars in 1008 bytes} [Tue Oct 12 18:19:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:19:25.009209 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e7e51a-91f7-4f1e-a194-6022d89b3559 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:19:25.023735 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e7e51a-91f7-4f1e-a194-6022d89b3559 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:19:25.029216 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b56a9f-30eb-4fb5-a524-5413e5a34366 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3417097a280b499086b36df9a2548239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:19:25.030000 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b56a9f-30eb-4fb5-a524-5413e5a34366 service nova] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:25.030286 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b56a9f-30eb-4fb5-a524-5413e5a34366 service nova] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:25.030561 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b56a9f-30eb-4fb5-a524-5413e5a34366 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:25.039152 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b56a9f-30eb-4fb5-a524-5413e5a34366 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:19:25.040808 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b56a9f-30eb-4fb5-a524-5413e5a34366 service nova] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:19:25.050871 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 676/1362] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:19:25 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:19:26.539851 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a476e-5a18-4dfc-af45-7fd51552cc04 None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:26.540627 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a476e-5a18-4dfc-af45-7fd51552cc04 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:26.540627 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a476e-5a18-4dfc-af45-7fd51552cc04 None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:26.542197 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 687/1363] 10.222.0.18 () {54 vars in 911 bytes} [Tue Oct 12 18:19:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 18:19:26.548026 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8c4d4-11f4-4d7b-9ae0-83e502a57375 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:26.548454 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8c4d4-11f4-4d7b-9ae0-83e502a57375 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:26.548670 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8c4d4-11f4-4d7b-9ae0-83e502a57375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:26.566344 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-19e8c4d4-11f4-4d7b-9ae0-83e502a57375 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:19:26.567546 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-19e8c4d4-11f4-4d7b-9ae0-83e502a57375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:19:26.575837 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 677/1364] 10.222.0.18 () {58 vars in 1008 bytes} [Tue Oct 12 18:19:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:19:26.732548 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81a476e-5a18-4dfc-af45-7fd51552cc04 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:19:26.747017 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81a476e-5a18-4dfc-af45-7fd51552cc04 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:19:26.752378 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a4864e-a410-4ae3-b4b3-1ee835ca4b60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3417097a280b499086b36df9a2548239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:19:26.753604 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a4864e-a410-4ae3-b4b3-1ee835ca4b60 service nova] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:26.753886 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a4864e-a410-4ae3-b4b3-1ee835ca4b60 service nova] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:26.754159 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a4864e-a410-4ae3-b4b3-1ee835ca4b60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:26.762019 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a4864e-a410-4ae3-b4b3-1ee835ca4b60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:19:26.763595 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a4864e-a410-4ae3-b4b3-1ee835ca4b60 service nova] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:19:26.772945 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 688/1365] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:19:26 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:19:28.244925 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5761c29-c097-47a1-90d4-95e73711ec02 None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:28.245465 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5761c29-c097-47a1-90d4-95e73711ec02 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:28.245465 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5761c29-c097-47a1-90d4-95e73711ec02 None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:28.247189 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 678/1366] 10.222.0.18 () {54 vars in 911 bytes} [Tue Oct 12 18:19:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:19:28.253623 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd9049b-76d0-48cf-a1a8-fd60cb84f0d3 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:28.254088 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd9049b-76d0-48cf-a1a8-fd60cb84f0d3 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:28.254203 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd9049b-76d0-48cf-a1a8-fd60cb84f0d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:28.272591 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-ebd9049b-76d0-48cf-a1a8-fd60cb84f0d3 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:19:28.273817 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-ebd9049b-76d0-48cf-a1a8-fd60cb84f0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:19:28.281745 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 689/1367] 10.222.0.18 () {58 vars in 1008 bytes} [Tue Oct 12 18:19:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:19:28.447303 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5761c29-c097-47a1-90d4-95e73711ec02 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:19:28.461878 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5761c29-c097-47a1-90d4-95e73711ec02 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:19:28.467687 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea38dc8-2ad5-43a6-b375-c4c7d0732e3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3417097a280b499086b36df9a2548239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:19:28.468327 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea38dc8-2ad5-43a6-b375-c4c7d0732e3e service nova] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:28.468629 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea38dc8-2ad5-43a6-b375-c4c7d0732e3e service nova] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:28.468905 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea38dc8-2ad5-43a6-b375-c4c7d0732e3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:28.477917 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea38dc8-2ad5-43a6-b375-c4c7d0732e3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:19:28.479512 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea38dc8-2ad5-43a6-b375-c4c7d0732e3e service nova] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:19:28.489480 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 679/1368] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:19:28 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:19:29.954893 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97734a1b-acb1-4ed3-bfd7-71eef9e9f4f7 None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:29.955466 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97734a1b-acb1-4ed3-bfd7-71eef9e9f4f7 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:29.955466 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97734a1b-acb1-4ed3-bfd7-71eef9e9f4f7 None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:29.957810 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 690/1369] 10.222.0.18 () {54 vars in 911 bytes} [Tue Oct 12 18:19:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:19:29.964081 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4409e9-9f8e-4df1-8e3e-2e4c795cea32 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:29.964616 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4409e9-9f8e-4df1-8e3e-2e4c795cea32 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:29.964712 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4409e9-9f8e-4df1-8e3e-2e4c795cea32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:29.982170 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-6b4409e9-9f8e-4df1-8e3e-2e4c795cea32 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:19:29.983365 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-6b4409e9-9f8e-4df1-8e3e-2e4c795cea32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:19:29.991074 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 680/1370] 10.222.0.18 () {58 vars in 1008 bytes} [Tue Oct 12 18:19:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:19:30.146642 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97734a1b-acb1-4ed3-bfd7-71eef9e9f4f7 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:19:30.160909 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97734a1b-acb1-4ed3-bfd7-71eef9e9f4f7 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:19:30.169448 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be065d9e-7ce5-4233-a9b9-2c9b0b6f1bd4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3417097a280b499086b36df9a2548239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:19:30.170098 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be065d9e-7ce5-4233-a9b9-2c9b0b6f1bd4 service nova] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:30.170373 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be065d9e-7ce5-4233-a9b9-2c9b0b6f1bd4 service nova] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:30.170639 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be065d9e-7ce5-4233-a9b9-2c9b0b6f1bd4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:30.179458 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be065d9e-7ce5-4233-a9b9-2c9b0b6f1bd4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:19:30.181124 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be065d9e-7ce5-4233-a9b9-2c9b0b6f1bd4 service nova] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:19:30.192587 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 691/1371] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:19:30 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:19:31.665152 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465974f4-492e-412f-9ef0-0d29af64f9b6 None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:31.665714 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465974f4-492e-412f-9ef0-0d29af64f9b6 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:31.665714 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465974f4-492e-412f-9ef0-0d29af64f9b6 None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:31.667516 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 681/1372] 10.222.0.18 () {54 vars in 911 bytes} [Tue Oct 12 18:19:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:19:31.673396 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f636897-3731-4915-94ef-204f7d4bc7cd None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:31.673879 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f636897-3731-4915-94ef-204f7d4bc7cd None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:31.673983 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f636897-3731-4915-94ef-204f7d4bc7cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:31.693784 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-6f636897-3731-4915-94ef-204f7d4bc7cd None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:19:31.694989 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-6f636897-3731-4915-94ef-204f7d4bc7cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:19:31.702779 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 692/1373] 10.222.0.18 () {58 vars in 1008 bytes} [Tue Oct 12 18:19:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:19:31.857015 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465974f4-492e-412f-9ef0-0d29af64f9b6 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:19:31.874857 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465974f4-492e-412f-9ef0-0d29af64f9b6 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:19:31.880887 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a953c2-a202-4bc5-a651-0f66176f8915 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3417097a280b499086b36df9a2548239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:19:31.881544 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a953c2-a202-4bc5-a651-0f66176f8915 service nova] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:31.881820 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a953c2-a202-4bc5-a651-0f66176f8915 service nova] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:31.882089 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a953c2-a202-4bc5-a651-0f66176f8915 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:31.892528 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a953c2-a202-4bc5-a651-0f66176f8915 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:19:31.894660 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a953c2-a202-4bc5-a651-0f66176f8915 service nova] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:19:31.907387 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 682/1374] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:19:31 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:19:33.460388 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3199b2-1fde-4f7c-bed0-d5f6e10f8c28 None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:33.460990 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3199b2-1fde-4f7c-bed0-d5f6e10f8c28 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:33.460990 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3199b2-1fde-4f7c-bed0-d5f6e10f8c28 None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:33.462645 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 693/1375] 10.222.0.18 () {54 vars in 911 bytes} [Tue Oct 12 18:19:33 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:19:33.468551 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00a07e-65c1-4a95-8b08-339b57357877 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:33.469027 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00a07e-65c1-4a95-8b08-339b57357877 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:33.469135 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00a07e-65c1-4a95-8b08-339b57357877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:33.487403 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-7b00a07e-65c1-4a95-8b08-339b57357877 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:19:33.488628 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-7b00a07e-65c1-4a95-8b08-339b57357877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:19:33.496595 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 683/1376] 10.222.0.18 () {58 vars in 1008 bytes} [Tue Oct 12 18:19:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:19:33.652063 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3199b2-1fde-4f7c-bed0-d5f6e10f8c28 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:19:33.666171 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3199b2-1fde-4f7c-bed0-d5f6e10f8c28 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:19:33.671752 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5f250c-db2d-4be0-9ffd-a2c43e004f78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3417097a280b499086b36df9a2548239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:19:33.672423 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f250c-db2d-4be0-9ffd-a2c43e004f78 service nova] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:33.672749 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f250c-db2d-4be0-9ffd-a2c43e004f78 service nova] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:33.673016 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f250c-db2d-4be0-9ffd-a2c43e004f78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:33.682524 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5f250c-db2d-4be0-9ffd-a2c43e004f78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:19:33.684128 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5f250c-db2d-4be0-9ffd-a2c43e004f78 service nova] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:19:33.694681 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 694/1377] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:19:33 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:19:35.181801 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b3538-a2ae-4dac-a55c-f9027edd8a5b None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:35.182356 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b3538-a2ae-4dac-a55c-f9027edd8a5b None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:35.182356 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b3538-a2ae-4dac-a55c-f9027edd8a5b None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:35.184119 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 684/1378] 10.222.0.18 () {54 vars in 911 bytes} [Tue Oct 12 18:19:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:19:35.189952 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e54eb-7c31-4dc2-9507-f36d3eccf1c1 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:35.190967 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e54eb-7c31-4dc2-9507-f36d3eccf1c1 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:35.191076 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e54eb-7c31-4dc2-9507-f36d3eccf1c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:35.211844 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-127e54eb-7c31-4dc2-9507-f36d3eccf1c1 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:19:35.213067 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-127e54eb-7c31-4dc2-9507-f36d3eccf1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:19:35.220756 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 695/1379] 10.222.0.18 () {58 vars in 1008 bytes} [Tue Oct 12 18:19:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:19:35.372118 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98b3538-a2ae-4dac-a55c-f9027edd8a5b None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:19:35.386958 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98b3538-a2ae-4dac-a55c-f9027edd8a5b None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:19:35.392447 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64e5298-b799-46f2-bb99-5de7a37d9893 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3417097a280b499086b36df9a2548239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:19:35.393120 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e5298-b799-46f2-bb99-5de7a37d9893 service nova] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:35.393927 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e5298-b799-46f2-bb99-5de7a37d9893 service nova] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:35.394201 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e5298-b799-46f2-bb99-5de7a37d9893 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:35.403106 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64e5298-b799-46f2-bb99-5de7a37d9893 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:19:35.404811 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64e5298-b799-46f2-bb99-5de7a37d9893 service nova] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:19:35.414387 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 685/1380] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:19:35 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:19:36.887599 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92cbb8-68a5-4c60-aa5a-5fc11a241174 None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:36.888138 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92cbb8-68a5-4c60-aa5a-5fc11a241174 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:36.888138 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92cbb8-68a5-4c60-aa5a-5fc11a241174 None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:36.889912 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 696/1381] 10.222.0.18 () {54 vars in 911 bytes} [Tue Oct 12 18:19:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:19:36.896253 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d8dd53-2a64-42f4-bc3f-f2f1d265b9cf None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:36.896754 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d8dd53-2a64-42f4-bc3f-f2f1d265b9cf None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:36.897112 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d8dd53-2a64-42f4-bc3f-f2f1d265b9cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:36.915595 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-b9d8dd53-2a64-42f4-bc3f-f2f1d265b9cf None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:19:36.916821 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-b9d8dd53-2a64-42f4-bc3f-f2f1d265b9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:19:36.924889 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 686/1382] 10.222.0.18 () {58 vars in 1008 bytes} [Tue Oct 12 18:19:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:19:37.079325 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca92cbb8-68a5-4c60-aa5a-5fc11a241174 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:19:37.093993 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca92cbb8-68a5-4c60-aa5a-5fc11a241174 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:19:37.099858 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3447d0d5-ed6d-421f-8dc9-17e2b222114e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3417097a280b499086b36df9a2548239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:19:37.100698 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3447d0d5-ed6d-421f-8dc9-17e2b222114e service nova] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:37.100979 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3447d0d5-ed6d-421f-8dc9-17e2b222114e service nova] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:37.101252 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3447d0d5-ed6d-421f-8dc9-17e2b222114e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:37.110496 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3447d0d5-ed6d-421f-8dc9-17e2b222114e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:19:37.112666 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3447d0d5-ed6d-421f-8dc9-17e2b222114e service nova] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:19:37.124853 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 697/1383] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:19:37 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:19:39.289932 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e66fb-94c8-4467-82c8-0409b6c3ff0d None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:39.290496 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e66fb-94c8-4467-82c8-0409b6c3ff0d None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:39.290496 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e66fb-94c8-4467-82c8-0409b6c3ff0d None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:39.292260 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 687/1384] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:19:39 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:19:39.298518 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d897a957-05c5-4ef5-820d-a71de6e16c8f None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:39.298995 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d897a957-05c5-4ef5-820d-a71de6e16c8f None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:39.299099 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d897a957-05c5-4ef5-820d-a71de6e16c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:39.316927 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-d897a957-05c5-4ef5-820d-a71de6e16c8f None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:19:39.318139 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-d897a957-05c5-4ef5-820d-a71de6e16c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:19:39.326062 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 698/1385] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:19:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:19:39.366482 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42e66fb-94c8-4467-82c8-0409b6c3ff0d None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:19:39.376895 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42e66fb-94c8-4467-82c8-0409b6c3ff0d None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:19:39.380434 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3433a1e1-73a9-4d01-837a-45c7a699867c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:19:39.381074 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433a1e1-73a9-4d01-837a-45c7a699867c service neutron] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:39.381349 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433a1e1-73a9-4d01-837a-45c7a699867c service neutron] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:39.381618 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433a1e1-73a9-4d01-837a-45c7a699867c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:39.390724 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3433a1e1-73a9-4d01-837a-45c7a699867c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:19:39.392144 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3433a1e1-73a9-4d01-837a-45c7a699867c service neutron] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:19:39.402874 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 688/1386] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:19:39 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:19:41.838826 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcffed4-47ce-4cd1-8c1a-89e2619d0883 None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:41.839438 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcffed4-47ce-4cd1-8c1a-89e2619d0883 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:41.839438 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcffed4-47ce-4cd1-8c1a-89e2619d0883 None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:41.841397 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 699/1387] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:19:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:19:41.849590 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cdd5cb-b66a-43aa-83e4-ad64ef598784 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:41.850074 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cdd5cb-b66a-43aa-83e4-ad64ef598784 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:41.850195 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cdd5cb-b66a-43aa-83e4-ad64ef598784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:41.867877 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-22cdd5cb-b66a-43aa-83e4-ad64ef598784 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:19:41.869028 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-22cdd5cb-b66a-43aa-83e4-ad64ef598784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:19:41.877666 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 689/1388] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:19:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:19:41.917655 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcffed4-47ce-4cd1-8c1a-89e2619d0883 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:19:41.928474 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcffed4-47ce-4cd1-8c1a-89e2619d0883 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:19:41.932050 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8041c97-b7d8-4f1c-b3ce-7c40401a8369 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:19:41.932765 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8041c97-b7d8-4f1c-b3ce-7c40401a8369 service neutron] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:41.933049 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8041c97-b7d8-4f1c-b3ce-7c40401a8369 service neutron] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:41.933325 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8041c97-b7d8-4f1c-b3ce-7c40401a8369 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:41.943820 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8041c97-b7d8-4f1c-b3ce-7c40401a8369 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:19:41.945307 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8041c97-b7d8-4f1c-b3ce-7c40401a8369 service neutron] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:19:41.955090 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 700/1389] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:19:41 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:19:44.670908 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d39f36e-1461-41eb-9db9-7ff62cd27011 None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:44.671496 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d39f36e-1461-41eb-9db9-7ff62cd27011 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:44.671496 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d39f36e-1461-41eb-9db9-7ff62cd27011 None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:44.673247 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 690/1390] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:19:44 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:19:44.679453 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b3e33-cd23-4f33-8b5b-5697ff59d56f None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:44.679920 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b3e33-cd23-4f33-8b5b-5697ff59d56f None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:44.680019 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b3e33-cd23-4f33-8b5b-5697ff59d56f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:44.697540 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-417b3e33-cd23-4f33-8b5b-5697ff59d56f None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:19:44.698740 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-417b3e33-cd23-4f33-8b5b-5697ff59d56f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:19:44.707110 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 701/1391] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:19:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:19:44.748946 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d39f36e-1461-41eb-9db9-7ff62cd27011 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:19:44.759415 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d39f36e-1461-41eb-9db9-7ff62cd27011 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:19:44.762938 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75461917-ea18-477d-b76f-45d91b6cc92c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:19:44.763571 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75461917-ea18-477d-b76f-45d91b6cc92c service neutron] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:44.763850 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75461917-ea18-477d-b76f-45d91b6cc92c service neutron] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:44.764124 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75461917-ea18-477d-b76f-45d91b6cc92c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:44.774078 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75461917-ea18-477d-b76f-45d91b6cc92c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:19:44.775505 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75461917-ea18-477d-b76f-45d91b6cc92c service neutron] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:19:44.785655 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 691/1392] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:19:44 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:19:47.266225 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca737a8-7fdc-4a20-8415-3bd350d1de7c None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:47.266910 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca737a8-7fdc-4a20-8415-3bd350d1de7c None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:47.266910 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca737a8-7fdc-4a20-8415-3bd350d1de7c None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:47.268660 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 702/1393] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:19:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:19:47.275133 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924675bb-e4a7-481e-9f2b-fb684939f1b5 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:47.275630 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924675bb-e4a7-481e-9f2b-fb684939f1b5 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:47.275755 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924675bb-e4a7-481e-9f2b-fb684939f1b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:47.293635 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-924675bb-e4a7-481e-9f2b-fb684939f1b5 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:19:47.294817 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-924675bb-e4a7-481e-9f2b-fb684939f1b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:19:47.303106 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 692/1394] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:19:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:19:47.342215 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca737a8-7fdc-4a20-8415-3bd350d1de7c None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:19:47.353495 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca737a8-7fdc-4a20-8415-3bd350d1de7c None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:19:47.357067 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4f29d9-dda3-492e-b4e3-ea4f39fdfb1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:19:47.357708 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f29d9-dda3-492e-b4e3-ea4f39fdfb1d service neutron] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:47.357985 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f29d9-dda3-492e-b4e3-ea4f39fdfb1d service neutron] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:47.358256 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f29d9-dda3-492e-b4e3-ea4f39fdfb1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:47.368094 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4f29d9-dda3-492e-b4e3-ea4f39fdfb1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:19:47.369569 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4f29d9-dda3-492e-b4e3-ea4f39fdfb1d service neutron] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:19:47.379121 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 703/1395] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:19:47 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:19:49.718303 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd85da46-14c6-4d49-ba09-92b1a5c9d14d None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:49.718870 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd85da46-14c6-4d49-ba09-92b1a5c9d14d None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:49.718870 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd85da46-14c6-4d49-ba09-92b1a5c9d14d None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:49.721157 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 693/1396] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:19:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:19:49.727475 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fc7571-c245-40bb-9271-400c0dcf31e7 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:49.727944 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fc7571-c245-40bb-9271-400c0dcf31e7 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:49.728048 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fc7571-c245-40bb-9271-400c0dcf31e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:49.749918 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-b7fc7571-c245-40bb-9271-400c0dcf31e7 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:19:49.751134 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-b7fc7571-c245-40bb-9271-400c0dcf31e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:19:49.759040 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 704/1397] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:19:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:19:49.799963 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd85da46-14c6-4d49-ba09-92b1a5c9d14d None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:19:49.810822 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd85da46-14c6-4d49-ba09-92b1a5c9d14d None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:19:49.814378 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53f2e34-7cfc-4460-a297-5ac033cd5be6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:19:49.815027 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53f2e34-7cfc-4460-a297-5ac033cd5be6 service neutron] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:49.815309 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53f2e34-7cfc-4460-a297-5ac033cd5be6 service neutron] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:49.815581 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53f2e34-7cfc-4460-a297-5ac033cd5be6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:49.824915 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53f2e34-7cfc-4460-a297-5ac033cd5be6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:19:49.826354 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53f2e34-7cfc-4460-a297-5ac033cd5be6 service neutron] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:19:49.839355 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 694/1398] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:19:49 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:19:52.168413 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a13e6-660d-4ac1-a19c-cbdcb383d88d None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:52.168988 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a13e6-660d-4ac1-a19c-cbdcb383d88d None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:52.168988 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a13e6-660d-4ac1-a19c-cbdcb383d88d None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:52.170790 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 705/1399] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:19:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:19:52.177093 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c24adc-2b67-4184-9244-93f23eee1189 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:52.177609 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c24adc-2b67-4184-9244-93f23eee1189 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:52.177695 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c24adc-2b67-4184-9244-93f23eee1189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:52.195070 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-90c24adc-2b67-4184-9244-93f23eee1189 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:19:52.196169 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-90c24adc-2b67-4184-9244-93f23eee1189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:19:52.204061 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 695/1400] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:19:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:19:52.245958 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314a13e6-660d-4ac1-a19c-cbdcb383d88d None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:19:52.256764 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314a13e6-660d-4ac1-a19c-cbdcb383d88d None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:19:52.260850 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709c4371-eca8-47fe-8d4d-329472625e14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:19:52.261910 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c4371-eca8-47fe-8d4d-329472625e14 service neutron] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:52.262417 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c4371-eca8-47fe-8d4d-329472625e14 service neutron] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:52.262949 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c4371-eca8-47fe-8d4d-329472625e14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:52.274308 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709c4371-eca8-47fe-8d4d-329472625e14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:19:52.275751 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709c4371-eca8-47fe-8d4d-329472625e14 service neutron] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:19:52.286295 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 706/1401] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:19:52 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:19:54.657434 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9818bb7-4e1d-4dd7-8b42-223b965093ee None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:54.658060 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9818bb7-4e1d-4dd7-8b42-223b965093ee None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:54.658060 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9818bb7-4e1d-4dd7-8b42-223b965093ee None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:54.659797 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 696/1402] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:19:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:19:54.666288 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f02058-5b9a-4725-9350-9d2fa9e8fce8 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:54.666764 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f02058-5b9a-4725-9350-9d2fa9e8fce8 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:54.666852 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f02058-5b9a-4725-9350-9d2fa9e8fce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:54.684541 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-65f02058-5b9a-4725-9350-9d2fa9e8fce8 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:19:54.685743 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-65f02058-5b9a-4725-9350-9d2fa9e8fce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:19:54.694121 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 707/1403] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:19:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:19:54.733292 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9818bb7-4e1d-4dd7-8b42-223b965093ee None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:19:54.743915 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9818bb7-4e1d-4dd7-8b42-223b965093ee None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:19:54.750658 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcad169c-c7a9-48df-a366-ab75d0673114 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:19:54.751304 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad169c-c7a9-48df-a366-ab75d0673114 service neutron] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:54.751581 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad169c-c7a9-48df-a366-ab75d0673114 service neutron] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:54.752350 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad169c-c7a9-48df-a366-ab75d0673114 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:54.761741 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcad169c-c7a9-48df-a366-ab75d0673114 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:19:54.763177 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcad169c-c7a9-48df-a366-ab75d0673114 service neutron] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:19:54.773799 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 697/1404] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:19:54 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:19:57.116578 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc00298-48ee-434f-815e-1190f8afbc88 None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:57.117131 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc00298-48ee-434f-815e-1190f8afbc88 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:57.117131 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc00298-48ee-434f-815e-1190f8afbc88 None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:57.118908 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 708/1405] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:19:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:19:57.125105 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7fb76d-c99c-4326-9ede-fc2e37c7fb23 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:57.125561 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7fb76d-c99c-4326-9ede-fc2e37c7fb23 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:57.125653 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7fb76d-c99c-4326-9ede-fc2e37c7fb23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:57.143256 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-8c7fb76d-c99c-4326-9ede-fc2e37c7fb23 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:19:57.144490 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-8c7fb76d-c99c-4326-9ede-fc2e37c7fb23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:19:57.152661 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 698/1406] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:19:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:19:57.191963 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc00298-48ee-434f-815e-1190f8afbc88 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:19:57.202515 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc00298-48ee-434f-815e-1190f8afbc88 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:19:57.206168 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20654048-82db-450a-b420-30815a8b33b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:19:57.206805 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20654048-82db-450a-b420-30815a8b33b2 service neutron] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:57.207086 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20654048-82db-450a-b420-30815a8b33b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:57.207361 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20654048-82db-450a-b420-30815a8b33b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:57.216936 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20654048-82db-450a-b420-30815a8b33b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:19:57.218379 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20654048-82db-450a-b420-30815a8b33b2 service neutron] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:19:57.228690 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 709/1407] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:19:57 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:19:59.518054 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb3acf6-8386-4f33-9c7f-7d38cb6c81e5 None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:59.518639 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb3acf6-8386-4f33-9c7f-7d38cb6c81e5 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:59.518639 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb3acf6-8386-4f33-9c7f-7d38cb6c81e5 None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:59.520419 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 699/1408] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:19:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:19:59.526910 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccccce4f-aa53-49ce-b5e8-3adbfc3b8e7a None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:59.527369 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccccce4f-aa53-49ce-b5e8-3adbfc3b8e7a None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:59.527473 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccccce4f-aa53-49ce-b5e8-3adbfc3b8e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:59.545767 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-ccccce4f-aa53-49ce-b5e8-3adbfc3b8e7a None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:19:59.546983 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-ccccce4f-aa53-49ce-b5e8-3adbfc3b8e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:19:59.554936 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 710/1409] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:19:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:19:59.593446 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb3acf6-8386-4f33-9c7f-7d38cb6c81e5 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:19:59.604278 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb3acf6-8386-4f33-9c7f-7d38cb6c81e5 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:19:59.607768 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f4349d-2700-47e1-9201-65323c240a0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:19:59.608414 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f4349d-2700-47e1-9201-65323c240a0f service neutron] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:19:59.608701 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f4349d-2700-47e1-9201-65323c240a0f service neutron] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:19:59.608972 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f4349d-2700-47e1-9201-65323c240a0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:19:59.618173 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f4349d-2700-47e1-9201-65323c240a0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:19:59.619619 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f4349d-2700-47e1-9201-65323c240a0f service neutron] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:19:59.629876 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 700/1410] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:19:59 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 18:20:01.926940 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adcaac0-943e-4aca-b192-7b39e51e2d8d None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:20:01.927564 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adcaac0-943e-4aca-b192-7b39e51e2d8d None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:20:01.927564 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adcaac0-943e-4aca-b192-7b39e51e2d8d None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:20:01.929157 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 711/1411] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:20:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:20:01.935593 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e601af5-960f-4068-9503-a835f133db23 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:20:01.936092 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e601af5-960f-4068-9503-a835f133db23 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:20:01.936245 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e601af5-960f-4068-9503-a835f133db23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:20:01.955080 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-4e601af5-960f-4068-9503-a835f133db23 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:20:01.956287 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-4e601af5-960f-4068-9503-a835f133db23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:20:01.965523 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 701/1412] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:20:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:20:02.004440 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adcaac0-943e-4aca-b192-7b39e51e2d8d None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:20:02.015134 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adcaac0-943e-4aca-b192-7b39e51e2d8d None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:20:02.019189 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9171a4d2-5d22-4722-bb2f-95f5d10db408 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:20:02.020076 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9171a4d2-5d22-4722-bb2f-95f5d10db408 service neutron] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:20:02.020349 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9171a4d2-5d22-4722-bb2f-95f5d10db408 service neutron] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:20:02.020654 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9171a4d2-5d22-4722-bb2f-95f5d10db408 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:20:02.030427 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9171a4d2-5d22-4722-bb2f-95f5d10db408 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:20:02.031863 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9171a4d2-5d22-4722-bb2f-95f5d10db408 service neutron] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:20:02.041920 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 712/1413] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:20:02 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:20:20.266535 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e91188-f80a-4beb-b44d-da852905cedf None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:20:20.267142 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e91188-f80a-4beb-b44d-da852905cedf None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:20:20.267142 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e91188-f80a-4beb-b44d-da852905cedf None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:20:20.269119 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 702/1414] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:20:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:20:20.275727 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af6b70-7eba-4478-8660-154d689144d2 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:20:20.276247 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af6b70-7eba-4478-8660-154d689144d2 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:20:20.276356 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af6b70-7eba-4478-8660-154d689144d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:20:20.294582 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-50af6b70-7eba-4478-8660-154d689144d2 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:20:20.295768 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-50af6b70-7eba-4478-8660-154d689144d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:20:20.304118 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 713/1415] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:20:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:20:20.354413 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b9800-d0ca-44e4-ad97-04e36fe2dba1 None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:20:20.354697 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b9800-d0ca-44e4-ad97-04e36fe2dba1 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:20:20.354975 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b9800-d0ca-44e4-ad97-04e36fe2dba1 None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:20:20.356749 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 703/1416] 10.222.0.18 () {54 vars in 961 bytes} [Tue Oct 12 18:20:20 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:20:20.362775 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a381bcac-536f-408d-8bd4-d5dd7d0bf626 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:20:20.363064 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a381bcac-536f-408d-8bd4-d5dd7d0bf626 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:20:20.363357 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a381bcac-536f-408d-8bd4-d5dd7d0bf626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:20:20.383365 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-a381bcac-536f-408d-8bd4-d5dd7d0bf626 None None] MFA Rules not processed for user `7a3d3e5a5cfc4ac3afcece4e55f23552`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:20:20.384582 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-a381bcac-536f-408d-8bd4-d5dd7d0bf626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:20:20.390972 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 714/1417] 10.222.0.18 () {58 vars in 1058 bytes} [Tue Oct 12 18:20:20 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:20:20.399267 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1b9800-d0ca-44e4-ad97-04e36fe2dba1 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:20:20.410784 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1b9800-d0ca-44e4-ad97-04e36fe2dba1 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:20:20.414288 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8457502-5360-4def-a71f-6da1388ac3ea service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a3d3e5a5cfc4ac3afcece4e55f23552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:20:20.414921 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8457502-5360-4def-a71f-6da1388ac3ea service glance] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:20:20.415195 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8457502-5360-4def-a71f-6da1388ac3ea service glance] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:20:20.415461 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8457502-5360-4def-a71f-6da1388ac3ea service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:20:20.425411 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8457502-5360-4def-a71f-6da1388ac3ea service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:20:20.426899 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8457502-5360-4def-a71f-6da1388ac3ea service glance] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:20:20.436478 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 704/1418] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:20:20 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:20:22.941264 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea8b53-57be-43c8-bedd-33298759fa1f None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:20:22.941830 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea8b53-57be-43c8-bedd-33298759fa1f None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:20:22.941830 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea8b53-57be-43c8-bedd-33298759fa1f None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:20:22.943554 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 715/1419] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:20:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:20:22.950181 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc5d849-e6c0-4994-8bda-3bfeb1646b6d None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:20:22.950633 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc5d849-e6c0-4994-8bda-3bfeb1646b6d None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:20:22.950752 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc5d849-e6c0-4994-8bda-3bfeb1646b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:20:22.968340 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-dcc5d849-e6c0-4994-8bda-3bfeb1646b6d None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:20:22.969768 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-dcc5d849-e6c0-4994-8bda-3bfeb1646b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:20:22.977899 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 705/1420] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:20:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:20:23.003961 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ea8b53-57be-43c8-bedd-33298759fa1f None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:20:23.016468 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ea8b53-57be-43c8-bedd-33298759fa1f None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:20:23.020913 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a540b-e13d-49f2-9dc1-f3acf8154e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:20:23.021569 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a540b-e13d-49f2-9dc1-f3acf8154e8e admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:20:23.021853 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a540b-e13d-49f2-9dc1-f3acf8154e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:20:23.022396 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a540b-e13d-49f2-9dc1-f3acf8154e8e admin admin] PATH_INFO: `/v3/projects` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:20:23.023140 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46a540b-e13d-49f2-9dc1-f3acf8154e8e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:20:23.025109 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46a540b-e13d-49f2-9dc1-f3acf8154e8e admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:20:23.038991 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 716/1421] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 12 18:20:23 2021] GET /identity/v3/projects => generated 2553 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:20:25.377521 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f184f78-cc9e-4908-843d-b7fa61b658c1 None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:20:25.378104 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f184f78-cc9e-4908-843d-b7fa61b658c1 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:20:25.378218 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f184f78-cc9e-4908-843d-b7fa61b658c1 None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:20:25.380019 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 706/1422] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:20:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:20:25.386280 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d9b0b-0551-4c6f-9eab-68bd0ded9fc6 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:20:25.386759 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d9b0b-0551-4c6f-9eab-68bd0ded9fc6 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:20:25.386865 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d9b0b-0551-4c6f-9eab-68bd0ded9fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:20:25.405485 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-612d9b0b-0551-4c6f-9eab-68bd0ded9fc6 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:20:25.406743 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-612d9b0b-0551-4c6f-9eab-68bd0ded9fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:20:25.414702 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 717/1423] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:20:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:20:25.460968 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f184f78-cc9e-4908-843d-b7fa61b658c1 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:20:25.474887 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f184f78-cc9e-4908-843d-b7fa61b658c1 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:20:25.480881 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20da61b6-8a25-44c9-ab7e-694ff5d95c46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3417097a280b499086b36df9a2548239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:20:25.481518 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da61b6-8a25-44c9-ab7e-694ff5d95c46 service nova] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:20:25.481797 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da61b6-8a25-44c9-ab7e-694ff5d95c46 service nova] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:20:25.482063 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da61b6-8a25-44c9-ab7e-694ff5d95c46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:20:25.490667 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20da61b6-8a25-44c9-ab7e-694ff5d95c46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:20:25.492261 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20da61b6-8a25-44c9-ab7e-694ff5d95c46 service nova] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:20:25.502286 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 707/1424] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:20:25 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:20:27.974618 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ef081-ee23-4444-9326-c2dcd4844b8d None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:20:27.975153 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ef081-ee23-4444-9326-c2dcd4844b8d None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:20:27.975153 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ef081-ee23-4444-9326-c2dcd4844b8d None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:20:27.976990 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 718/1425] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:20:27 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:20:27.984187 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f271df-0987-4b00-8e92-63a76e3d573a None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:20:27.985240 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f271df-0987-4b00-8e92-63a76e3d573a None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:20:27.985631 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f271df-0987-4b00-8e92-63a76e3d573a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:20:28.011883 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-00f271df-0987-4b00-8e92-63a76e3d573a None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:20:28.013099 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-00f271df-0987-4b00-8e92-63a76e3d573a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:20:28.025019 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 708/1426] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:20:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:20:28.059581 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238ef081-ee23-4444-9326-c2dcd4844b8d None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:20:28.074900 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238ef081-ee23-4444-9326-c2dcd4844b8d None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:20:28.074900 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1258689-16f9-461c-93d3-132c25e9123e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:20:28.075362 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1258689-16f9-461c-93d3-132c25e9123e service neutron] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:20:28.075672 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1258689-16f9-461c-93d3-132c25e9123e service neutron] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:20:28.075947 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1258689-16f9-461c-93d3-132c25e9123e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:20:28.085166 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1258689-16f9-461c-93d3-132c25e9123e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:20:28.086593 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1258689-16f9-461c-93d3-132c25e9123e service neutron] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:20:28.095684 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 719/1427] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:20:28 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:20:30.426373 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d896d-4649-41c8-bc7a-8b7a605b3918 None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:20:30.426944 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d896d-4649-41c8-bc7a-8b7a605b3918 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:20:30.426944 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d896d-4649-41c8-bc7a-8b7a605b3918 None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:20:30.428748 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 709/1428] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:20:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:20:30.435524 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95698515-2295-40dd-8f4c-9de2332aba1a None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:20:30.435959 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95698515-2295-40dd-8f4c-9de2332aba1a None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:20:30.436056 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95698515-2295-40dd-8f4c-9de2332aba1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:20:30.454847 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-95698515-2295-40dd-8f4c-9de2332aba1a None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:20:30.456039 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-95698515-2295-40dd-8f4c-9de2332aba1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:20:30.463772 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 720/1429] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:20:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:20:30.504316 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6d896d-4649-41c8-bc7a-8b7a605b3918 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:20:30.514794 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6d896d-4649-41c8-bc7a-8b7a605b3918 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:20:30.518794 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd113b07-2eac-4216-a4f2-b55694879d95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:20:30.519429 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd113b07-2eac-4216-a4f2-b55694879d95 service neutron] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:20:30.519709 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd113b07-2eac-4216-a4f2-b55694879d95 service neutron] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:20:30.519984 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd113b07-2eac-4216-a4f2-b55694879d95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:20:30.530095 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd113b07-2eac-4216-a4f2-b55694879d95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:20:30.532454 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd113b07-2eac-4216-a4f2-b55694879d95 service neutron] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:20:30.542003 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 710/1430] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:20:30 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:20:32.983753 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e96fbb-d2a1-4d94-8cdf-f9d5e0ae3736 None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:20:32.984302 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e96fbb-d2a1-4d94-8cdf-f9d5e0ae3736 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:20:32.984302 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e96fbb-d2a1-4d94-8cdf-f9d5e0ae3736 None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:20:32.986115 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 721/1431] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:20:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:20:32.992596 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915af24-d8b6-4e37-94fd-cf64026445f0 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:20:32.993098 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915af24-d8b6-4e37-94fd-cf64026445f0 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:20:32.993196 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915af24-d8b6-4e37-94fd-cf64026445f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:20:33.011298 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-e915af24-d8b6-4e37-94fd-cf64026445f0 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:20:33.012543 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-e915af24-d8b6-4e37-94fd-cf64026445f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:20:33.020917 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 711/1432] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:20:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:20:33.063256 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e96fbb-d2a1-4d94-8cdf-f9d5e0ae3736 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:20:33.073867 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e96fbb-d2a1-4d94-8cdf-f9d5e0ae3736 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:20:33.077329 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89503c26-77d5-4524-8552-afaba7c2582d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:20:33.077962 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89503c26-77d5-4524-8552-afaba7c2582d service neutron] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:20:33.078796 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89503c26-77d5-4524-8552-afaba7c2582d service neutron] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:20:33.079067 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89503c26-77d5-4524-8552-afaba7c2582d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:20:33.087572 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89503c26-77d5-4524-8552-afaba7c2582d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:20:33.089037 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89503c26-77d5-4524-8552-afaba7c2582d service neutron] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:20:33.097978 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 722/1433] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:20:33 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:20:35.907034 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5621fd-4550-49ea-becf-80dedc9314e8 None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:20:35.907583 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5621fd-4550-49ea-becf-80dedc9314e8 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:20:35.907583 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5621fd-4550-49ea-becf-80dedc9314e8 None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:20:35.909373 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 712/1434] 10.222.0.18 () {54 vars in 926 bytes} [Tue Oct 12 18:20:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:20:35.915729 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d897d7ed-36ae-464f-9756-23ed429c8355 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:20:35.916219 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d897d7ed-36ae-464f-9756-23ed429c8355 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:20:35.916314 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d897d7ed-36ae-464f-9756-23ed429c8355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:20:35.936830 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-d897d7ed-36ae-464f-9756-23ed429c8355 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:20:35.938024 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-d897d7ed-36ae-464f-9756-23ed429c8355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:20:35.946786 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 723/1435] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Oct 12 18:20:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:20:35.987798 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5621fd-4550-49ea-becf-80dedc9314e8 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:20:35.998355 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5621fd-4550-49ea-becf-80dedc9314e8 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:20:36.001820 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f46a0a0-627e-4018-8997-5a8c600b7e7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:20:36.002449 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46a0a0-627e-4018-8997-5a8c600b7e7b service neutron] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:20:36.002725 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46a0a0-627e-4018-8997-5a8c600b7e7b service neutron] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:20:36.003184 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46a0a0-627e-4018-8997-5a8c600b7e7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:20:36.013311 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f46a0a0-627e-4018-8997-5a8c600b7e7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:20:36.014767 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f46a0a0-627e-4018-8997-5a8c600b7e7b service neutron] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:20:36.025303 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 713/1436] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:20:35 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:22:05.009862 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1138b7-c0f7-4725-bfe8-cf3e28439518 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:22:05.010431 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1138b7-c0f7-4725-bfe8-cf3e28439518 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:22:05.010431 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1138b7-c0f7-4725-bfe8-cf3e28439518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:22:05.029986 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-9e1138b7-c0f7-4725-bfe8-cf3e28439518 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:22:05.031152 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-9e1138b7-c0f7-4725-bfe8-cf3e28439518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:22:05.038889 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 724/1437] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:22:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:22:05.046736 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f0d7ae-57b2-4c14-aa12-c7e8ef57e4fc None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:22:05.047253 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f0d7ae-57b2-4c14-aa12-c7e8ef57e4fc None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:22:05.047359 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f0d7ae-57b2-4c14-aa12-c7e8ef57e4fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:22:05.065458 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-95f0d7ae-57b2-4c14-aa12-c7e8ef57e4fc None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:22:05.066632 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-95f0d7ae-57b2-4c14-aa12-c7e8ef57e4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:22:05.074320 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 714/1438] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:22:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:22:05.079363 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1138b7-c0f7-4725-bfe8-cf3e28439518 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:22:05.088590 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1138b7-c0f7-4725-bfe8-cf3e28439518 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:22:05.096240 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3224cd-343b-4b68-97b1-8e6399e75bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:22:05.096937 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3224cd-343b-4b68-97b1-8e6399e75bf3 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:22:05.097218 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3224cd-343b-4b68-97b1-8e6399e75bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:22:05.097493 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3224cd-343b-4b68-97b1-8e6399e75bf3 admin admin] PATH_INFO: `/v3/domains` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:22:05.098222 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3224cd-343b-4b68-97b1-8e6399e75bf3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:22:05.098529 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3224cd-343b-4b68-97b1-8e6399e75bf3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:22:05.100145 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3224cd-343b-4b68-97b1-8e6399e75bf3 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:22:05.111600 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 725/1439] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 12 18:22:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:22:05.119592 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f0d7ae-57b2-4c14-aa12-c7e8ef57e4fc None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:22:05.129202 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f0d7ae-57b2-4c14-aa12-c7e8ef57e4fc None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:22:05.133765 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc8e26-82c0-4c43-bda9-5a57c2ce58b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:22:05.134409 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc8e26-82c0-4c43-bda9-5a57c2ce58b8 admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:22:05.134691 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc8e26-82c0-4c43-bda9-5a57c2ce58b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:22:05.134960 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc8e26-82c0-4c43-bda9-5a57c2ce58b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:22:05.135692 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cc8e26-82c0-4c43-bda9-5a57c2ce58b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:22:05.137626 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cc8e26-82c0-4c43-bda9-5a57c2ce58b8 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:22:05.296326 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 715/1440] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:22:05 2021] POST /identity/v3/projects => generated 377 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:22:05.300592 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3224cd-343b-4b68-97b1-8e6399e75bf3 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:22:05.310666 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3224cd-343b-4b68-97b1-8e6399e75bf3 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:22:05.362634 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af790120-526c-4daf-8293-3cfa61b1fe25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:22:05.363285 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af790120-526c-4daf-8293-3cfa61b1fe25 admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:22:05.363564 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af790120-526c-4daf-8293-3cfa61b1fe25 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:22:05.363835 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af790120-526c-4daf-8293-3cfa61b1fe25 admin admin] PATH_INFO: `/v3/users` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:22:05.364559 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af790120-526c-4daf-8293-3cfa61b1fe25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:22:05.366463 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af790120-526c-4daf-8293-3cfa61b1fe25 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:22:05.460909 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 726/1441] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:22:05 2021] POST /identity/v3/users => generated 289 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:22:05.465072 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc8e26-82c0-4c43-bda9-5a57c2ce58b8 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:22:05.475634 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc8e26-82c0-4c43-bda9-5a57c2ce58b8 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:22:05.480079 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06b5e0a-7b15-4c10-92f5-6e9617545004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:22:05.480762 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b5e0a-7b15-4c10-92f5-6e9617545004 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:22:05.481034 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b5e0a-7b15-4c10-92f5-6e9617545004 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:22:05.481307 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b5e0a-7b15-4c10-92f5-6e9617545004 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:22:05.482063 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06b5e0a-7b15-4c10-92f5-6e9617545004 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:22:05.483651 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06b5e0a-7b15-4c10-92f5-6e9617545004 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:22:05.496481 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 716/1442] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:22:05 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:22:05.500367 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af790120-526c-4daf-8293-3cfa61b1fe25 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:22:05.514937 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af790120-526c-4daf-8293-3cfa61b1fe25 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:22:05.519511 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fc3ae1-ab0f-4a43-aa8d-43267f82f968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:22:05.520159 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fc3ae1-ab0f-4a43-aa8d-43267f82f968 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:22:05.520471 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fc3ae1-ab0f-4a43-aa8d-43267f82f968 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:22:05.520749 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fc3ae1-ab0f-4a43-aa8d-43267f82f968 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:22:05.521478 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fc3ae1-ab0f-4a43-aa8d-43267f82f968 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:22:05.523335 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fc3ae1-ab0f-4a43-aa8d-43267f82f968 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:22:05.537046 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 727/1443] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:22:05 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:22:05.541151 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06b5e0a-7b15-4c10-92f5-6e9617545004 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:22:05.552466 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06b5e0a-7b15-4c10-92f5-6e9617545004 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:22:05.558519 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7f90ab-0113-46f3-bad8-dcdbd38ccfaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:22:05.560059 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f90ab-0113-46f3-bad8-dcdbd38ccfaf admin admin] REQUEST_METHOD: `PUT` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:22:05.560547 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f90ab-0113-46f3-bad8-dcdbd38ccfaf admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:22:05.560966 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f90ab-0113-46f3-bad8-dcdbd38ccfaf admin admin] PATH_INFO: `/v3/projects/ce4f180480024840a89a0210da934f70/users/e50ae6d982134e899b3c1ca7d85402b4/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:22:05.575716 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7f90ab-0113-46f3-bad8-dcdbd38ccfaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce4f180480024840a89a0210da934f70, user_id=e50ae6d982134e899b3c1ca7d85402b4, role_id=33b8a5a8d1d643f2a98f598e6ab0a1cf)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:22:05.578909 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7f90ab-0113-46f3-bad8-dcdbd38ccfaf admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:22:05.694778 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 717/1444] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:22:05 2021] PUT /identity/v3/projects/ce4f180480024840a89a0210da934f70/users/e50ae6d982134e899b3c1ca7d85402b4/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 18:22:05.707149 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58267c0-9962-4eaf-9091-e4a84f12d5d7 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:22:05.708757 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58267c0-9962-4eaf-9091-e4a84f12d5d7 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:22:05.708757 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58267c0-9962-4eaf-9091-e4a84f12d5d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:22:05.733574 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-c58267c0-9962-4eaf-9091-e4a84f12d5d7 None None] MFA Rules not processed for user `e50ae6d982134e899b3c1ca7d85402b4`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:22:05.734760 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-c58267c0-9962-4eaf-9091-e4a84f12d5d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:22:05.793876 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 728/1445] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:22:05 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:22:05.805655 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7f90ab-0113-46f3-bad8-dcdbd38ccfaf admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:22:05.871426 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7f90ab-0113-46f3-bad8-dcdbd38ccfaf admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:22:05.877454 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7feeeb7-99bd-4d05-abbd-240c3b05e962 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3417097a280b499086b36df9a2548239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:22:05.878086 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7feeeb7-99bd-4d05-abbd-240c3b05e962 service nova] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:22:05.878369 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7feeeb7-99bd-4d05-abbd-240c3b05e962 service nova] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:22:05.878643 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7feeeb7-99bd-4d05-abbd-240c3b05e962 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:22:05.886181 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7feeeb7-99bd-4d05-abbd-240c3b05e962 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:22:05.887755 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7feeeb7-99bd-4d05-abbd-240c3b05e962 service nova] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:22:05.896861 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 718/1446] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:22:05 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:22:05.963727 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15282342-9789-49a3-a460-55caabd8396a None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:22:05.964012 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15282342-9789-49a3-a460-55caabd8396a None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:22:05.964282 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15282342-9789-49a3-a460-55caabd8396a None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:22:05.966002 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 729/1447] 10.222.0.18 () {52 vars in 829 bytes} [Tue Oct 12 18:22:05 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:22:05.969652 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7feeeb7-99bd-4d05-abbd-240c3b05e962 service nova] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:22:06.033538 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7feeeb7-99bd-4d05-abbd-240c3b05e962 service nova] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:22:06.038118 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c6fafc-38f6-45be-8809-99cf474089b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:22:06.038980 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c6fafc-38f6-45be-8809-99cf474089b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:22:06.039260 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c6fafc-38f6-45be-8809-99cf474089b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:22:06.039536 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c6fafc-38f6-45be-8809-99cf474089b0 admin admin] PATH_INFO: `/v3/users/e50ae6d982134e899b3c1ca7d85402b4` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:22:06.040756 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c6fafc-38f6-45be-8809-99cf474089b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e50ae6d982134e899b3c1ca7d85402b4)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:22:06.042326 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING py.warnings [None req-a5c6fafc-38f6-45be-8809-99cf474089b0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:22:06.042326 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: warnings.warn(msg) Oct 12 18:22:06.042326 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: Oct 12 18:22:06.042971 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c6fafc-38f6-45be-8809-99cf474089b0 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:22:06.246784 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-a5c6fafc-38f6-45be-8809-99cf474089b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e50ae6d982134e899b3c1ca7d85402b4'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:22:06.259744 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-a5c6fafc-38f6-45be-8809-99cf474089b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e50ae6d982134e899b3c1ca7d85402b4'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:22:06.279181 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-a5c6fafc-38f6-45be-8809-99cf474089b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e50ae6d982134e899b3c1ca7d85402b4'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:22:06.358602 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-a5c6fafc-38f6-45be-8809-99cf474089b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e50ae6d982134e899b3c1ca7d85402b4'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:22:06.359456 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-a5c6fafc-38f6-45be-8809-99cf474089b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e50ae6d982134e899b3c1ca7d85402b4'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:22:06.365712 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 719/1448] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:22:05 2021] DELETE /identity/v3/users/e50ae6d982134e899b3c1ca7d85402b4 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:22:06.370248 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3682ea1f-8a2a-4ce0-a52c-1111fe4a39d5 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:22:06.370762 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3682ea1f-8a2a-4ce0-a52c-1111fe4a39d5 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:22:06.370868 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3682ea1f-8a2a-4ce0-a52c-1111fe4a39d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:22:06.388367 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-3682ea1f-8a2a-4ce0-a52c-1111fe4a39d5 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:22:06.392135 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-3682ea1f-8a2a-4ce0-a52c-1111fe4a39d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:22:06.445269 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 730/1449] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:22:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:22:06.454891 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c6fafc-38f6-45be-8809-99cf474089b0 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:22:06.456318 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-a5c6fafc-38f6-45be-8809-99cf474089b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:22:06.510929 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c6fafc-38f6-45be-8809-99cf474089b0 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:22:06.514579 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cc6ec9-54e2-4e53-b73f-b92fe536b8d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:22:06.515209 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc6ec9-54e2-4e53-b73f-b92fe536b8d6 service neutron] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:22:06.515494 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc6ec9-54e2-4e53-b73f-b92fe536b8d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:22:06.515776 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc6ec9-54e2-4e53-b73f-b92fe536b8d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:22:06.524846 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cc6ec9-54e2-4e53-b73f-b92fe536b8d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:22:06.526267 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cc6ec9-54e2-4e53-b73f-b92fe536b8d6 service neutron] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:22:06.535416 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 720/1450] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:22:06 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:22:07.005410 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3682ea1f-8a2a-4ce0-a52c-1111fe4a39d5 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:22:07.006978 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-3682ea1f-8a2a-4ce0-a52c-1111fe4a39d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:22:07.019806 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3682ea1f-8a2a-4ce0-a52c-1111fe4a39d5 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:22:07.025794 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54ce13d-ff08-4e49-9f08-8b606a983a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:22:07.026706 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54ce13d-ff08-4e49-9f08-8b606a983a2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:22:07.026906 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54ce13d-ff08-4e49-9f08-8b606a983a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:22:07.027281 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54ce13d-ff08-4e49-9f08-8b606a983a2e admin admin] PATH_INFO: `/v3/projects/ce4f180480024840a89a0210da934f70` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:22:07.029661 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54ce13d-ff08-4e49-9f08-8b606a983a2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce4f180480024840a89a0210da934f70)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:22:07.030862 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING py.warnings [None req-b54ce13d-ff08-4e49-9f08-8b606a983a2e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:22:07.030862 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: warnings.warn(msg) Oct 12 18:22:07.030862 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: Oct 12 18:22:07.032052 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54ce13d-ff08-4e49-9f08-8b606a983a2e admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:22:07.174973 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-b54ce13d-ff08-4e49-9f08-8b606a983a2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce4f180480024840a89a0210da934f70', 'request_id': 'req-b54ce13d-ff08-4e49-9f08-8b606a983a2e'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:22:07.187741 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-b54ce13d-ff08-4e49-9f08-8b606a983a2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce4f180480024840a89a0210da934f70', 'request_id': 'req-b54ce13d-ff08-4e49-9f08-8b606a983a2e'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:22:07.193482 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-b54ce13d-ff08-4e49-9f08-8b606a983a2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce4f180480024840a89a0210da934f70', 'request_id': 'req-b54ce13d-ff08-4e49-9f08-8b606a983a2e'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:22:07.277493 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-b54ce13d-ff08-4e49-9f08-8b606a983a2e admin admin] The token cache is being invalidate because project ce4f180480024840a89a0210da934f70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74005) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:22:07.277777 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-b54ce13d-ff08-4e49-9f08-8b606a983a2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:22:07.278518 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-b54ce13d-ff08-4e49-9f08-8b606a983a2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:22:07.280759 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 731/1451] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:22:07 2021] DELETE /identity/v3/projects/ce4f180480024840a89a0210da934f70 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:23:35.235102 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c13250-de69-4d36-a5eb-3bb98f946377 None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:23:35.235661 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c13250-de69-4d36-a5eb-3bb98f946377 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:23:35.235661 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c13250-de69-4d36-a5eb-3bb98f946377 None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:23:35.237963 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 721/1452] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 12 18:23:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:23:35.243171 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810e31c-e308-465a-bb81-af9a235a75fc None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:23:35.243631 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810e31c-e308-465a-bb81-af9a235a75fc None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:23:35.243749 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810e31c-e308-465a-bb81-af9a235a75fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:23:35.262106 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-4810e31c-e308-465a-bb81-af9a235a75fc None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:23:35.263360 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-4810e31c-e308-465a-bb81-af9a235a75fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:23:35.319607 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 732/1453] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 12 18:23:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:23:35.477367 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c13250-de69-4d36-a5eb-3bb98f946377 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:23:35.479180 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-70c13250-de69-4d36-a5eb-3bb98f946377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:23:35.536308 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dedd40-6a79-479d-9866-5f533cb4d8e7 None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:23:35.536642 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dedd40-6a79-479d-9866-5f533cb4d8e7 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:23:35.536893 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dedd40-6a79-479d-9866-5f533cb4d8e7 None None] PATH_INFO: `/v3` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:23:35.538175 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 733/1454] 10.222.0.42 () {54 vars in 925 bytes} [Tue Oct 12 18:23:35 2021] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:23:35.544755 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db683b43-9a3e-4428-907b-cb66afa58d75 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:23:35.545207 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db683b43-9a3e-4428-907b-cb66afa58d75 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:23:35.545561 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db683b43-9a3e-4428-907b-cb66afa58d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:23:35.555267 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c13250-de69-4d36-a5eb-3bb98f946377 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:23:35.560713 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2937cf0-8dff-4df7-af3c-a2d7a8c85eca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3417097a280b499086b36df9a2548239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:23:35.561358 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2937cf0-8dff-4df7-af3c-a2d7a8c85eca service nova] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:23:35.561778 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2937cf0-8dff-4df7-af3c-a2d7a8c85eca service nova] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:23:35.562063 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2937cf0-8dff-4df7-af3c-a2d7a8c85eca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:23:35.565085 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-db683b43-9a3e-4428-907b-cb66afa58d75 None None] MFA Rules not processed for user `4bd99e4f2d444a388ecde7ea3cb61089`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:23:35.566350 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-db683b43-9a3e-4428-907b-cb66afa58d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:23:35.570491 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2937cf0-8dff-4df7-af3c-a2d7a8c85eca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:23:35.572122 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2937cf0-8dff-4df7-af3c-a2d7a8c85eca service nova] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:23:35.581995 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 722/1455] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:23:35 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:23:35.639697 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 734/1456] 10.222.0.42 () {58 vars in 1015 bytes} [Tue Oct 12 18:23:35 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:23:37.024507 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35509bb5-63b1-4c08-86cf-554176091dc9 None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:23:37.025080 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35509bb5-63b1-4c08-86cf-554176091dc9 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:23:37.025080 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35509bb5-63b1-4c08-86cf-554176091dc9 None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:23:37.026835 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 723/1457] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 12 18:23:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:23:37.035542 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224265e5-9733-435a-a481-9fe9319798d4 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:23:37.036250 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224265e5-9733-435a-a481-9fe9319798d4 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:23:37.036250 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224265e5-9733-435a-a481-9fe9319798d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:23:37.053815 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-224265e5-9733-435a-a481-9fe9319798d4 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:23:37.054996 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-224265e5-9733-435a-a481-9fe9319798d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:23:37.063176 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 735/1458] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 12 18:23:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:23:37.217420 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35509bb5-63b1-4c08-86cf-554176091dc9 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:23:37.231860 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35509bb5-63b1-4c08-86cf-554176091dc9 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:23:37.237442 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65c4ea3-2180-42cb-9bb5-e758230830d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3417097a280b499086b36df9a2548239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:23:37.238075 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c4ea3-2180-42cb-9bb5-e758230830d5 service nova] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:23:37.238355 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c4ea3-2180-42cb-9bb5-e758230830d5 service nova] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:23:37.238629 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c4ea3-2180-42cb-9bb5-e758230830d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:23:37.247304 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65c4ea3-2180-42cb-9bb5-e758230830d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:23:37.248937 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65c4ea3-2180-42cb-9bb5-e758230830d5 service nova] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:23:37.258559 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 724/1459] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:23:37 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:23:39.522317 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46166b1c-7e6d-446a-8fc0-87d996d89662 None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:23:39.523037 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46166b1c-7e6d-446a-8fc0-87d996d89662 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:23:39.523154 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46166b1c-7e6d-446a-8fc0-87d996d89662 None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:23:39.525008 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 736/1460] 10.222.0.18 () {54 vars in 960 bytes} [Tue Oct 12 18:23:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:23:39.530486 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ebac1-cc63-43f7-9563-bc54a39cf385 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:23:39.530915 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ebac1-cc63-43f7-9563-bc54a39cf385 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:23:39.531046 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ebac1-cc63-43f7-9563-bc54a39cf385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:23:39.551742 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-be5ebac1-cc63-43f7-9563-bc54a39cf385 None None] MFA Rules not processed for user `4bd99e4f2d444a388ecde7ea3cb61089`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:23:39.553112 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-be5ebac1-cc63-43f7-9563-bc54a39cf385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:23:39.561851 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 725/1461] 10.222.0.18 () {58 vars in 1057 bytes} [Tue Oct 12 18:23:39 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:23:39.570222 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46166b1c-7e6d-446a-8fc0-87d996d89662 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:23:39.584244 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46166b1c-7e6d-446a-8fc0-87d996d89662 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:23:39.589400 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715365e2-f097-4b61-b698-1456e1334d6e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bd99e4f2d444a388ecde7ea3cb61089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:23:39.590037 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715365e2-f097-4b61-b698-1456e1334d6e service placement] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:23:39.590320 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715365e2-f097-4b61-b698-1456e1334d6e service placement] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:23:39.590594 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715365e2-f097-4b61-b698-1456e1334d6e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:23:39.598850 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715365e2-f097-4b61-b698-1456e1334d6e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:23:39.600488 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715365e2-f097-4b61-b698-1456e1334d6e service placement] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:23:39.609846 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 737/1462] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:23:39 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:23:49.096543 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcecebc-d32b-4570-a9bc-0ff0c9e6ebb4 None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:23:49.097160 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcecebc-d32b-4570-a9bc-0ff0c9e6ebb4 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:23:49.097160 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcecebc-d32b-4570-a9bc-0ff0c9e6ebb4 None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:23:49.098884 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 726/1463] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 12 18:23:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:23:49.104890 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203fee81-a626-4bc0-b1b5-4f6e2c7bf1fc None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:23:49.105369 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203fee81-a626-4bc0-b1b5-4f6e2c7bf1fc None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:23:49.105609 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203fee81-a626-4bc0-b1b5-4f6e2c7bf1fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:23:49.124393 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-203fee81-a626-4bc0-b1b5-4f6e2c7bf1fc None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:23:49.125655 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-203fee81-a626-4bc0-b1b5-4f6e2c7bf1fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:23:49.133424 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 738/1464] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 12 18:23:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:23:49.289670 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcecebc-d32b-4570-a9bc-0ff0c9e6ebb4 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:23:49.304583 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcecebc-d32b-4570-a9bc-0ff0c9e6ebb4 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:23:49.310220 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f334b9-455b-4163-a313-5e128da2a26c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3417097a280b499086b36df9a2548239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:23:49.310854 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f334b9-455b-4163-a313-5e128da2a26c service nova] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:23:49.311136 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f334b9-455b-4163-a313-5e128da2a26c service nova] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:23:49.311411 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f334b9-455b-4163-a313-5e128da2a26c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:23:49.320130 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f334b9-455b-4163-a313-5e128da2a26c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:23:49.321784 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f334b9-455b-4163-a313-5e128da2a26c service nova] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:23:49.331692 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 727/1465] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:23:49 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:23:50.761842 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621f306-2c19-46d5-8957-b0ea537814c3 None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:23:50.762384 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621f306-2c19-46d5-8957-b0ea537814c3 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:23:50.762384 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621f306-2c19-46d5-8957-b0ea537814c3 None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:23:50.764182 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 739/1466] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 12 18:23:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:23:50.769768 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e20b92-6e89-41bc-834c-9c9171a195a0 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:23:50.770244 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e20b92-6e89-41bc-834c-9c9171a195a0 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:23:50.770356 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e20b92-6e89-41bc-834c-9c9171a195a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:23:50.790811 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-29e20b92-6e89-41bc-834c-9c9171a195a0 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:23:50.792004 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-29e20b92-6e89-41bc-834c-9c9171a195a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:23:50.800304 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 728/1467] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 12 18:23:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:23:50.954111 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8621f306-2c19-46d5-8957-b0ea537814c3 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:23:50.969239 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8621f306-2c19-46d5-8957-b0ea537814c3 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:23:50.975265 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086807ed-5510-4e87-8367-80a350c7cbb4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3417097a280b499086b36df9a2548239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:23:50.975903 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086807ed-5510-4e87-8367-80a350c7cbb4 service nova] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:23:50.976183 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086807ed-5510-4e87-8367-80a350c7cbb4 service nova] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:23:50.976478 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086807ed-5510-4e87-8367-80a350c7cbb4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:23:50.984704 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086807ed-5510-4e87-8367-80a350c7cbb4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:23:50.986297 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086807ed-5510-4e87-8367-80a350c7cbb4 service nova] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:23:50.995851 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 740/1468] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:23:50 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:23:55.554322 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1926aad6-32da-4c85-a36d-7f98b0d89fd6 None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:23:55.554893 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1926aad6-32da-4c85-a36d-7f98b0d89fd6 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:23:55.554893 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1926aad6-32da-4c85-a36d-7f98b0d89fd6 None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:23:55.556724 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 729/1469] 127.0.0.1 () {54 vars in 916 bytes} [Tue Oct 12 18:23:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:23:55.562702 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b641b-8ffb-4dcb-beb5-8d46330b7504 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:23:55.563177 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b641b-8ffb-4dcb-beb5-8d46330b7504 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:23:55.563301 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b641b-8ffb-4dcb-beb5-8d46330b7504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:23:55.582056 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-1b0b641b-8ffb-4dcb-beb5-8d46330b7504 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:23:55.583262 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-1b0b641b-8ffb-4dcb-beb5-8d46330b7504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:23:55.591177 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 741/1470] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Oct 12 18:23:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:23:55.632378 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1926aad6-32da-4c85-a36d-7f98b0d89fd6 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:23:55.634134 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-1926aad6-32da-4c85-a36d-7f98b0d89fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:23:55.693699 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1926aad6-32da-4c85-a36d-7f98b0d89fd6 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:23:55.697434 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b32d020-b3b5-4462-815d-7dd82f84ca74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:23:55.698004 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32d020-b3b5-4462-815d-7dd82f84ca74 service neutron] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:23:55.698287 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32d020-b3b5-4462-815d-7dd82f84ca74 service neutron] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:23:55.699296 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32d020-b3b5-4462-815d-7dd82f84ca74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:23:55.708082 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b32d020-b3b5-4462-815d-7dd82f84ca74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:23:55.709569 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b32d020-b3b5-4462-815d-7dd82f84ca74 service neutron] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:23:55.719022 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 730/1471] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:23:55 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:23:58.012526 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a05db0-0553-459e-9949-6c50484886ac None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:23:58.013220 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a05db0-0553-459e-9949-6c50484886ac None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:23:58.013220 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a05db0-0553-459e-9949-6c50484886ac None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:23:58.014857 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 742/1472] 127.0.0.1 () {54 vars in 916 bytes} [Tue Oct 12 18:23:58 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:23:58.021061 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60fbd8f-2030-47b9-9ec2-52e94bcb5c74 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:23:58.029832 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60fbd8f-2030-47b9-9ec2-52e94bcb5c74 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:23:58.029832 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60fbd8f-2030-47b9-9ec2-52e94bcb5c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:23:58.039993 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-f60fbd8f-2030-47b9-9ec2-52e94bcb5c74 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:23:58.041213 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-f60fbd8f-2030-47b9-9ec2-52e94bcb5c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:23:58.049449 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 731/1473] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Oct 12 18:23:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:23:58.087767 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a05db0-0553-459e-9949-6c50484886ac None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:23:58.100661 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a05db0-0553-459e-9949-6c50484886ac None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:23:58.104217 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52fe2bd-dc84-4a43-bcf4-8c0e5855865a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:23:58.104966 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52fe2bd-dc84-4a43-bcf4-8c0e5855865a service neutron] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:23:58.105148 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52fe2bd-dc84-4a43-bcf4-8c0e5855865a service neutron] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:23:58.105420 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52fe2bd-dc84-4a43-bcf4-8c0e5855865a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:23:58.115783 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52fe2bd-dc84-4a43-bcf4-8c0e5855865a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:23:58.117309 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52fe2bd-dc84-4a43-bcf4-8c0e5855865a service neutron] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:23:58.126803 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 743/1474] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:23:58 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:24:02.053165 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fede485-d353-46e6-9810-cc25822a58b5 None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:24:02.053710 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fede485-d353-46e6-9810-cc25822a58b5 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:24:02.053710 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fede485-d353-46e6-9810-cc25822a58b5 None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:24:02.055537 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 732/1475] 127.0.0.1 () {54 vars in 916 bytes} [Tue Oct 12 18:24:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:24:02.064584 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f329d69b-e559-4dab-b355-d601921f6a51 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:24:02.065031 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f329d69b-e559-4dab-b355-d601921f6a51 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:24:02.065518 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f329d69b-e559-4dab-b355-d601921f6a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:24:02.090612 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-f329d69b-e559-4dab-b355-d601921f6a51 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:24:02.092544 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-f329d69b-e559-4dab-b355-d601921f6a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:24:02.104342 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 744/1476] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Oct 12 18:24:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:24:02.181495 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fede485-d353-46e6-9810-cc25822a58b5 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:24:02.183188 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-6fede485-d353-46e6-9810-cc25822a58b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:24:02.238383 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fede485-d353-46e6-9810-cc25822a58b5 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:24:02.241957 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28502995-1c4c-482e-b606-99a63e91e10f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6966ce0774f4437a9b688494e9d0574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:24:02.242613 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28502995-1c4c-482e-b606-99a63e91e10f service cinder] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:24:02.242893 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28502995-1c4c-482e-b606-99a63e91e10f service cinder] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:24:02.243171 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28502995-1c4c-482e-b606-99a63e91e10f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:24:02.252272 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28502995-1c4c-482e-b606-99a63e91e10f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:24:02.253769 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28502995-1c4c-482e-b606-99a63e91e10f service cinder] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:24:02.263194 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 733/1477] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:24:02 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:24:04.551259 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7239fe85-011f-4b51-a8d6-20135fcf48fc None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:24:04.551870 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7239fe85-011f-4b51-a8d6-20135fcf48fc None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:24:04.551870 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7239fe85-011f-4b51-a8d6-20135fcf48fc None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:24:04.553625 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 745/1478] 127.0.0.1 () {54 vars in 916 bytes} [Tue Oct 12 18:24:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:24:04.559705 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a5061-43e5-4738-90f2-181a4cb969c7 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:24:04.560138 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a5061-43e5-4738-90f2-181a4cb969c7 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:24:04.560254 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a5061-43e5-4738-90f2-181a4cb969c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:24:04.578370 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-623a5061-43e5-4738-90f2-181a4cb969c7 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:24:04.579591 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-623a5061-43e5-4738-90f2-181a4cb969c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:24:04.587315 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 734/1479] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Oct 12 18:24:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:24:04.638600 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3239388-767c-4f06-8f17-58f8226767a1 None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:24:04.638888 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3239388-767c-4f06-8f17-58f8226767a1 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:24:04.639279 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3239388-767c-4f06-8f17-58f8226767a1 None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:24:04.641075 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 746/1480] 10.222.0.18 () {54 vars in 962 bytes} [Tue Oct 12 18:24:04 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:24:04.646543 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a21449-8b93-47e9-8d7b-630b9c59ada5 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:24:04.646835 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a21449-8b93-47e9-8d7b-630b9c59ada5 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:24:04.647117 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a21449-8b93-47e9-8d7b-630b9c59ada5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:24:04.665892 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-a0a21449-8b93-47e9-8d7b-630b9c59ada5 None None] MFA Rules not processed for user `f6966ce0774f4437a9b688494e9d0574`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:24:04.667099 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-a0a21449-8b93-47e9-8d7b-630b9c59ada5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:24:04.674202 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 735/1481] 10.222.0.18 () {58 vars in 1059 bytes} [Tue Oct 12 18:24:04 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:24:04.682844 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3239388-767c-4f06-8f17-58f8226767a1 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:24:04.694368 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3239388-767c-4f06-8f17-58f8226767a1 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:24:04.697823 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833bfd92-aa9b-45a9-b999-b064286be41e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6966ce0774f4437a9b688494e9d0574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:24:04.698449 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833bfd92-aa9b-45a9-b999-b064286be41e service cinder] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:24:04.698726 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833bfd92-aa9b-45a9-b999-b064286be41e service cinder] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:24:04.698995 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833bfd92-aa9b-45a9-b999-b064286be41e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:24:04.707728 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833bfd92-aa9b-45a9-b999-b064286be41e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:24:04.709185 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833bfd92-aa9b-45a9-b999-b064286be41e service cinder] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:24:04.718413 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 747/1482] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:24:04 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:25:26.480434 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e437e331-f047-40d7-9b4f-974e49d49367 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:26.481022 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e437e331-f047-40d7-9b4f-974e49d49367 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:26.481022 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e437e331-f047-40d7-9b4f-974e49d49367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:26.506356 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-e437e331-f047-40d7-9b4f-974e49d49367 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:25:26.507589 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-e437e331-f047-40d7-9b4f-974e49d49367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:26.520863 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 736/1483] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:25:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:25:26.529927 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d0444c-a5ce-471e-99b1-cc7f2da97152 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:26.530479 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d0444c-a5ce-471e-99b1-cc7f2da97152 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:26.530479 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d0444c-a5ce-471e-99b1-cc7f2da97152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:26.555284 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-f4d0444c-a5ce-471e-99b1-cc7f2da97152 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:25:26.556521 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-f4d0444c-a5ce-471e-99b1-cc7f2da97152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:26.571656 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 748/1484] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:25:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:25:26.576979 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e437e331-f047-40d7-9b4f-974e49d49367 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:26.587326 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e437e331-f047-40d7-9b4f-974e49d49367 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:26.600713 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324a1219-dc9c-44a3-9626-df6114ac3d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:26.601391 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324a1219-dc9c-44a3-9626-df6114ac3d42 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:26.601671 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324a1219-dc9c-44a3-9626-df6114ac3d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:26.601946 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324a1219-dc9c-44a3-9626-df6114ac3d42 admin admin] PATH_INFO: `/v3/domains` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:26.602887 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324a1219-dc9c-44a3-9626-df6114ac3d42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:25:26.603203 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324a1219-dc9c-44a3-9626-df6114ac3d42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:26.604859 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324a1219-dc9c-44a3-9626-df6114ac3d42 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:26.621823 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 737/1485] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 12 18:25:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:25:26.631174 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d0444c-a5ce-471e-99b1-cc7f2da97152 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:26.641461 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d0444c-a5ce-471e-99b1-cc7f2da97152 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:26.657772 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13860a7c-344e-49db-b763-89c7a0191033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:26.659014 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13860a7c-344e-49db-b763-89c7a0191033 admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:26.659458 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13860a7c-344e-49db-b763-89c7a0191033 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:26.660131 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13860a7c-344e-49db-b763-89c7a0191033 admin admin] PATH_INFO: `/v3/projects` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:26.661040 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13860a7c-344e-49db-b763-89c7a0191033 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:26.663904 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13860a7c-344e-49db-b763-89c7a0191033 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:26.791197 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 749/1486] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:25:26 2021] POST /identity/v3/projects => generated 379 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:25:26.794477 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324a1219-dc9c-44a3-9626-df6114ac3d42 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:26.805074 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324a1219-dc9c-44a3-9626-df6114ac3d42 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:26.885113 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e0674e-4cd0-429a-a240-f7c5b6706967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:26.885797 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e0674e-4cd0-429a-a240-f7c5b6706967 admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:26.886079 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e0674e-4cd0-429a-a240-f7c5b6706967 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:26.886359 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e0674e-4cd0-429a-a240-f7c5b6706967 admin admin] PATH_INFO: `/v3/users` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:26.887086 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e0674e-4cd0-429a-a240-f7c5b6706967 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:26.889076 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e0674e-4cd0-429a-a240-f7c5b6706967 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:26.995449 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102667a3-1d8c-4dd9-83be-41a4a453bee8 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:26.996283 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102667a3-1d8c-4dd9-83be-41a4a453bee8 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:26.996790 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102667a3-1d8c-4dd9-83be-41a4a453bee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:27.022046 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 738/1487] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:25:26 2021] POST /identity/v3/users => generated 290 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 18:25:27.027703 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e0674e-4cd0-429a-a240-f7c5b6706967 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:27.027850 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-102667a3-1d8c-4dd9-83be-41a4a453bee8 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:25:27.027850 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-102667a3-1d8c-4dd9-83be-41a4a453bee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:27.034236 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e0674e-4cd0-429a-a240-f7c5b6706967 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:27.045173 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 750/1488] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:25:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:25:27.046124 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19384828-3a2b-44e9-a701-7828cd5f44d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:27.046397 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19384828-3a2b-44e9-a701-7828cd5f44d9 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:27.046684 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19384828-3a2b-44e9-a701-7828cd5f44d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:27.051086 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19384828-3a2b-44e9-a701-7828cd5f44d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:27.051086 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19384828-3a2b-44e9-a701-7828cd5f44d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:27.051086 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19384828-3a2b-44e9-a701-7828cd5f44d9 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:27.055537 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7156b-a1b4-4a55-a031-d5ffa7837176 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:27.056091 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7156b-a1b4-4a55-a031-d5ffa7837176 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:27.056579 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7156b-a1b4-4a55-a031-d5ffa7837176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:27.066275 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 739/1489] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:25:27 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 18:25:27.070781 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19384828-3a2b-44e9-a701-7828cd5f44d9 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:27.086156 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19384828-3a2b-44e9-a701-7828cd5f44d9 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:27.093448 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-bea7156b-a1b4-4a55-a031-d5ffa7837176 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:25:27.095859 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-bea7156b-a1b4-4a55-a031-d5ffa7837176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:27.097250 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05087cb-d1f9-496e-8484-a944dbe75fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:27.097951 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05087cb-d1f9-496e-8484-a944dbe75fa7 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:27.098238 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05087cb-d1f9-496e-8484-a944dbe75fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:27.098543 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05087cb-d1f9-496e-8484-a944dbe75fa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:27.099452 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05087cb-d1f9-496e-8484-a944dbe75fa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:27.101613 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05087cb-d1f9-496e-8484-a944dbe75fa7 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:27.109917 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 751/1490] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:25:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:25:27.116181 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 740/1491] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:25:27 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 18:25:27.116884 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea7156b-a1b4-4a55-a031-d5ffa7837176 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:27.120493 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05087cb-d1f9-496e-8484-a944dbe75fa7 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:27.131407 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05087cb-d1f9-496e-8484-a944dbe75fa7 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:27.137150 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea7156b-a1b4-4a55-a031-d5ffa7837176 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:27.146650 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0d37a9-83ae-41f5-bcc0-366ae358c1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:27.147573 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0d37a9-83ae-41f5-bcc0-366ae358c1e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:27.147857 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0d37a9-83ae-41f5-bcc0-366ae358c1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:27.148132 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0d37a9-83ae-41f5-bcc0-366ae358c1e2 admin admin] PATH_INFO: `/v3/projects/9da6195bb2d64abfa8cd8671874f1830/users/15239896ef4b4f50af6af54712301f5b/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:27.148534 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320d693a-f229-44b5-8de3-b3a3ce38ebfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:27.150377 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d693a-f229-44b5-8de3-b3a3ce38ebfe admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:27.150860 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d693a-f229-44b5-8de3-b3a3ce38ebfe admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:27.151327 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d693a-f229-44b5-8de3-b3a3ce38ebfe admin admin] PATH_INFO: `/v3/domains` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:27.152277 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320d693a-f229-44b5-8de3-b3a3ce38ebfe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:25:27.152818 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320d693a-f229-44b5-8de3-b3a3ce38ebfe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:27.154646 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320d693a-f229-44b5-8de3-b3a3ce38ebfe admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:27.173904 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0d37a9-83ae-41f5-bcc0-366ae358c1e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9da6195bb2d64abfa8cd8671874f1830, user_id=15239896ef4b4f50af6af54712301f5b, role_id=33b8a5a8d1d643f2a98f598e6ab0a1cf)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:27.179281 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0d37a9-83ae-41f5-bcc0-366ae358c1e2 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:27.179906 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 752/1492] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 12 18:25:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:25:27.182208 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f548a-eb40-43ee-af5e-20adeb8cbc24 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:27.182722 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f548a-eb40-43ee-af5e-20adeb8cbc24 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:27.183492 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f548a-eb40-43ee-af5e-20adeb8cbc24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:27.213194 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-496f548a-eb40-43ee-af5e-20adeb8cbc24 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:25:27.214742 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-496f548a-eb40-43ee-af5e-20adeb8cbc24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:27.226089 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 753/1493] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:25:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:25:27.226975 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496f548a-eb40-43ee-af5e-20adeb8cbc24 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:27.244143 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496f548a-eb40-43ee-af5e-20adeb8cbc24 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:27.252595 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc92222-5853-4a1c-bb8f-babf8d75aad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:27.253278 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc92222-5853-4a1c-bb8f-babf8d75aad3 admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:27.253561 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc92222-5853-4a1c-bb8f-babf8d75aad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:27.253835 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc92222-5853-4a1c-bb8f-babf8d75aad3 admin admin] PATH_INFO: `/v3/projects` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:27.254546 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc92222-5853-4a1c-bb8f-babf8d75aad3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:27.256675 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc92222-5853-4a1c-bb8f-babf8d75aad3 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:27.290614 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 741/1494] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:25:27 2021] PUT /identity/v3/projects/9da6195bb2d64abfa8cd8671874f1830/users/15239896ef4b4f50af6af54712301f5b/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 18:25:27.292199 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79fc882-ea13-477e-8beb-ea386bf21db8 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:27.292527 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79fc882-ea13-477e-8beb-ea386bf21db8 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:27.292808 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79fc882-ea13-477e-8beb-ea386bf21db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:27.313536 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-a79fc882-ea13-477e-8beb-ea386bf21db8 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:25:27.313536 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-a79fc882-ea13-477e-8beb-ea386bf21db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:27.371150 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 742/1495] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:25:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:25:27.372820 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50894a47-843f-4faf-b58c-e1c1e9195ea4 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:27.373282 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50894a47-843f-4faf-b58c-e1c1e9195ea4 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:27.373721 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50894a47-843f-4faf-b58c-e1c1e9195ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:27.383124 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 754/1496] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:25:27 2021] POST /identity/v3/projects => generated 405 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:25:27.387978 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6301e74-8464-48ae-a719-42d6ecc7d9fe None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:27.388264 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6301e74-8464-48ae-a719-42d6ecc7d9fe None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:27.388560 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6301e74-8464-48ae-a719-42d6ecc7d9fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:27.393137 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-50894a47-843f-4faf-b58c-e1c1e9195ea4 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:25:27.394290 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-50894a47-843f-4faf-b58c-e1c1e9195ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:27.408678 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-f6301e74-8464-48ae-a719-42d6ecc7d9fe None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:25:27.409860 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-f6301e74-8464-48ae-a719-42d6ecc7d9fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:27.452490 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 743/1497] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:25:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:25:27.454088 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce1ec6-e93c-4fd2-8d8d-f9ef1fb9c0b6 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:27.454374 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce1ec6-e93c-4fd2-8d8d-f9ef1fb9c0b6 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:27.454651 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce1ec6-e93c-4fd2-8d8d-f9ef1fb9c0b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:27.470772 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 755/1498] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:25:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:25:27.472358 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165606ff-09ee-434a-a5a1-9199023478e7 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:27.472533 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-81ce1ec6-e93c-4fd2-8d8d-f9ef1fb9c0b6 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:25:27.472654 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165606ff-09ee-434a-a5a1-9199023478e7 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:27.472930 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165606ff-09ee-434a-a5a1-9199023478e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:27.473834 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-81ce1ec6-e93c-4fd2-8d8d-f9ef1fb9c0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:27.482918 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 744/1499] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:25:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:25:27.484829 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fde7ea-e62f-4882-9eb4-6a475df27e01 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:27.485257 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fde7ea-e62f-4882-9eb4-6a475df27e01 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:27.485569 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fde7ea-e62f-4882-9eb4-6a475df27e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:27.490780 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-165606ff-09ee-434a-a5a1-9199023478e7 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:25:27.491999 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-165606ff-09ee-434a-a5a1-9199023478e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:27.499532 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 756/1500] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:25:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:25:27.500861 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47181179-71e7-4622-adee-ae06f18616dd None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:27.501146 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47181179-71e7-4622-adee-ae06f18616dd None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:27.501422 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47181179-71e7-4622-adee-ae06f18616dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:27.504615 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-c9fde7ea-e62f-4882-9eb4-6a475df27e01 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:25:27.506446 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-c9fde7ea-e62f-4882-9eb4-6a475df27e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:27.515903 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 745/1501] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:25:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:25:27.517800 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd504ae-e927-4878-b471-9c29b00f420c None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:27.518155 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd504ae-e927-4878-b471-9c29b00f420c None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:27.518494 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd504ae-e927-4878-b471-9c29b00f420c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:27.520299 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-47181179-71e7-4622-adee-ae06f18616dd None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:25:27.522176 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-47181179-71e7-4622-adee-ae06f18616dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:27.532289 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 757/1502] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:25:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:25:27.533415 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47181179-71e7-4622-adee-ae06f18616dd None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:27.539054 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-ddd504ae-e927-4878-b471-9c29b00f420c None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:25:27.540036 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-ddd504ae-e927-4878-b471-9c29b00f420c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:27.548031 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 746/1503] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:25:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:25:27.548470 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47181179-71e7-4622-adee-ae06f18616dd None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:27.549032 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd504ae-e927-4878-b471-9c29b00f420c None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:27.553507 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87a36dd-2061-426b-89bd-b9c62b837752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:27.554334 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a36dd-2061-426b-89bd-b9c62b837752 admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:27.554611 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a36dd-2061-426b-89bd-b9c62b837752 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:27.554887 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a36dd-2061-426b-89bd-b9c62b837752 admin admin] PATH_INFO: `/v3/users` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:27.555588 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87a36dd-2061-426b-89bd-b9c62b837752 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:27.557566 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87a36dd-2061-426b-89bd-b9c62b837752 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:27.558469 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd504ae-e927-4878-b471-9c29b00f420c None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:27.562979 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dd93b6-e1a8-439f-b007-be626f1190fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:27.563671 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd93b6-e1a8-439f-b007-be626f1190fc admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:27.563891 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd93b6-e1a8-439f-b007-be626f1190fc admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:27.564163 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd93b6-e1a8-439f-b007-be626f1190fc admin admin] PATH_INFO: `/v3/domains` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:27.565303 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dd93b6-e1a8-439f-b007-be626f1190fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:25:27.565303 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dd93b6-e1a8-439f-b007-be626f1190fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:27.566987 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dd93b6-e1a8-439f-b007-be626f1190fc admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:27.578665 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 747/1504] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 12 18:25:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:25:27.580015 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b167ba40-f036-4332-a9cf-540eebd770f5 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:27.582528 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b167ba40-f036-4332-a9cf-540eebd770f5 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:27.582528 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b167ba40-f036-4332-a9cf-540eebd770f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:27.598612 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-b167ba40-f036-4332-a9cf-540eebd770f5 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:25:27.599793 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-b167ba40-f036-4332-a9cf-540eebd770f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:27.607762 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 748/1505] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:25:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:25:27.609633 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4565e0b-91b0-4697-bf76-38c2dac59758 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:27.609633 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4565e0b-91b0-4697-bf76-38c2dac59758 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:27.609633 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4565e0b-91b0-4697-bf76-38c2dac59758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:27.627717 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-b4565e0b-91b0-4697-bf76-38c2dac59758 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:25:27.628932 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-b4565e0b-91b0-4697-bf76-38c2dac59758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:27.637543 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 749/1506] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:25:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:25:27.638581 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4565e0b-91b0-4697-bf76-38c2dac59758 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:27.666755 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 758/1507] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:25:27 2021] POST /identity/v3/users => generated 303 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:25:27.666755 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa76d8-ef6a-46c3-b8db-4bc850b2c95e None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:27.666755 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa76d8-ef6a-46c3-b8db-4bc850b2c95e None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:27.666755 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa76d8-ef6a-46c3-b8db-4bc850b2c95e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:27.684635 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-43aa76d8-ef6a-46c3-b8db-4bc850b2c95e None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:25:27.685851 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-43aa76d8-ef6a-46c3-b8db-4bc850b2c95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:27.692738 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4565e0b-91b0-4697-bf76-38c2dac59758 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:27.695159 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 759/1508] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:25:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:25:27.696458 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf55da-61ac-402f-a3e3-0d713c037b73 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:27.696745 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf55da-61ac-402f-a3e3-0d713c037b73 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:27.697044 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf55da-61ac-402f-a3e3-0d713c037b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:27.700684 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9f9414-e124-42cd-9847-7b0a2c091647 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:27.701347 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f9414-e124-42cd-9847-7b0a2c091647 service neutron] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:27.701624 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f9414-e124-42cd-9847-7b0a2c091647 service neutron] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:27.701905 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f9414-e124-42cd-9847-7b0a2c091647 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:27.710905 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9f9414-e124-42cd-9847-7b0a2c091647 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:27.712330 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9f9414-e124-42cd-9847-7b0a2c091647 service neutron] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:27.714376 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-1baf55da-61ac-402f-a3e3-0d713c037b73 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:25:27.715562 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-1baf55da-61ac-402f-a3e3-0d713c037b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:27.721904 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 750/1509] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:25:27 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:25:27.722698 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9f9414-e124-42cd-9847-7b0a2c091647 service neutron] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:27.724536 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 760/1510] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:25:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:25:27.725606 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baf55da-61ac-402f-a3e3-0d713c037b73 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:27.732631 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9f9414-e124-42cd-9847-7b0a2c091647 service neutron] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:27.737353 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baf55da-61ac-402f-a3e3-0d713c037b73 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:27.737804 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457b062f-e5b4-4380-8003-6a14eeb52e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:27.738460 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b062f-e5b4-4380-8003-6a14eeb52e5a admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:27.738734 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b062f-e5b4-4380-8003-6a14eeb52e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:27.739010 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b062f-e5b4-4380-8003-6a14eeb52e5a admin admin] PATH_INFO: `/v3/domains` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:27.739753 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457b062f-e5b4-4380-8003-6a14eeb52e5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:25:27.740620 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457b062f-e5b4-4380-8003-6a14eeb52e5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:27.742765 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457b062f-e5b4-4380-8003-6a14eeb52e5a admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:27.745223 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d199e5-7601-4ecb-88e2-7d08d484fb3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:27.745891 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d199e5-7601-4ecb-88e2-7d08d484fb3c admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:27.746174 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d199e5-7601-4ecb-88e2-7d08d484fb3c admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:27.746468 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d199e5-7601-4ecb-88e2-7d08d484fb3c admin admin] PATH_INFO: `/v3/projects` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:27.747161 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d199e5-7601-4ecb-88e2-7d08d484fb3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:27.749121 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d199e5-7601-4ecb-88e2-7d08d484fb3c admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:27.756194 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 751/1511] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 12 18:25:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:25:27.776847 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457b062f-e5b4-4380-8003-6a14eeb52e5a admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:27.776847 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457b062f-e5b4-4380-8003-6a14eeb52e5a admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:27.776847 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d057537-bf23-49a6-9da5-845d36283303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:27.776847 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d057537-bf23-49a6-9da5-845d36283303 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:27.777264 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d057537-bf23-49a6-9da5-845d36283303 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:27.777264 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d057537-bf23-49a6-9da5-845d36283303 admin admin] PATH_INFO: `/v3/domains` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:27.777264 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d057537-bf23-49a6-9da5-845d36283303 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:25:27.777264 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d057537-bf23-49a6-9da5-845d36283303 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:27.777264 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d057537-bf23-49a6-9da5-845d36283303 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:27.796710 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 752/1512] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 12 18:25:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:25:27.796710 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d057537-bf23-49a6-9da5-845d36283303 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:27.805124 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d057537-bf23-49a6-9da5-845d36283303 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:27.806350 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79876e7e-514f-4b4d-a064-6e1fb858cf79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:27.807036 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79876e7e-514f-4b4d-a064-6e1fb858cf79 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:27.807358 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79876e7e-514f-4b4d-a064-6e1fb858cf79 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:27.807697 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79876e7e-514f-4b4d-a064-6e1fb858cf79 admin admin] PATH_INFO: `/v3/domains` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:27.808426 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79876e7e-514f-4b4d-a064-6e1fb858cf79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:25:27.808732 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79876e7e-514f-4b4d-a064-6e1fb858cf79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:27.810280 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79876e7e-514f-4b4d-a064-6e1fb858cf79 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:27.821965 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 753/1513] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 12 18:25:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:25:27.823442 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79876e7e-514f-4b4d-a064-6e1fb858cf79 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:27.833005 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79876e7e-514f-4b4d-a064-6e1fb858cf79 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:27.837881 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b18b40b-6fd0-43f1-9d4d-ed2d1f115a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:27.838619 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18b40b-6fd0-43f1-9d4d-ed2d1f115a84 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:27.838919 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18b40b-6fd0-43f1-9d4d-ed2d1f115a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:27.839195 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18b40b-6fd0-43f1-9d4d-ed2d1f115a84 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:27.839926 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b18b40b-6fd0-43f1-9d4d-ed2d1f115a84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:27.841548 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b18b40b-6fd0-43f1-9d4d-ed2d1f115a84 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:27.853467 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 754/1514] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:25:27 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:25:27.853467 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b18b40b-6fd0-43f1-9d4d-ed2d1f115a84 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:27.860435 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 761/1515] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:25:27 2021] POST /identity/v3/projects => generated 365 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:25:27.878622 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d199e5-7601-4ecb-88e2-7d08d484fb3c admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:27.878779 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b18b40b-6fd0-43f1-9d4d-ed2d1f115a84 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:27.924189 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71693716-4e96-4e49-93a7-5a4382382b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:27.924889 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71693716-4e96-4e49-93a7-5a4382382b86 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:27.925167 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71693716-4e96-4e49-93a7-5a4382382b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:27.925436 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71693716-4e96-4e49-93a7-5a4382382b86 admin admin] PATH_INFO: `/v3/domains` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:27.926166 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71693716-4e96-4e49-93a7-5a4382382b86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:25:27.926571 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71693716-4e96-4e49-93a7-5a4382382b86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:27.928648 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71693716-4e96-4e49-93a7-5a4382382b86 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:27.933120 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d199e5-7601-4ecb-88e2-7d08d484fb3c admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:27.938706 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847ec499-3684-4a98-a1c8-a18f790d29f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:27.942490 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847ec499-3684-4a98-a1c8-a18f790d29f1 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:27.942490 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847ec499-3684-4a98-a1c8-a18f790d29f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:27.942490 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847ec499-3684-4a98-a1c8-a18f790d29f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:27.942490 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847ec499-3684-4a98-a1c8-a18f790d29f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:25:27.942490 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847ec499-3684-4a98-a1c8-a18f790d29f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:27.942955 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 755/1516] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 12 18:25:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:25:27.942955 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71693716-4e96-4e49-93a7-5a4382382b86 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:27.943666 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847ec499-3684-4a98-a1c8-a18f790d29f1 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:27.953111 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71693716-4e96-4e49-93a7-5a4382382b86 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:27.955629 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 762/1517] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 12 18:25:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:25:27.956658 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847ec499-3684-4a98-a1c8-a18f790d29f1 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:27.958121 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f9a659-2286-4a48-b6d8-28228d629a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:27.958773 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f9a659-2286-4a48-b6d8-28228d629a7b admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:27.959051 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f9a659-2286-4a48-b6d8-28228d629a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:27.959323 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f9a659-2286-4a48-b6d8-28228d629a7b admin admin] PATH_INFO: `/v3/projects` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:27.960016 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f9a659-2286-4a48-b6d8-28228d629a7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:27.962333 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f9a659-2286-4a48-b6d8-28228d629a7b admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:27.966335 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847ec499-3684-4a98-a1c8-a18f790d29f1 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:27.971246 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f8dc65-7c06-4d6f-9e2b-d4422a12714a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:27.972139 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f8dc65-7c06-4d6f-9e2b-d4422a12714a admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:27.972592 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f8dc65-7c06-4d6f-9e2b-d4422a12714a admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:27.982566 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f8dc65-7c06-4d6f-9e2b-d4422a12714a admin admin] PATH_INFO: `/v3/projects` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:27.982566 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f8dc65-7c06-4d6f-9e2b-d4422a12714a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:27.982566 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f8dc65-7c06-4d6f-9e2b-d4422a12714a admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:28.111390 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 756/1518] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:25:27 2021] POST /identity/v3/projects => generated 385 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:25:28.113642 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f9a659-2286-4a48-b6d8-28228d629a7b admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:28.133858 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 763/1519] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:25:27 2021] POST /identity/v3/projects => generated 375 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:25:28.134698 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f8dc65-7c06-4d6f-9e2b-d4422a12714a admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:28.176804 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f9a659-2286-4a48-b6d8-28228d629a7b admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:28.196363 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f8dc65-7c06-4d6f-9e2b-d4422a12714a admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:28.201304 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2910c252-8f0f-4e40-841a-f332d13e1874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:28.201964 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910c252-8f0f-4e40-841a-f332d13e1874 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:28.202245 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910c252-8f0f-4e40-841a-f332d13e1874 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:28.202522 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910c252-8f0f-4e40-841a-f332d13e1874 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:28.203265 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2910c252-8f0f-4e40-841a-f332d13e1874 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:28.204964 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2910c252-8f0f-4e40-841a-f332d13e1874 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:28.217448 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 764/1520] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:25:28 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:25:28.218572 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2910c252-8f0f-4e40-841a-f332d13e1874 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:28.229545 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2910c252-8f0f-4e40-841a-f332d13e1874 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:28.234559 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d22334-b98d-4ee8-a72f-538a0a0f5a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:28.235343 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d22334-b98d-4ee8-a72f-538a0a0f5a5a admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:28.235629 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d22334-b98d-4ee8-a72f-538a0a0f5a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:28.235932 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d22334-b98d-4ee8-a72f-538a0a0f5a5a admin admin] PATH_INFO: `/v3/users` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:28.236679 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d22334-b98d-4ee8-a72f-538a0a0f5a5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:28.238859 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d22334-b98d-4ee8-a72f-538a0a0f5a5a admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:28.244725 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dccdfce-4018-4de2-acd0-9aeef4daa399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:28.245440 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dccdfce-4018-4de2-acd0-9aeef4daa399 admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:28.245722 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dccdfce-4018-4de2-acd0-9aeef4daa399 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:28.246156 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dccdfce-4018-4de2-acd0-9aeef4daa399 admin admin] PATH_INFO: `/v3/projects` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:28.246723 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dccdfce-4018-4de2-acd0-9aeef4daa399 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:28.248670 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dccdfce-4018-4de2-acd0-9aeef4daa399 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:28.330371 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 757/1521] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:25:28 2021] POST /identity/v3/projects => generated 367 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:25:28.331417 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dccdfce-4018-4de2-acd0-9aeef4daa399 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:28.332331 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 765/1522] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:25:28 2021] POST /identity/v3/users => generated 283 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:25:28.334441 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d22334-b98d-4ee8-a72f-538a0a0f5a5a admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:28.346332 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d22334-b98d-4ee8-a72f-538a0a0f5a5a admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:28.400011 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dccdfce-4018-4de2-acd0-9aeef4daa399 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:28.404848 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63e3609-a307-4f47-8317-e63ecd219e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:28.405507 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e3609-a307-4f47-8317-e63ecd219e5f admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:28.405798 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e3609-a307-4f47-8317-e63ecd219e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:28.406054 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e3609-a307-4f47-8317-e63ecd219e5f admin admin] PATH_INFO: `/v3/projects` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:28.406764 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63e3609-a307-4f47-8317-e63ecd219e5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:28.407666 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dad725-f0ca-4597-90c8-c93f733a4fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:28.408331 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dad725-f0ca-4597-90c8-c93f733a4fec admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:28.408651 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dad725-f0ca-4597-90c8-c93f733a4fec admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:28.408869 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63e3609-a307-4f47-8317-e63ecd219e5f admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:28.409001 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dad725-f0ca-4597-90c8-c93f733a4fec admin admin] PATH_INFO: `/v3/projects` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:28.409621 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dad725-f0ca-4597-90c8-c93f733a4fec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:28.411559 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dad725-f0ca-4597-90c8-c93f733a4fec admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:28.487585 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 758/1523] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:25:28 2021] POST /identity/v3/projects => generated 405 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:25:28.489136 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63e3609-a307-4f47-8317-e63ecd219e5f admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:28.522920 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 766/1524] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:25:28 2021] POST /identity/v3/projects => generated 389 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:25:28.524742 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dad725-f0ca-4597-90c8-c93f733a4fec admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:28.552911 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63e3609-a307-4f47-8317-e63ecd219e5f admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:28.587404 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dad725-f0ca-4597-90c8-c93f733a4fec admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:28.592659 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be57fdcc-5dc6-47d3-b15e-a7954b843112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:28.593400 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be57fdcc-5dc6-47d3-b15e-a7954b843112 admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:28.593681 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be57fdcc-5dc6-47d3-b15e-a7954b843112 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:28.593954 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be57fdcc-5dc6-47d3-b15e-a7954b843112 admin admin] PATH_INFO: `/v3/users` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:28.594665 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be57fdcc-5dc6-47d3-b15e-a7954b843112 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:28.597095 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be57fdcc-5dc6-47d3-b15e-a7954b843112 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:28.611520 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c634bc5-04ae-44c6-9247-15e0274c4d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:28.612760 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c634bc5-04ae-44c6-9247-15e0274c4d5c admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:28.612760 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c634bc5-04ae-44c6-9247-15e0274c4d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:28.612760 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c634bc5-04ae-44c6-9247-15e0274c4d5c admin admin] PATH_INFO: `/v3/users` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:28.616925 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c634bc5-04ae-44c6-9247-15e0274c4d5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:28.616925 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c634bc5-04ae-44c6-9247-15e0274c4d5c admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:28.669673 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 767/1525] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:25:28 2021] POST /identity/v3/users => generated 288 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:25:28.669673 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be57fdcc-5dc6-47d3-b15e-a7954b843112 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:28.680971 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be57fdcc-5dc6-47d3-b15e-a7954b843112 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:28.686569 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832dda9f-649b-4833-965f-ba50fb704853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:28.687614 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832dda9f-649b-4833-965f-ba50fb704853 admin admin] REQUEST_METHOD: `PUT` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:28.687969 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832dda9f-649b-4833-965f-ba50fb704853 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:28.688345 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832dda9f-649b-4833-965f-ba50fb704853 admin admin] PATH_INFO: `/v3/projects/0e8e9dc83e25477dae45ac51e7fee2c6/users/548ce7f3a2b74ce5bc70afbc0463f391/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:28.689682 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 759/1526] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:25:28 2021] POST /identity/v3/users => generated 293 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:25:28.694686 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c634bc5-04ae-44c6-9247-15e0274c4d5c admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:28.704685 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832dda9f-649b-4833-965f-ba50fb704853 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e8e9dc83e25477dae45ac51e7fee2c6, user_id=548ce7f3a2b74ce5bc70afbc0463f391, role_id=33b8a5a8d1d643f2a98f598e6ab0a1cf)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:28.704884 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c634bc5-04ae-44c6-9247-15e0274c4d5c admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:28.707598 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832dda9f-649b-4833-965f-ba50fb704853 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:28.709869 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7b2110-de2b-4f93-8269-afb9aa1b8f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:28.710520 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b2110-de2b-4f93-8269-afb9aa1b8f35 admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:28.710944 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b2110-de2b-4f93-8269-afb9aa1b8f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:28.711220 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b2110-de2b-4f93-8269-afb9aa1b8f35 admin admin] PATH_INFO: `/v3/users` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:28.711915 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7b2110-de2b-4f93-8269-afb9aa1b8f35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:28.713861 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7b2110-de2b-4f93-8269-afb9aa1b8f35 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:28.760699 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 768/1527] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:25:28 2021] PUT /identity/v3/projects/0e8e9dc83e25477dae45ac51e7fee2c6/users/548ce7f3a2b74ce5bc70afbc0463f391/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:25:28.761735 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832dda9f-649b-4833-965f-ba50fb704853 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:28.812667 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 760/1528] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:25:28 2021] POST /identity/v3/users => generated 284 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:25:28.812667 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7b2110-de2b-4f93-8269-afb9aa1b8f35 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:28.821921 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7b2110-de2b-4f93-8269-afb9aa1b8f35 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:28.827329 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cc99ca-d350-4f35-b53c-e0b9e8c357d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:28.828007 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc99ca-d350-4f35-b53c-e0b9e8c357d3 admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:28.828171 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832dda9f-649b-4833-965f-ba50fb704853 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:28.828343 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc99ca-d350-4f35-b53c-e0b9e8c357d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:28.828557 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc99ca-d350-4f35-b53c-e0b9e8c357d3 admin admin] PATH_INFO: `/v3/users` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:28.829259 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cc99ca-d350-4f35-b53c-e0b9e8c357d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:28.831180 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cc99ca-d350-4f35-b53c-e0b9e8c357d3 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:28.832821 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80432785-c4ac-43dd-b6ca-5580b3b93d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:28.833520 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80432785-c4ac-43dd-b6ca-5580b3b93d2a admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:28.841792 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80432785-c4ac-43dd-b6ca-5580b3b93d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:28.842342 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80432785-c4ac-43dd-b6ca-5580b3b93d2a admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:28.843352 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80432785-c4ac-43dd-b6ca-5580b3b93d2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:28.845227 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80432785-c4ac-43dd-b6ca-5580b3b93d2a admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:28.856761 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 769/1529] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:25:28 2021] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:25:28.857646 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80432785-c4ac-43dd-b6ca-5580b3b93d2a admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:28.867441 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80432785-c4ac-43dd-b6ca-5580b3b93d2a admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:28.872340 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff8f1b8-2aeb-461d-8092-bbc104b1a749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:28.886535 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff8f1b8-2aeb-461d-8092-bbc104b1a749 admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:28.886535 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff8f1b8-2aeb-461d-8092-bbc104b1a749 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:28.886535 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff8f1b8-2aeb-461d-8092-bbc104b1a749 admin admin] PATH_INFO: `/v3/users` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:28.886535 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff8f1b8-2aeb-461d-8092-bbc104b1a749 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:28.886535 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff8f1b8-2aeb-461d-8092-bbc104b1a749 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:28.998042 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 761/1530] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:25:28 2021] POST /identity/v3/users => generated 303 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:25:28.998042 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cc99ca-d350-4f35-b53c-e0b9e8c357d3 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:29.008937 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cc99ca-d350-4f35-b53c-e0b9e8c357d3 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:29.017505 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2367ab1d-8c9e-4204-8c90-04e6acc02d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:29.028191 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 770/1531] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:25:28 2021] POST /identity/v3/users => generated 295 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:25:29.028444 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2367ab1d-8c9e-4204-8c90-04e6acc02d58 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:29.028444 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2367ab1d-8c9e-4204-8c90-04e6acc02d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:29.028444 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2367ab1d-8c9e-4204-8c90-04e6acc02d58 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:29.028722 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff8f1b8-2aeb-461d-8092-bbc104b1a749 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:29.028808 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2367ab1d-8c9e-4204-8c90-04e6acc02d58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:29.028808 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2367ab1d-8c9e-4204-8c90-04e6acc02d58 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:29.038259 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 762/1532] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:25:28 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:25:29.038259 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009cef71-438a-4b59-a992-00c6ba711c31 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:29.038259 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009cef71-438a-4b59-a992-00c6ba711c31 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:29.038259 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009cef71-438a-4b59-a992-00c6ba711c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:29.041321 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff8f1b8-2aeb-461d-8092-bbc104b1a749 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:29.046495 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f395430b-fd5c-4188-9863-efa551289849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:29.047212 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f395430b-fd5c-4188-9863-efa551289849 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:29.047497 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f395430b-fd5c-4188-9863-efa551289849 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:29.047795 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f395430b-fd5c-4188-9863-efa551289849 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:29.048561 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f395430b-fd5c-4188-9863-efa551289849 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:29.050170 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f395430b-fd5c-4188-9863-efa551289849 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:29.055895 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-009cef71-438a-4b59-a992-00c6ba711c31 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:25:29.057142 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-009cef71-438a-4b59-a992-00c6ba711c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:29.064885 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 771/1533] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:25:29 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:25:29.064885 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f395430b-fd5c-4188-9863-efa551289849 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:29.067837 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 763/1534] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:25:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:25:29.072979 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009cef71-438a-4b59-a992-00c6ba711c31 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:29.076210 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f395430b-fd5c-4188-9863-efa551289849 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:29.081114 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d019b9-be3f-449b-8125-0aa1cc2f2144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:29.081933 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d019b9-be3f-449b-8125-0aa1cc2f2144 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:29.082309 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d019b9-be3f-449b-8125-0aa1cc2f2144 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:29.082672 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d019b9-be3f-449b-8125-0aa1cc2f2144 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:29.082859 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009cef71-438a-4b59-a992-00c6ba711c31 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:29.083664 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d019b9-be3f-449b-8125-0aa1cc2f2144 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:29.086577 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d019b9-be3f-449b-8125-0aa1cc2f2144 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:29.090052 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95404332-9690-4a8d-88d5-d6518d31ea30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:29.098253 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95404332-9690-4a8d-88d5-d6518d31ea30 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:29.098253 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95404332-9690-4a8d-88d5-d6518d31ea30 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:29.098253 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95404332-9690-4a8d-88d5-d6518d31ea30 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:29.098253 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95404332-9690-4a8d-88d5-d6518d31ea30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:29.098253 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95404332-9690-4a8d-88d5-d6518d31ea30 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:29.098635 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 772/1535] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:25:29 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:25:29.098635 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d019b9-be3f-449b-8125-0aa1cc2f2144 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:29.107497 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 764/1536] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:25:29 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:25:29.107497 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95404332-9690-4a8d-88d5-d6518d31ea30 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:29.108679 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d019b9-be3f-449b-8125-0aa1cc2f2144 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:29.113214 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e3b5ca-a270-4c11-808a-54d1e469ecdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:29.113859 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3b5ca-a270-4c11-808a-54d1e469ecdf admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:29.114135 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3b5ca-a270-4c11-808a-54d1e469ecdf admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:29.114408 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3b5ca-a270-4c11-808a-54d1e469ecdf admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:29.115646 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e3b5ca-a270-4c11-808a-54d1e469ecdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:29.117420 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e3b5ca-a270-4c11-808a-54d1e469ecdf admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:29.117557 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95404332-9690-4a8d-88d5-d6518d31ea30 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:29.122439 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7ceb80-1b41-4380-859b-e25cc1495b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:29.123072 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ceb80-1b41-4380-859b-e25cc1495b80 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:29.123354 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ceb80-1b41-4380-859b-e25cc1495b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:29.123625 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ceb80-1b41-4380-859b-e25cc1495b80 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:29.124345 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7ceb80-1b41-4380-859b-e25cc1495b80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:29.125937 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7ceb80-1b41-4380-859b-e25cc1495b80 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:29.127280 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 773/1537] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:25:29 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:25:29.128526 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3dde10-1c93-4047-9c97-93630a045464 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:29.128812 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3dde10-1c93-4047-9c97-93630a045464 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:29.129086 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3dde10-1c93-4047-9c97-93630a045464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:29.137465 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 765/1538] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:25:29 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:25:29.138378 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7ceb80-1b41-4380-859b-e25cc1495b80 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:29.150500 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7ceb80-1b41-4380-859b-e25cc1495b80 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:29.155505 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93521f5-d309-4621-a4ed-fb66fe2682aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:29.156242 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93521f5-d309-4621-a4ed-fb66fe2682aa admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:29.156563 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93521f5-d309-4621-a4ed-fb66fe2682aa admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:29.156839 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93521f5-d309-4621-a4ed-fb66fe2682aa admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:29.157682 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93521f5-d309-4621-a4ed-fb66fe2682aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:29.158343 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-ca3dde10-1c93-4047-9c97-93630a045464 None None] MFA Rules not processed for user `15239896ef4b4f50af6af54712301f5b`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:25:29.159269 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93521f5-d309-4621-a4ed-fb66fe2682aa admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:29.159546 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-ca3dde10-1c93-4047-9c97-93630a045464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:29.169869 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 766/1539] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:25:29 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:25:29.170743 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93521f5-d309-4621-a4ed-fb66fe2682aa admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:29.181587 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93521f5-d309-4621-a4ed-fb66fe2682aa admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:29.186431 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3c8a29-2f21-494d-91b8-c7bd1989d2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:29.187079 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c8a29-2f21-494d-91b8-c7bd1989d2a5 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:29.187365 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c8a29-2f21-494d-91b8-c7bd1989d2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:29.187641 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c8a29-2f21-494d-91b8-c7bd1989d2a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:29.188374 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3c8a29-2f21-494d-91b8-c7bd1989d2a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:29.190004 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3c8a29-2f21-494d-91b8-c7bd1989d2a5 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:29.200067 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 767/1540] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:25:29 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:25:29.201492 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3c8a29-2f21-494d-91b8-c7bd1989d2a5 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:29.225941 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 774/1541] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:25:29 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:25:29.226783 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3dde10-1c93-4047-9c97-93630a045464 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:29.246886 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3dde10-1c93-4047-9c97-93630a045464 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:29.251646 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab9288b-7d28-4304-8030-b312bcad8e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:29.252311 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab9288b-7d28-4304-8030-b312bcad8e78 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:29.252623 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab9288b-7d28-4304-8030-b312bcad8e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:29.252919 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab9288b-7d28-4304-8030-b312bcad8e78 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:29.253701 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab9288b-7d28-4304-8030-b312bcad8e78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:29.255029 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3c8a29-2f21-494d-91b8-c7bd1989d2a5 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:29.255330 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab9288b-7d28-4304-8030-b312bcad8e78 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:29.258901 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b66a3-37a5-4392-bfa0-be255e2bb58c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:29.259546 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b66a3-37a5-4392-bfa0-be255e2bb58c service neutron] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:29.259829 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b66a3-37a5-4392-bfa0-be255e2bb58c service neutron] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:29.260107 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b66a3-37a5-4392-bfa0-be255e2bb58c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:29.268987 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 775/1542] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:25:29 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:25:29.268987 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab9288b-7d28-4304-8030-b312bcad8e78 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:29.269233 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983b66a3-37a5-4392-bfa0-be255e2bb58c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:29.270668 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983b66a3-37a5-4392-bfa0-be255e2bb58c service neutron] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:29.279089 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab9288b-7d28-4304-8030-b312bcad8e78 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:29.280988 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 768/1543] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:25:29 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:25:29.281769 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b66a3-37a5-4392-bfa0-be255e2bb58c service neutron] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:29.283949 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74f7191-ca63-4967-88b1-4f6be3b41ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:29.284923 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74f7191-ca63-4967-88b1-4f6be3b41ec4 admin admin] REQUEST_METHOD: `PUT` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:29.285270 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74f7191-ca63-4967-88b1-4f6be3b41ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:29.285612 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74f7191-ca63-4967-88b1-4f6be3b41ec4 admin admin] PATH_INFO: `/v3/projects/511ac684e82943649bfee26494105d12/users/f4f1ad3b929548c294a741a27ae2a093/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:29.294674 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b66a3-37a5-4392-bfa0-be255e2bb58c service neutron] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:29.299655 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f0afec-97b1-44e4-8693-e2080c480681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:29.300685 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f0afec-97b1-44e4-8693-e2080c480681 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:29.300992 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f0afec-97b1-44e4-8693-e2080c480681 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:29.301261 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f0afec-97b1-44e4-8693-e2080c480681 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:29.301730 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74f7191-ca63-4967-88b1-4f6be3b41ec4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=511ac684e82943649bfee26494105d12, user_id=f4f1ad3b929548c294a741a27ae2a093, role_id=33b8a5a8d1d643f2a98f598e6ab0a1cf)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:29.302000 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f0afec-97b1-44e4-8693-e2080c480681 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:29.303599 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f0afec-97b1-44e4-8693-e2080c480681 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:29.304488 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74f7191-ca63-4967-88b1-4f6be3b41ec4 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:29.313884 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 769/1544] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:25:29 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:25:29.321231 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f0afec-97b1-44e4-8693-e2080c480681 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:29.323651 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f0afec-97b1-44e4-8693-e2080c480681 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:29.328450 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757bdc48-1ffd-476b-bf9e-e63ad5e2b0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:29.329068 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757bdc48-1ffd-476b-bf9e-e63ad5e2b0df admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:29.329346 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757bdc48-1ffd-476b-bf9e-e63ad5e2b0df admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:29.329618 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757bdc48-1ffd-476b-bf9e-e63ad5e2b0df admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:29.330340 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757bdc48-1ffd-476b-bf9e-e63ad5e2b0df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:29.331888 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757bdc48-1ffd-476b-bf9e-e63ad5e2b0df admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:29.342075 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 770/1545] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:25:29 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:25:29.342926 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757bdc48-1ffd-476b-bf9e-e63ad5e2b0df admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:29.351866 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757bdc48-1ffd-476b-bf9e-e63ad5e2b0df admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:29.356727 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ff79fe-7a44-47be-b4a1-e4779e550137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:29.357665 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff79fe-7a44-47be-b4a1-e4779e550137 admin admin] REQUEST_METHOD: `PUT` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:29.357856 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff79fe-7a44-47be-b4a1-e4779e550137 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:29.358127 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff79fe-7a44-47be-b4a1-e4779e550137 admin admin] PATH_INFO: `/v3/projects/ee04649277c84912b20967b31162615b/users/835bbb43ae5f48bfa14b22cb0a47cb4e/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:29.373143 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ff79fe-7a44-47be-b4a1-e4779e550137 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee04649277c84912b20967b31162615b, user_id=835bbb43ae5f48bfa14b22cb0a47cb4e, role_id=33b8a5a8d1d643f2a98f598e6ab0a1cf)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:29.375810 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ff79fe-7a44-47be-b4a1-e4779e550137 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:29.417610 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 776/1546] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:25:29 2021] PUT /identity/v3/projects/511ac684e82943649bfee26494105d12/users/f4f1ad3b929548c294a741a27ae2a093/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:25:29.419079 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74f7191-ca63-4967-88b1-4f6be3b41ec4 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:29.452356 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 771/1547] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:25:29 2021] PUT /identity/v3/projects/ee04649277c84912b20967b31162615b/users/835bbb43ae5f48bfa14b22cb0a47cb4e/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:25:29.453755 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5451823-a506-495f-846a-2e097687d6c9 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:29.454040 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5451823-a506-495f-846a-2e097687d6c9 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:29.454315 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5451823-a506-495f-846a-2e097687d6c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:29.473003 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-c5451823-a506-495f-846a-2e097687d6c9 None None] MFA Rules not processed for user `15239896ef4b4f50af6af54712301f5b`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:25:29.474776 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-c5451823-a506-495f-846a-2e097687d6c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:29.486836 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74f7191-ca63-4967-88b1-4f6be3b41ec4 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:29.528365 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 772/1548] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:25:29 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:25:29.529103 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5451823-a506-495f-846a-2e097687d6c9 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:29.542253 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db1fcee-ea59-4cf4-a5bf-604f62621c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:29.543713 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db1fcee-ea59-4cf4-a5bf-604f62621c50 admin admin] REQUEST_METHOD: `PUT` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:29.543713 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db1fcee-ea59-4cf4-a5bf-604f62621c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:29.543713 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db1fcee-ea59-4cf4-a5bf-604f62621c50 admin admin] PATH_INFO: `/v3/projects/e27b9516947040f79544fc7b3b9f847a/users/da3fa02babfb4f0fa23376cbd6782519/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:29.559098 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db1fcee-ea59-4cf4-a5bf-604f62621c50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e27b9516947040f79544fc7b3b9f847a, user_id=da3fa02babfb4f0fa23376cbd6782519, role_id=33b8a5a8d1d643f2a98f598e6ab0a1cf)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:29.561833 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db1fcee-ea59-4cf4-a5bf-604f62621c50 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:29.594987 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5451823-a506-495f-846a-2e097687d6c9 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:29.604276 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dc5bb6-3a33-448a-be81-e17d1348f892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:29.604276 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc5bb6-3a33-448a-be81-e17d1348f892 admin admin] REQUEST_METHOD: `PUT` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:29.604276 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc5bb6-3a33-448a-be81-e17d1348f892 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:29.604276 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc5bb6-3a33-448a-be81-e17d1348f892 admin admin] PATH_INFO: `/v3/projects/7bb2dcb9d8864f24912572fd4757f9ac/users/1f761babee1a4a9ea7dc0deb5eb9db79/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:29.618396 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dc5bb6-3a33-448a-be81-e17d1348f892 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bb2dcb9d8864f24912572fd4757f9ac, user_id=1f761babee1a4a9ea7dc0deb5eb9db79, role_id=33b8a5a8d1d643f2a98f598e6ab0a1cf)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:29.621105 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dc5bb6-3a33-448a-be81-e17d1348f892 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:29.658402 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 777/1549] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:25:29 2021] PUT /identity/v3/projects/e27b9516947040f79544fc7b3b9f847a/users/da3fa02babfb4f0fa23376cbd6782519/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:25:29.663930 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db1fcee-ea59-4cf4-a5bf-604f62621c50 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:29.715043 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 773/1550] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:25:29 2021] PUT /identity/v3/projects/7bb2dcb9d8864f24912572fd4757f9ac/users/1f761babee1a4a9ea7dc0deb5eb9db79/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:25:29.715880 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dc5bb6-3a33-448a-be81-e17d1348f892 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:29.725335 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db1fcee-ea59-4cf4-a5bf-604f62621c50 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:29.790553 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dc5bb6-3a33-448a-be81-e17d1348f892 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:29.791012 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47e12eb-5d44-454d-8017-9426632359dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:29.791910 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47e12eb-5d44-454d-8017-9426632359dd admin admin] REQUEST_METHOD: `PUT` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:29.792183 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47e12eb-5d44-454d-8017-9426632359dd admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:29.792483 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47e12eb-5d44-454d-8017-9426632359dd admin admin] PATH_INFO: `/v3/projects/898ba601237143988a195f0471a82ffa/users/51d43864bf9f4bfda994440ceac7103e/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:29.797558 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201fe6df-5070-4bc1-8757-e64c8c321d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:29.803300 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201fe6df-5070-4bc1-8757-e64c8c321d0d admin admin] REQUEST_METHOD: `PUT` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:29.803300 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201fe6df-5070-4bc1-8757-e64c8c321d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:29.803300 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201fe6df-5070-4bc1-8757-e64c8c321d0d admin admin] PATH_INFO: `/v3/projects/94cdd5201533434888e7691148b9a3a8/users/74acf90c734149808a501de7754b5943/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:29.813825 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47e12eb-5d44-454d-8017-9426632359dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=898ba601237143988a195f0471a82ffa, user_id=51d43864bf9f4bfda994440ceac7103e, role_id=33b8a5a8d1d643f2a98f598e6ab0a1cf)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:29.816856 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47e12eb-5d44-454d-8017-9426632359dd admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:29.818452 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201fe6df-5070-4bc1-8757-e64c8c321d0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=94cdd5201533434888e7691148b9a3a8, user_id=74acf90c734149808a501de7754b5943, role_id=33b8a5a8d1d643f2a98f598e6ab0a1cf)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:29.821185 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201fe6df-5070-4bc1-8757-e64c8c321d0d admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:29.909489 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 778/1551] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:25:29 2021] PUT /identity/v3/projects/898ba601237143988a195f0471a82ffa/users/51d43864bf9f4bfda994440ceac7103e/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:25:29.910943 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e8edc0-c96d-45af-a2ed-114020bd44c9 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:29.911260 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e8edc0-c96d-45af-a2ed-114020bd44c9 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:29.911512 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e8edc0-c96d-45af-a2ed-114020bd44c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:29.937380 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-83e8edc0-c96d-45af-a2ed-114020bd44c9 None None] MFA Rules not processed for user `f4f1ad3b929548c294a741a27ae2a093`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:25:29.938616 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-83e8edc0-c96d-45af-a2ed-114020bd44c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:29.979673 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 774/1552] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:25:29 2021] PUT /identity/v3/projects/94cdd5201533434888e7691148b9a3a8/users/74acf90c734149808a501de7754b5943/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:25:29.981132 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d886f55-77a4-4cd4-8593-2cd0add43a77 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:29.981376 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d886f55-77a4-4cd4-8593-2cd0add43a77 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:29.981656 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d886f55-77a4-4cd4-8593-2cd0add43a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:29.999563 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-4d886f55-77a4-4cd4-8593-2cd0add43a77 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:25:30.000890 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-4d886f55-77a4-4cd4-8593-2cd0add43a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:30.003608 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 779/1553] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:25:29 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:25:30.005091 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986bcad0-e269-4b38-a148-1131339f01f7 None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:30.005494 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986bcad0-e269-4b38-a148-1131339f01f7 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:30.005698 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986bcad0-e269-4b38-a148-1131339f01f7 None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:30.007592 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 780/1554] 10.222.0.18 () {54 vars in 960 bytes} [Tue Oct 12 18:25:30 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:25:30.008503 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c62dd-518f-4cec-81af-14d8495f8089 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:30.008772 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c62dd-518f-4cec-81af-14d8495f8089 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:30.009047 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c62dd-518f-4cec-81af-14d8495f8089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:30.040259 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-9c6c62dd-518f-4cec-81af-14d8495f8089 None None] MFA Rules not processed for user `da3fa02babfb4f0fa23376cbd6782519`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:25:30.041511 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-9c6c62dd-518f-4cec-81af-14d8495f8089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:30.070895 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 775/1555] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:25:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:25:30.072327 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69219e8-bfe5-46e4-ab72-0136510fc079 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:30.072572 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69219e8-bfe5-46e4-ab72-0136510fc079 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:30.072850 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69219e8-bfe5-46e4-ab72-0136510fc079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:30.101753 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-f69219e8-bfe5-46e4-ab72-0136510fc079 None None] MFA Rules not processed for user `1f761babee1a4a9ea7dc0deb5eb9db79`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:25:30.103284 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-f69219e8-bfe5-46e4-ab72-0136510fc079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:30.116156 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 781/1556] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:25:30 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:25:30.121898 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25fcd51-27f3-4773-bf48-ec3a6748d9e3 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:30.122237 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25fcd51-27f3-4773-bf48-ec3a6748d9e3 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:30.122455 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25fcd51-27f3-4773-bf48-ec3a6748d9e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:30.152789 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-e25fcd51-27f3-4773-bf48-ec3a6748d9e3 None None] MFA Rules not processed for user `51d43864bf9f4bfda994440ceac7103e`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:25:30.154509 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-e25fcd51-27f3-4773-bf48-ec3a6748d9e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:30.179424 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 776/1557] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:25:30 2021] POST /identity/v3/auth/tokens => generated 3387 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:25:30.181070 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b46011-bfb5-467d-82fb-a42b56d263d1 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:30.181350 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b46011-bfb5-467d-82fb-a42b56d263d1 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:30.181624 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b46011-bfb5-467d-82fb-a42b56d263d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:30.207014 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-d9b46011-bfb5-467d-82fb-a42b56d263d1 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:25:30.207377 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-d9b46011-bfb5-467d-82fb-a42b56d263d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:30.215851 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 777/1558] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:25:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:25:30.216689 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b46011-bfb5-467d-82fb-a42b56d263d1 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:30.226740 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b46011-bfb5-467d-82fb-a42b56d263d1 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:30.229603 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 782/1559] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:25:30 2021] POST /identity/v3/auth/tokens => generated 3425 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:25:30.230963 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece13079-1874-4cc8-89fb-d6be1fcd3efe None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:30.231308 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece13079-1874-4cc8-89fb-d6be1fcd3efe None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:30.231418 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f6009-c67e-4586-8076-500f614c518b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:30.231677 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece13079-1874-4cc8-89fb-d6be1fcd3efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:30.232118 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f6009-c67e-4586-8076-500f614c518b admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:30.232419 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f6009-c67e-4586-8076-500f614c518b admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:30.233540 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f6009-c67e-4586-8076-500f614c518b admin admin] PATH_INFO: `/v3/projects` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:30.233540 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5f6009-c67e-4586-8076-500f614c518b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:30.235337 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5f6009-c67e-4586-8076-500f614c518b admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:30.250999 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-ece13079-1874-4cc8-89fb-d6be1fcd3efe None None] MFA Rules not processed for user `3417097a280b499086b36df9a2548239`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:25:30.252194 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-ece13079-1874-4cc8-89fb-d6be1fcd3efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:30.319547 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 778/1560] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:25:30 2021] POST /identity/v3/projects => generated 365 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:25:30.319788 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 783/1561] 10.222.0.18 () {58 vars in 1057 bytes} [Tue Oct 12 18:25:30 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:25:30.319788 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1cf405-1ba3-4e6a-97ed-673f5f0e49bf None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:30.319788 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1cf405-1ba3-4e6a-97ed-673f5f0e49bf None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:30.319788 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1cf405-1ba3-4e6a-97ed-673f5f0e49bf None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:30.321290 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 784/1562] 10.222.0.18 () {54 vars in 960 bytes} [Tue Oct 12 18:25:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:25:30.321841 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1cf405-1ba3-4e6a-97ed-673f5f0e49bf None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:30.324635 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f6009-c67e-4586-8076-500f614c518b admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:30.379118 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f6009-c67e-4586-8076-500f614c518b admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:30.379334 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1cf405-1ba3-4e6a-97ed-673f5f0e49bf None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:30.383768 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750021db-fb15-4eb3-a20a-6f3435dea7b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:30.384431 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750021db-fb15-4eb3-a20a-6f3435dea7b4 service neutron] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:30.384714 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9815d2-f93c-4095-ba10-1262c37791f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6966ce0774f4437a9b688494e9d0574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:30.384845 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750021db-fb15-4eb3-a20a-6f3435dea7b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:30.384988 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750021db-fb15-4eb3-a20a-6f3435dea7b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:30.385344 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9815d2-f93c-4095-ba10-1262c37791f6 service cinder] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:30.385623 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9815d2-f93c-4095-ba10-1262c37791f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:30.385889 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9815d2-f93c-4095-ba10-1262c37791f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:30.444688 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9815d2-f93c-4095-ba10-1262c37791f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:30.446309 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9815d2-f93c-4095-ba10-1262c37791f6 service cinder] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:30.451528 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750021db-fb15-4eb3-a20a-6f3435dea7b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:30.452999 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750021db-fb15-4eb3-a20a-6f3435dea7b4 service neutron] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:30.455495 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 785/1563] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:25:30 2021] GET /identity/v3/auth/tokens => generated 3387 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:25:30.456415 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9815d2-f93c-4095-ba10-1262c37791f6 service cinder] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:30.457912 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-2b9815d2-f93c-4095-ba10-1262c37791f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:30.463813 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 779/1564] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:25:30 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:25:30.464544 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750021db-fb15-4eb3-a20a-6f3435dea7b4 service neutron] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:30.470544 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9815d2-f93c-4095-ba10-1262c37791f6 service cinder] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:30.474198 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750021db-fb15-4eb3-a20a-6f3435dea7b4 service neutron] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:30.474347 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b2eacf-8b84-4527-84cf-0460f6ed62b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:30.474978 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2eacf-8b84-4527-84cf-0460f6ed62b2 service neutron] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:30.475259 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2eacf-8b84-4527-84cf-0460f6ed62b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:30.475531 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2eacf-8b84-4527-84cf-0460f6ed62b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:30.479369 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a1159-eb74-4dbd-88e2-fdc83fa356b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:30.480344 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a1159-eb74-4dbd-88e2-fdc83fa356b8 admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:30.480745 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a1159-eb74-4dbd-88e2-fdc83fa356b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:30.481093 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a1159-eb74-4dbd-88e2-fdc83fa356b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:30.482022 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17a1159-eb74-4dbd-88e2-fdc83fa356b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:30.484194 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17a1159-eb74-4dbd-88e2-fdc83fa356b8 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:30.487526 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b2eacf-8b84-4527-84cf-0460f6ed62b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:30.500021 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b2eacf-8b84-4527-84cf-0460f6ed62b2 service neutron] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:30.514956 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 786/1565] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:25:30 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:25:30.517987 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b2eacf-8b84-4527-84cf-0460f6ed62b2 service neutron] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:30.526139 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b2eacf-8b84-4527-84cf-0460f6ed62b2 service neutron] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:30.530942 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57703f22-af6c-43e6-bbd3-141a59bdde7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:30.531601 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57703f22-af6c-43e6-bbd3-141a59bdde7b admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:30.531881 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57703f22-af6c-43e6-bbd3-141a59bdde7b admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:30.532151 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57703f22-af6c-43e6-bbd3-141a59bdde7b admin admin] PATH_INFO: `/v3/users` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:30.532884 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57703f22-af6c-43e6-bbd3-141a59bdde7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:30.534931 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57703f22-af6c-43e6-bbd3-141a59bdde7b admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:30.577442 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 780/1566] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:25:30 2021] POST /identity/v3/projects => generated 403 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:25:30.577442 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a1159-eb74-4dbd-88e2-fdc83fa356b8 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:30.673247 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 787/1567] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:25:30 2021] POST /identity/v3/users => generated 289 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:25:30.673247 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf7d71-c29e-4961-8c28-867c4cd231bf None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:30.673247 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf7d71-c29e-4961-8c28-867c4cd231bf None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:30.673247 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf7d71-c29e-4961-8c28-867c4cd231bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:30.679510 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a1159-eb74-4dbd-88e2-fdc83fa356b8 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:30.686104 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff214af0-708c-4e6e-b9ca-580ed4389312 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3417097a280b499086b36df9a2548239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:30.689179 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff214af0-708c-4e6e-b9ca-580ed4389312 service nova] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:30.689702 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff214af0-708c-4e6e-b9ca-580ed4389312 service nova] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:30.690209 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff214af0-708c-4e6e-b9ca-580ed4389312 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:30.730189 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-88bf7d71-c29e-4961-8c28-867c4cd231bf None None] MFA Rules not processed for user `3417097a280b499086b36df9a2548239`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:25:30.731531 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-88bf7d71-c29e-4961-8c28-867c4cd231bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:30.752272 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 788/1568] 10.222.0.18 () {58 vars in 1057 bytes} [Tue Oct 12 18:25:30 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:25:30.753251 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bf7d71-c29e-4961-8c28-867c4cd231bf None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:30.784952 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff214af0-708c-4e6e-b9ca-580ed4389312 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:30.787810 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff214af0-708c-4e6e-b9ca-580ed4389312 service nova] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:30.801022 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 781/1569] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:25:30 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:25:30.817526 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff214af0-708c-4e6e-b9ca-580ed4389312 service nova] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:30.831503 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bf7d71-c29e-4961-8c28-867c4cd231bf None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:30.839469 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff214af0-708c-4e6e-b9ca-580ed4389312 service nova] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:30.852452 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70440a26-499a-4ef7-9a96-4f47a2ba9874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:30.852695 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70440a26-499a-4ef7-9a96-4f47a2ba9874 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:30.852908 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70440a26-499a-4ef7-9a96-4f47a2ba9874 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:30.853467 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70440a26-499a-4ef7-9a96-4f47a2ba9874 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:30.854251 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70440a26-499a-4ef7-9a96-4f47a2ba9874 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:30.856197 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70440a26-499a-4ef7-9a96-4f47a2ba9874 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:30.858204 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05c3aee-5044-4f2e-923b-275858688c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:30.858898 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c3aee-5044-4f2e-923b-275858688c7b admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:30.859186 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c3aee-5044-4f2e-923b-275858688c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:30.859463 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c3aee-5044-4f2e-923b-275858688c7b admin admin] PATH_INFO: `/v3/users` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:30.860171 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05c3aee-5044-4f2e-923b-275858688c7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:30.864285 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05c3aee-5044-4f2e-923b-275858688c7b admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:30.885779 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 782/1570] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:25:30 2021] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:25:30.885779 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408447de-49e3-4562-9824-a8a1a9be616a None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:30.885779 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408447de-49e3-4562-9824-a8a1a9be616a None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:30.885779 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408447de-49e3-4562-9824-a8a1a9be616a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:30.928497 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-408447de-49e3-4562-9824-a8a1a9be616a None None] MFA Rules not processed for user `548ce7f3a2b74ce5bc70afbc0463f391`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:25:30.929711 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-408447de-49e3-4562-9824-a8a1a9be616a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:30.995253 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 783/1571] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:25:30 2021] POST /identity/v3/auth/tokens => generated 3425 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:25:31.000502 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408447de-49e3-4562-9824-a8a1a9be616a None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:31.017738 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408447de-49e3-4562-9824-a8a1a9be616a None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:31.019297 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 789/1572] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:25:30 2021] POST /identity/v3/users => generated 308 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:25:31.020579 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05c3aee-5044-4f2e-923b-275858688c7b admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:31.030502 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1a33ef-f26c-4a98-a5b5-95fda4ef3894 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3417097a280b499086b36df9a2548239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:31.031230 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a33ef-f26c-4a98-a5b5-95fda4ef3894 service nova] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:31.031509 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a33ef-f26c-4a98-a5b5-95fda4ef3894 service nova] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:31.039668 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a33ef-f26c-4a98-a5b5-95fda4ef3894 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:31.039854 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05c3aee-5044-4f2e-923b-275858688c7b admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:31.043452 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6038deb6-1f0e-4ebf-9196-dbeeef3d0496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:31.044834 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6038deb6-1f0e-4ebf-9196-dbeeef3d0496 admin admin] REQUEST_METHOD: `PUT` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:31.045362 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6038deb6-1f0e-4ebf-9196-dbeeef3d0496 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:31.046616 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6038deb6-1f0e-4ebf-9196-dbeeef3d0496 admin admin] PATH_INFO: `/v3/projects/7ad9357fd44b492783bb48fc51831bf2/users/5379be23b0a74f4f970c2958c53c3960/roles/6c54f239944d46e3b027ccce97eb8b49` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:31.114828 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6038deb6-1f0e-4ebf-9196-dbeeef3d0496 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ad9357fd44b492783bb48fc51831bf2, user_id=5379be23b0a74f4f970c2958c53c3960, role_id=6c54f239944d46e3b027ccce97eb8b49)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:31.121049 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6038deb6-1f0e-4ebf-9196-dbeeef3d0496 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:31.169944 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1a33ef-f26c-4a98-a5b5-95fda4ef3894 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:31.171800 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1a33ef-f26c-4a98-a5b5-95fda4ef3894 service nova] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:31.183406 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 784/1573] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:25:30 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:25:31.188551 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1a33ef-f26c-4a98-a5b5-95fda4ef3894 service nova] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:31.198838 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1a33ef-f26c-4a98-a5b5-95fda4ef3894 service nova] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:31.205520 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105c5483-f692-4134-b173-eb1ec26a4e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:31.206308 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c5483-f692-4134-b173-eb1ec26a4e5e admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:31.206659 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c5483-f692-4134-b173-eb1ec26a4e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:31.207005 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c5483-f692-4134-b173-eb1ec26a4e5e admin admin] PATH_INFO: `/v3/projects` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:31.207791 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105c5483-f692-4134-b173-eb1ec26a4e5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:31.211414 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105c5483-f692-4134-b173-eb1ec26a4e5e admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:31.279419 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 790/1574] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:25:31 2021] PUT /identity/v3/projects/7ad9357fd44b492783bb48fc51831bf2/users/5379be23b0a74f4f970c2958c53c3960/roles/6c54f239944d46e3b027ccce97eb8b49 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:25:31.279419 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6038deb6-1f0e-4ebf-9196-dbeeef3d0496 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:31.342845 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6038deb6-1f0e-4ebf-9196-dbeeef3d0496 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:31.347452 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87760c8e-87cb-45e6-9ef4-93a9ed6f5e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:31.348114 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87760c8e-87cb-45e6-9ef4-93a9ed6f5e6f admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:31.348390 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87760c8e-87cb-45e6-9ef4-93a9ed6f5e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:31.348688 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87760c8e-87cb-45e6-9ef4-93a9ed6f5e6f admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:31.349421 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87760c8e-87cb-45e6-9ef4-93a9ed6f5e6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:31.351041 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87760c8e-87cb-45e6-9ef4-93a9ed6f5e6f admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:31.363695 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 791/1575] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:25:31 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:25:31.363695 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b2cc34-95b5-49c1-96dd-13618129e0bd None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:31.363695 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b2cc34-95b5-49c1-96dd-13618129e0bd None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:31.363695 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b2cc34-95b5-49c1-96dd-13618129e0bd None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:31.364577 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 792/1576] 10.222.0.18 () {54 vars in 912 bytes} [Tue Oct 12 18:25:31 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:25:31.365892 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b2cc34-95b5-49c1-96dd-13618129e0bd None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:31.385876 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 785/1577] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:25:31 2021] POST /identity/v3/projects => generated 405 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:25:31.387499 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105c5483-f692-4134-b173-eb1ec26a4e5e admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:31.390818 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b2cc34-95b5-49c1-96dd-13618129e0bd None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:31.495557 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7355ead-2081-4715-801f-0a6f1aee36a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:31.496240 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7355ead-2081-4715-801f-0a6f1aee36a7 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:31.496686 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7355ead-2081-4715-801f-0a6f1aee36a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:31.496962 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7355ead-2081-4715-801f-0a6f1aee36a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:31.497707 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7355ead-2081-4715-801f-0a6f1aee36a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:31.499311 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7355ead-2081-4715-801f-0a6f1aee36a7 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:31.529600 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 793/1578] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:25:31 2021] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:25:31.529600 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a803d07f-f5ab-406d-bc99-51728df46fbf None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:31.529600 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a803d07f-f5ab-406d-bc99-51728df46fbf None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:31.529600 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a803d07f-f5ab-406d-bc99-51728df46fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:31.533688 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105c5483-f692-4134-b173-eb1ec26a4e5e admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:31.547130 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-a803d07f-f5ab-406d-bc99-51728df46fbf None None] MFA Rules not processed for user `3417097a280b499086b36df9a2548239`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:25:31.547365 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e1e850-194b-4c62-a64b-2379ede70cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:31.548195 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1e850-194b-4c62-a64b-2379ede70cd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:31.548331 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-a803d07f-f5ab-406d-bc99-51728df46fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:31.548507 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1e850-194b-4c62-a64b-2379ede70cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:31.548784 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1e850-194b-4c62-a64b-2379ede70cd2 admin admin] PATH_INFO: `/v3/projects/79862b324a6d475b9c75960e518b234d/users/dcbcff8f22474248ab8b068449244ff3/roles/6c54f239944d46e3b027ccce97eb8b49` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:31.571710 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e1e850-194b-4c62-a64b-2379ede70cd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79862b324a6d475b9c75960e518b234d, user_id=dcbcff8f22474248ab8b068449244ff3, role_id=6c54f239944d46e3b027ccce97eb8b49)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:31.575839 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e1e850-194b-4c62-a64b-2379ede70cd2 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:31.634964 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 794/1579] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Oct 12 18:25:31 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:25:31.637290 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a803d07f-f5ab-406d-bc99-51728df46fbf None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:31.647716 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a803d07f-f5ab-406d-bc99-51728df46fbf None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:31.652564 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b7f9d9-657c-49de-90e0-ab639ff13669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:31.653214 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b7f9d9-657c-49de-90e0-ab639ff13669 admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:31.653489 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b7f9d9-657c-49de-90e0-ab639ff13669 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:31.653761 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b7f9d9-657c-49de-90e0-ab639ff13669 admin admin] PATH_INFO: `/v3/users` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:31.654452 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b7f9d9-657c-49de-90e0-ab639ff13669 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:31.656389 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b7f9d9-657c-49de-90e0-ab639ff13669 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:31.744436 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 786/1580] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:25:31 2021] PUT /identity/v3/projects/79862b324a6d475b9c75960e518b234d/users/dcbcff8f22474248ab8b068449244ff3/roles/6c54f239944d46e3b027ccce97eb8b49 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:25:31.745860 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5072a06c-feac-421c-971e-4bed71837cd5 None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:31.746223 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5072a06c-feac-421c-971e-4bed71837cd5 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:31.746590 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5072a06c-feac-421c-971e-4bed71837cd5 None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:31.748640 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 787/1581] 10.222.0.18 () {54 vars in 912 bytes} [Tue Oct 12 18:25:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:25:31.749329 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5072a06c-feac-421c-971e-4bed71837cd5 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:31.805599 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 795/1582] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:25:31 2021] POST /identity/v3/users => generated 309 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:25:31.805599 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b7f9d9-657c-49de-90e0-ab639ff13669 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:31.810768 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-08b7f9d9-657c-49de-90e0-ab639ff13669 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:31.821824 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5072a06c-feac-421c-971e-4bed71837cd5 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:31.845249 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c9bda2-3196-4047-823f-9a348feaa035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:31.845891 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9bda2-3196-4047-823f-9a348feaa035 admin admin] REQUEST_METHOD: `PUT` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:31.846237 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9bda2-3196-4047-823f-9a348feaa035 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:31.846642 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9bda2-3196-4047-823f-9a348feaa035 admin admin] PATH_INFO: `/v3/projects/7ad9357fd44b492783bb48fc51831bf2/users/5379be23b0a74f4f970c2958c53c3960/roles/6c54f239944d46e3b027ccce97eb8b49` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:31.852612 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c9bda2-3196-4047-823f-9a348feaa035 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ad9357fd44b492783bb48fc51831bf2, user_id=5379be23b0a74f4f970c2958c53c3960, role_id=6c54f239944d46e3b027ccce97eb8b49)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:31.868348 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c9bda2-3196-4047-823f-9a348feaa035 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:31.885965 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 788/1583] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:25:31 2021] PUT /identity/v3/projects/7ad9357fd44b492783bb48fc51831bf2/users/5379be23b0a74f4f970c2958c53c3960/roles/6c54f239944d46e3b027ccce97eb8b49 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:25:31.886972 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c9bda2-3196-4047-823f-9a348feaa035 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:31.901370 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b7f9d9-657c-49de-90e0-ab639ff13669 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:31.956023 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d76d7-abe0-4673-953c-289150188fd8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a3d3e5a5cfc4ac3afcece4e55f23552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:31.956720 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d76d7-abe0-4673-953c-289150188fd8 service glance] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:31.957001 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d76d7-abe0-4673-953c-289150188fd8 service glance] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:31.957273 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d76d7-abe0-4673-953c-289150188fd8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:31.973822 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c9bda2-3196-4047-823f-9a348feaa035 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:31.979624 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e15d2bf-fbcd-4e4b-bb36-4f87b702ff71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:31.980371 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15d2bf-fbcd-4e4b-bb36-4f87b702ff71 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:31.980758 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15d2bf-fbcd-4e4b-bb36-4f87b702ff71 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:31.981142 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15d2bf-fbcd-4e4b-bb36-4f87b702ff71 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:31.981995 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e15d2bf-fbcd-4e4b-bb36-4f87b702ff71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:31.983749 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e15d2bf-fbcd-4e4b-bb36-4f87b702ff71 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:31.994891 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 789/1584] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:25:31 2021] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:25:31.999170 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd96de-c683-4a69-b161-8ca86a1ae22c None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:31.999170 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd96de-c683-4a69-b161-8ca86a1ae22c None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:31.999170 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd96de-c683-4a69-b161-8ca86a1ae22c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:32.017709 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-bbbd96de-c683-4a69-b161-8ca86a1ae22c None None] MFA Rules not processed for user `3417097a280b499086b36df9a2548239`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:25:32.018987 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-bbbd96de-c683-4a69-b161-8ca86a1ae22c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:32.029765 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575d76d7-abe0-4673-953c-289150188fd8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:32.031192 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575d76d7-abe0-4673-953c-289150188fd8 service glance] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:32.042674 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 796/1585] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:25:31 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:25:32.043271 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d76d7-abe0-4673-953c-289150188fd8 service glance] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:32.061609 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d76d7-abe0-4673-953c-289150188fd8 service glance] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:32.068032 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b06bbbb-ae5b-46d7-b817-43d9dc4abfa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:32.068747 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b06bbbb-ae5b-46d7-b817-43d9dc4abfa0 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:32.069034 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b06bbbb-ae5b-46d7-b817-43d9dc4abfa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:32.069311 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b06bbbb-ae5b-46d7-b817-43d9dc4abfa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:32.070052 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b06bbbb-ae5b-46d7-b817-43d9dc4abfa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:32.071660 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b06bbbb-ae5b-46d7-b817-43d9dc4abfa0 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:32.086681 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 797/1586] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:25:32 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:25:32.086681 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087a4ce-bcbf-4d66-81ca-782f42c2cc62 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:32.086681 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087a4ce-bcbf-4d66-81ca-782f42c2cc62 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:32.086681 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087a4ce-bcbf-4d66-81ca-782f42c2cc62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:32.104569 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 790/1587] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Oct 12 18:25:31 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:25:32.105634 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbd96de-c683-4a69-b161-8ca86a1ae22c None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:32.118770 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbd96de-c683-4a69-b161-8ca86a1ae22c None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:32.126767 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4c55ae-5fd7-45f7-bbc0-bb93484f5ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:32.127674 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c55ae-5fd7-45f7-bbc0-bb93484f5ad5 admin admin] REQUEST_METHOD: `PUT` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:32.128108 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c55ae-5fd7-45f7-bbc0-bb93484f5ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:32.128387 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c55ae-5fd7-45f7-bbc0-bb93484f5ad5 admin admin] PATH_INFO: `/v3/projects/79862b324a6d475b9c75960e518b234d/users/dcbcff8f22474248ab8b068449244ff3/roles/6c54f239944d46e3b027ccce97eb8b49` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:32.131728 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4c55ae-5fd7-45f7-bbc0-bb93484f5ad5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79862b324a6d475b9c75960e518b234d, user_id=dcbcff8f22474248ab8b068449244ff3, role_id=6c54f239944d46e3b027ccce97eb8b49)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:32.134164 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4c55ae-5fd7-45f7-bbc0-bb93484f5ad5 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:32.137980 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-9087a4ce-bcbf-4d66-81ca-782f42c2cc62 None None] MFA Rules not processed for user `5379be23b0a74f4f970c2958c53c3960`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:25:32.139323 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-9087a4ce-bcbf-4d66-81ca-782f42c2cc62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:32.149576 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 791/1588] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:25:32 2021] PUT /identity/v3/projects/79862b324a6d475b9c75960e518b234d/users/dcbcff8f22474248ab8b068449244ff3/roles/6c54f239944d46e3b027ccce97eb8b49 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:25:32.150517 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4c55ae-5fd7-45f7-bbc0-bb93484f5ad5 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:32.253600 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4c55ae-5fd7-45f7-bbc0-bb93484f5ad5 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:32.258512 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c63557-5e2e-4f7f-9cde-cd66fc126d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:32.259469 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c63557-5e2e-4f7f-9cde-cd66fc126d7e admin admin] REQUEST_METHOD: `PUT` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:32.259788 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c63557-5e2e-4f7f-9cde-cd66fc126d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:32.260320 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c63557-5e2e-4f7f-9cde-cd66fc126d7e admin admin] PATH_INFO: `/v3/projects/6ffaaf836e7a49e6965a7d80f3fd4400/users/b9dca4bb37fa428f92980078b2d566d3/roles/6c54f239944d46e3b027ccce97eb8b49` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:32.281890 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c63557-5e2e-4f7f-9cde-cd66fc126d7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ffaaf836e7a49e6965a7d80f3fd4400, user_id=b9dca4bb37fa428f92980078b2d566d3, role_id=6c54f239944d46e3b027ccce97eb8b49)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:32.282256 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 798/1589] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:25:32 2021] POST /identity/v3/auth/tokens => generated 3452 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:25:32.287557 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9087a4ce-bcbf-4d66-81ca-782f42c2cc62 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:32.292906 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c63557-5e2e-4f7f-9cde-cd66fc126d7e admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:32.383374 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9087a4ce-bcbf-4d66-81ca-782f42c2cc62 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:32.388972 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3300a56-6db4-46a1-81d1-74a9f78ba0e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6966ce0774f4437a9b688494e9d0574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:32.389381 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3300a56-6db4-46a1-81d1-74a9f78ba0e1 service cinder] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:32.389698 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3300a56-6db4-46a1-81d1-74a9f78ba0e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:32.389921 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3300a56-6db4-46a1-81d1-74a9f78ba0e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:32.474007 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3300a56-6db4-46a1-81d1-74a9f78ba0e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:32.475688 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3300a56-6db4-46a1-81d1-74a9f78ba0e1 service cinder] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:32.487702 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 799/1590] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:25:32 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:25:32.499145 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7adb380-2fc1-4b29-b478-26e88e26e453 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:32.500646 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7adb380-2fc1-4b29-b478-26e88e26e453 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:32.501390 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7adb380-2fc1-4b29-b478-26e88e26e453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:32.541359 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-d7adb380-2fc1-4b29-b478-26e88e26e453 None None] MFA Rules not processed for user `dcbcff8f22474248ab8b068449244ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:25:32.546168 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-d7adb380-2fc1-4b29-b478-26e88e26e453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:32.628483 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 792/1591] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:25:32 2021] PUT /identity/v3/projects/6ffaaf836e7a49e6965a7d80f3fd4400/users/b9dca4bb37fa428f92980078b2d566d3/roles/6c54f239944d46e3b027ccce97eb8b49 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:25:32.628483 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c63557-5e2e-4f7f-9cde-cd66fc126d7e admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:32.628762 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 800/1592] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:25:32 2021] POST /identity/v3/auth/tokens => generated 3490 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:25:32.628762 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dd5850-f139-4c85-b521-110dfdb0c842 None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:32.628762 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dd5850-f139-4c85-b521-110dfdb0c842 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:32.628762 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dd5850-f139-4c85-b521-110dfdb0c842 None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:32.642753 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 801/1593] 10.222.0.18 () {54 vars in 912 bytes} [Tue Oct 12 18:25:32 2021] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:25:32.644047 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dd5850-f139-4c85-b521-110dfdb0c842 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:32.699377 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c63557-5e2e-4f7f-9cde-cd66fc126d7e admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:32.703080 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babefef0-c54b-4aa3-8eec-93cb85c57f40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6966ce0774f4437a9b688494e9d0574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:32.704491 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babefef0-c54b-4aa3-8eec-93cb85c57f40 service cinder] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:32.704776 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babefef0-c54b-4aa3-8eec-93cb85c57f40 service cinder] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:32.705050 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babefef0-c54b-4aa3-8eec-93cb85c57f40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:32.731602 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dd5850-f139-4c85-b521-110dfdb0c842 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:32.737526 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c9b13a-ef97-4fd1-aefa-8d67eb71abe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:32.738553 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c9b13a-ef97-4fd1-aefa-8d67eb71abe1 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:32.739015 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c9b13a-ef97-4fd1-aefa-8d67eb71abe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:32.739474 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c9b13a-ef97-4fd1-aefa-8d67eb71abe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:32.741001 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c9b13a-ef97-4fd1-aefa-8d67eb71abe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:32.743071 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c9b13a-ef97-4fd1-aefa-8d67eb71abe1 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:32.754551 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 802/1594] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:25:32 2021] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:25:32.756294 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e81f130-7b9a-4061-8023-7353fab0b79a None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:32.756624 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e81f130-7b9a-4061-8023-7353fab0b79a None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:32.756971 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e81f130-7b9a-4061-8023-7353fab0b79a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:32.782408 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babefef0-c54b-4aa3-8eec-93cb85c57f40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:32.784733 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babefef0-c54b-4aa3-8eec-93cb85c57f40 service cinder] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:32.811692 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 793/1595] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:25:32 2021] GET /identity/v3/auth/tokens => generated 3452 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:25:32.812937 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babefef0-c54b-4aa3-8eec-93cb85c57f40 service cinder] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:32.823633 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-5e81f130-7b9a-4061-8023-7353fab0b79a None None] MFA Rules not processed for user `9a1ea6f47a7c41aba102ad481f5ad5c8`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:25:32.828638 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-5e81f130-7b9a-4061-8023-7353fab0b79a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:32.838540 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babefef0-c54b-4aa3-8eec-93cb85c57f40 service cinder] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:32.845265 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9e5ce5-bc44-454f-a02e-930ad3ad590e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:32.845834 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e5ce5-bc44-454f-a02e-930ad3ad590e admin admin] REQUEST_METHOD: `PUT` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:32.846111 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e5ce5-bc44-454f-a02e-930ad3ad590e admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:32.846705 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e5ce5-bc44-454f-a02e-930ad3ad590e admin admin] PATH_INFO: `/v3/projects/6ffaaf836e7a49e6965a7d80f3fd4400/users/b9dca4bb37fa428f92980078b2d566d3/roles/6c54f239944d46e3b027ccce97eb8b49` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:32.848749 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9e5ce5-bc44-454f-a02e-930ad3ad590e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ffaaf836e7a49e6965a7d80f3fd4400, user_id=b9dca4bb37fa428f92980078b2d566d3, role_id=6c54f239944d46e3b027ccce97eb8b49)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:32.852086 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9e5ce5-bc44-454f-a02e-930ad3ad590e admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:32.866227 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 794/1596] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:25:32 2021] PUT /identity/v3/projects/6ffaaf836e7a49e6965a7d80f3fd4400/users/b9dca4bb37fa428f92980078b2d566d3/roles/6c54f239944d46e3b027ccce97eb8b49 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:25:32.922980 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 803/1597] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Oct 12 18:25:32 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:25:32.989357 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9e5ce5-bc44-454f-a02e-930ad3ad590e admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:33.046695 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e81f130-7b9a-4061-8023-7353fab0b79a None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:33.060159 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e81f130-7b9a-4061-8023-7353fab0b79a None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:33.080501 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9e5ce5-bc44-454f-a02e-930ad3ad590e admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:33.093743 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4371093a-6c61-4f91-ad3a-e16af86d1877 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:33.095092 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371093a-6c61-4f91-ad3a-e16af86d1877 service neutron] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:33.095508 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371093a-6c61-4f91-ad3a-e16af86d1877 service neutron] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:33.095989 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371093a-6c61-4f91-ad3a-e16af86d1877 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:33.111814 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4371093a-6c61-4f91-ad3a-e16af86d1877 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:33.113446 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4371093a-6c61-4f91-ad3a-e16af86d1877 service neutron] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:33.126772 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 795/1598] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:25:32 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:25:33.127865 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bf0d49-a427-4f6e-883f-fd7e61f401b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6966ce0774f4437a9b688494e9d0574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:33.128715 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf0d49-a427-4f6e-883f-fd7e61f401b0 service cinder] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:33.129117 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf0d49-a427-4f6e-883f-fd7e61f401b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:33.130370 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf0d49-a427-4f6e-883f-fd7e61f401b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:33.228521 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bf0d49-a427-4f6e-883f-fd7e61f401b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:33.230567 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bf0d49-a427-4f6e-883f-fd7e61f401b0 service cinder] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:33.249379 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 804/1599] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:25:33 2021] GET /identity/v3/auth/tokens => generated 3490 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:25:33.432447 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4371093a-6c61-4f91-ad3a-e16af86d1877 service neutron] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:33.443619 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4371093a-6c61-4f91-ad3a-e16af86d1877 service neutron] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:33.448511 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153dd0b5-1caa-4db7-9c98-450305d2b864 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6966ce0774f4437a9b688494e9d0574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:33.449305 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153dd0b5-1caa-4db7-9c98-450305d2b864 service cinder] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:33.449697 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153dd0b5-1caa-4db7-9c98-450305d2b864 service cinder] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:33.450085 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153dd0b5-1caa-4db7-9c98-450305d2b864 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:33.577663 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153dd0b5-1caa-4db7-9c98-450305d2b864 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:33.579450 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153dd0b5-1caa-4db7-9c98-450305d2b864 service cinder] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:33.600218 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 796/1600] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:25:33 2021] GET /identity/v3/auth/tokens => generated 3385 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:25:33.744242 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bf0d49-a427-4f6e-883f-fd7e61f401b0 service cinder] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:33.866360 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bf0d49-a427-4f6e-883f-fd7e61f401b0 service cinder] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:33.880473 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deb8fdd-24b0-4d8a-818f-0671a4d89de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:33.881519 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb8fdd-24b0-4d8a-818f-0671a4d89de7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:33.881875 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb8fdd-24b0-4d8a-818f-0671a4d89de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:33.882244 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb8fdd-24b0-4d8a-818f-0671a4d89de7 admin admin] PATH_INFO: `/v3/users/51d43864bf9f4bfda994440ceac7103e` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:33.887056 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deb8fdd-24b0-4d8a-818f-0671a4d89de7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51d43864bf9f4bfda994440ceac7103e)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:33.890357 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: WARNING py.warnings [None req-1deb8fdd-24b0-4d8a-818f-0671a4d89de7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:25:33.890357 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: warnings.warn(msg) Oct 12 18:25:33.890357 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: Oct 12 18:25:33.890357 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deb8fdd-24b0-4d8a-818f-0671a4d89de7 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:34.257500 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-1deb8fdd-24b0-4d8a-818f-0671a4d89de7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51d43864bf9f4bfda994440ceac7103e'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:34.258205 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-1deb8fdd-24b0-4d8a-818f-0671a4d89de7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51d43864bf9f4bfda994440ceac7103e'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:34.333422 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-1deb8fdd-24b0-4d8a-818f-0671a4d89de7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51d43864bf9f4bfda994440ceac7103e'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:34.334372 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-1deb8fdd-24b0-4d8a-818f-0671a4d89de7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51d43864bf9f4bfda994440ceac7103e'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:34.359719 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153dd0b5-1caa-4db7-9c98-450305d2b864 service cinder] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:34.371492 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-1deb8fdd-24b0-4d8a-818f-0671a4d89de7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51d43864bf9f4bfda994440ceac7103e'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:34.461355 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 805/1601] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:25:33 2021] DELETE /identity/v3/users/51d43864bf9f4bfda994440ceac7103e => generated 0 bytes in 717 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:25:34.469103 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a522366c-f7f5-4e31-9f80-6608918ee64d None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:34.469745 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a522366c-f7f5-4e31-9f80-6608918ee64d None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:34.470229 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a522366c-f7f5-4e31-9f80-6608918ee64d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:34.523730 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-a522366c-f7f5-4e31-9f80-6608918ee64d None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:25:34.526506 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-a522366c-f7f5-4e31-9f80-6608918ee64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:34.571265 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153dd0b5-1caa-4db7-9c98-450305d2b864 service cinder] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:34.774901 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 806/1602] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:25:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:25:34.775698 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983952dc-796f-4031-80dc-5cd50143ad81 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bd99e4f2d444a388ecde7ea3cb61089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:34.775698 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983952dc-796f-4031-80dc-5cd50143ad81 service placement] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:34.775698 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983952dc-796f-4031-80dc-5cd50143ad81 service placement] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:34.775698 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983952dc-796f-4031-80dc-5cd50143ad81 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:34.781236 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a522366c-f7f5-4e31-9f80-6608918ee64d None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:34.781236 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-a522366c-f7f5-4e31-9f80-6608918ee64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:34.789731 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-983952dc-796f-4031-80dc-5cd50143ad81 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:34.844586 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983952dc-796f-4031-80dc-5cd50143ad81 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:34.850360 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983952dc-796f-4031-80dc-5cd50143ad81 service placement] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:34.898957 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 797/1603] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:25:34 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 18:25:34.922472 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a522366c-f7f5-4e31-9f80-6608918ee64d None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:34.941008 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d43ff4f-ec09-4362-8cf9-897947d3a362 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:34.941724 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d43ff4f-ec09-4362-8cf9-897947d3a362 service neutron] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:34.942105 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d43ff4f-ec09-4362-8cf9-897947d3a362 service neutron] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:34.942563 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d43ff4f-ec09-4362-8cf9-897947d3a362 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:34.960837 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d43ff4f-ec09-4362-8cf9-897947d3a362 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:34.976477 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d43ff4f-ec09-4362-8cf9-897947d3a362 service neutron] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:35.002636 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 807/1604] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:25:34 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:25:36.131652 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab7f01-9961-4847-8c3f-a96a93d0ff1e None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:36.131652 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab7f01-9961-4847-8c3f-a96a93d0ff1e None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:36.131652 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab7f01-9961-4847-8c3f-a96a93d0ff1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:36.212134 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-09ab7f01-9961-4847-8c3f-a96a93d0ff1e None None] MFA Rules not processed for user `b9dca4bb37fa428f92980078b2d566d3`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:25:36.216820 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-09ab7f01-9961-4847-8c3f-a96a93d0ff1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:36.417093 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 798/1605] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:25:36 2021] POST /identity/v3/auth/tokens => generated 3492 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:25:36.481699 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d43ff4f-ec09-4362-8cf9-897947d3a362 service neutron] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:36.484024 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-3d43ff4f-ec09-4362-8cf9-897947d3a362 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:36.519227 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d43ff4f-ec09-4362-8cf9-897947d3a362 service neutron] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:36.536170 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cffd8f6-1ac2-4efd-92df-113b08584ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:36.540119 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cffd8f6-1ac2-4efd-92df-113b08584ad2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:36.540443 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cffd8f6-1ac2-4efd-92df-113b08584ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:36.541486 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cffd8f6-1ac2-4efd-92df-113b08584ad2 admin admin] PATH_INFO: `/v3/projects/898ba601237143988a195f0471a82ffa` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:36.543997 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cffd8f6-1ac2-4efd-92df-113b08584ad2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=898ba601237143988a195f0471a82ffa)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:36.550757 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cffd8f6-1ac2-4efd-92df-113b08584ad2 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:36.737903 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-7cffd8f6-1ac2-4efd-92df-113b08584ad2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '898ba601237143988a195f0471a82ffa', 'request_id': 'req-7cffd8f6-1ac2-4efd-92df-113b08584ad2'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:36.758327 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-7cffd8f6-1ac2-4efd-92df-113b08584ad2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '898ba601237143988a195f0471a82ffa', 'request_id': 'req-7cffd8f6-1ac2-4efd-92df-113b08584ad2'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:36.786137 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-7cffd8f6-1ac2-4efd-92df-113b08584ad2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '898ba601237143988a195f0471a82ffa', 'request_id': 'req-7cffd8f6-1ac2-4efd-92df-113b08584ad2'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:36.917354 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-7cffd8f6-1ac2-4efd-92df-113b08584ad2 admin admin] The token cache is being invalidate because project 898ba601237143988a195f0471a82ffa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74005) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:25:36.921659 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-7cffd8f6-1ac2-4efd-92df-113b08584ad2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:36.921659 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-7cffd8f6-1ac2-4efd-92df-113b08584ad2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:36.925724 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 808/1606] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:25:36 2021] DELETE /identity/v3/projects/898ba601237143988a195f0471a82ffa => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:25:36.926491 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ab7f01-9961-4847-8c3f-a96a93d0ff1e None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:36.944882 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ab7f01-9961-4847-8c3f-a96a93d0ff1e None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:37.119094 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a5d745-ced1-485e-8b11-6d04546707ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:37.119094 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a5d745-ced1-485e-8b11-6d04546707ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:37.119094 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a5d745-ced1-485e-8b11-6d04546707ed admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:37.119094 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a5d745-ced1-485e-8b11-6d04546707ed admin admin] PATH_INFO: `/v3/users/dcbcff8f22474248ab8b068449244ff3` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:37.119729 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a5d745-ced1-485e-8b11-6d04546707ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcbcff8f22474248ab8b068449244ff3)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:37.121584 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a5d745-ced1-485e-8b11-6d04546707ed admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:37.388809 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-97a5d745-ced1-485e-8b11-6d04546707ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcbcff8f22474248ab8b068449244ff3'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:37.402315 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-97a5d745-ced1-485e-8b11-6d04546707ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcbcff8f22474248ab8b068449244ff3'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:37.428052 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-97a5d745-ced1-485e-8b11-6d04546707ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcbcff8f22474248ab8b068449244ff3'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:37.582964 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-97a5d745-ced1-485e-8b11-6d04546707ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcbcff8f22474248ab8b068449244ff3'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:37.583615 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-97a5d745-ced1-485e-8b11-6d04546707ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcbcff8f22474248ab8b068449244ff3'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:37.591535 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 799/1607] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:25:36 2021] DELETE /identity/v3/users/dcbcff8f22474248ab8b068449244ff3 => generated 0 bytes in 666 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:25:38.913805 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cffd8f6-1ac2-4efd-92df-113b08584ad2 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:38.914411 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-7cffd8f6-1ac2-4efd-92df-113b08584ad2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:38.939812 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cffd8f6-1ac2-4efd-92df-113b08584ad2 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:39.075464 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c0eb11-fe50-4a4b-868f-ada3f68e4bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:39.077182 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0eb11-fe50-4a4b-868f-ada3f68e4bb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:39.077627 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0eb11-fe50-4a4b-868f-ada3f68e4bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:39.078119 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0eb11-fe50-4a4b-868f-ada3f68e4bb3 admin admin] PATH_INFO: `/v3/projects/79862b324a6d475b9c75960e518b234d` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:39.084459 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c0eb11-fe50-4a4b-868f-ada3f68e4bb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79862b324a6d475b9c75960e518b234d)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:39.086417 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c0eb11-fe50-4a4b-868f-ada3f68e4bb3 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:39.323087 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-f1c0eb11-fe50-4a4b-868f-ada3f68e4bb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79862b324a6d475b9c75960e518b234d', 'request_id': 'req-f1c0eb11-fe50-4a4b-868f-ada3f68e4bb3'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:39.333209 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-f1c0eb11-fe50-4a4b-868f-ada3f68e4bb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79862b324a6d475b9c75960e518b234d', 'request_id': 'req-f1c0eb11-fe50-4a4b-868f-ada3f68e4bb3'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:39.340289 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-f1c0eb11-fe50-4a4b-868f-ada3f68e4bb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79862b324a6d475b9c75960e518b234d', 'request_id': 'req-f1c0eb11-fe50-4a4b-868f-ada3f68e4bb3'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:39.447809 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-f1c0eb11-fe50-4a4b-868f-ada3f68e4bb3 admin admin] The token cache is being invalidate because project 79862b324a6d475b9c75960e518b234d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74005) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:25:39.448112 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-f1c0eb11-fe50-4a4b-868f-ada3f68e4bb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:39.448826 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-f1c0eb11-fe50-4a4b-868f-ada3f68e4bb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:39.450381 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 809/1608] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:25:38 2021] DELETE /identity/v3/projects/79862b324a6d475b9c75960e518b234d => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:25:39.456164 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f98c29-c539-4c1b-a36c-dce06f7df2f9 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:39.457130 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f98c29-c539-4c1b-a36c-dce06f7df2f9 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:39.457584 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f98c29-c539-4c1b-a36c-dce06f7df2f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:39.486532 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-93f98c29-c539-4c1b-a36c-dce06f7df2f9 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:25:39.487779 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-93f98c29-c539-4c1b-a36c-dce06f7df2f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:39.590845 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 800/1609] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:25:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:25:39.599007 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ec8d9-11b8-4d87-adf6-90b87310049b None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:39.599294 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ec8d9-11b8-4d87-adf6-90b87310049b None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:39.599779 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ec8d9-11b8-4d87-adf6-90b87310049b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:39.641406 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-966ec8d9-11b8-4d87-adf6-90b87310049b None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:25:39.642781 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-966ec8d9-11b8-4d87-adf6-90b87310049b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:39.663089 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 810/1610] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:25:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:25:39.667928 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f98c29-c539-4c1b-a36c-dce06f7df2f9 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:39.682825 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f98c29-c539-4c1b-a36c-dce06f7df2f9 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:39.699925 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a254fef-f0cb-47a8-bb6f-a2d2733c9583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:39.700852 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a254fef-f0cb-47a8-bb6f-a2d2733c9583 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:39.701235 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a254fef-f0cb-47a8-bb6f-a2d2733c9583 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:39.701872 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a254fef-f0cb-47a8-bb6f-a2d2733c9583 admin admin] PATH_INFO: `/v3/domains` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:39.702921 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a254fef-f0cb-47a8-bb6f-a2d2733c9583 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:25:39.707496 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a254fef-f0cb-47a8-bb6f-a2d2733c9583 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:39.709402 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a254fef-f0cb-47a8-bb6f-a2d2733c9583 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:39.746694 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 801/1611] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 12 18:25:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:25:39.750986 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966ec8d9-11b8-4d87-adf6-90b87310049b None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:39.770847 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966ec8d9-11b8-4d87-adf6-90b87310049b None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:39.791797 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d819c9c-7ed1-4df8-b4df-4f06fe800db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:39.792524 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d819c9c-7ed1-4df8-b4df-4f06fe800db5 admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:39.792817 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d819c9c-7ed1-4df8-b4df-4f06fe800db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:39.793074 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d819c9c-7ed1-4df8-b4df-4f06fe800db5 admin admin] PATH_INFO: `/v3/projects` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:39.793811 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d819c9c-7ed1-4df8-b4df-4f06fe800db5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:39.806773 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d819c9c-7ed1-4df8-b4df-4f06fe800db5 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:39.965191 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 811/1612] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:25:39 2021] POST /identity/v3/projects => generated 373 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:25:39.969128 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a254fef-f0cb-47a8-bb6f-a2d2733c9583 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:39.993850 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a254fef-f0cb-47a8-bb6f-a2d2733c9583 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:40.108803 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e88af6-47e9-45ea-a7ad-c5c4ecb973e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:40.114135 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e88af6-47e9-45ea-a7ad-c5c4ecb973e2 admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:40.114135 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e88af6-47e9-45ea-a7ad-c5c4ecb973e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:40.114135 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e88af6-47e9-45ea-a7ad-c5c4ecb973e2 admin admin] PATH_INFO: `/v3/users` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:40.114135 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e88af6-47e9-45ea-a7ad-c5c4ecb973e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:40.114135 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e88af6-47e9-45ea-a7ad-c5c4ecb973e2 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:40.219090 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 802/1613] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:25:39 2021] POST /identity/v3/users => generated 287 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 18:25:40.223084 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d819c9c-7ed1-4df8-b4df-4f06fe800db5 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:40.245520 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d819c9c-7ed1-4df8-b4df-4f06fe800db5 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:40.258765 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a339ed-c9d8-4696-9f6f-d77329a52424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:40.259572 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a339ed-c9d8-4696-9f6f-d77329a52424 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:40.260066 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a339ed-c9d8-4696-9f6f-d77329a52424 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:40.260429 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a339ed-c9d8-4696-9f6f-d77329a52424 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:40.261276 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a339ed-c9d8-4696-9f6f-d77329a52424 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:40.263138 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a339ed-c9d8-4696-9f6f-d77329a52424 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:40.290755 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 812/1614] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:25:40 2021] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:25:40.291178 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e88af6-47e9-45ea-a7ad-c5c4ecb973e2 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:40.308203 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e88af6-47e9-45ea-a7ad-c5c4ecb973e2 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:40.321661 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018b5071-31e9-4783-b3c6-0c284d2eb8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:40.323023 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b5071-31e9-4783-b3c6-0c284d2eb8f0 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:40.323366 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b5071-31e9-4783-b3c6-0c284d2eb8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:40.323843 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b5071-31e9-4783-b3c6-0c284d2eb8f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:40.325328 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018b5071-31e9-4783-b3c6-0c284d2eb8f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:40.327512 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018b5071-31e9-4783-b3c6-0c284d2eb8f0 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:40.346683 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 803/1615] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:25:40 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:25:40.350556 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a339ed-c9d8-4696-9f6f-d77329a52424 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:40.365228 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a339ed-c9d8-4696-9f6f-d77329a52424 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:40.371264 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc764e6-eca5-42f9-b27d-2dbe1283291e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:40.373906 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc764e6-eca5-42f9-b27d-2dbe1283291e admin admin] REQUEST_METHOD: `PUT` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:40.373906 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc764e6-eca5-42f9-b27d-2dbe1283291e admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:40.373906 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc764e6-eca5-42f9-b27d-2dbe1283291e admin admin] PATH_INFO: `/v3/projects/11257010d54549a98c2a8e6c91860717/users/b3d9794a3ae04adb91ee66fac1a48cce/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:40.405943 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc764e6-eca5-42f9-b27d-2dbe1283291e admin admin] RBAC: Authorizing `identity:create_grant(project_id=11257010d54549a98c2a8e6c91860717, user_id=b3d9794a3ae04adb91ee66fac1a48cce, role_id=33b8a5a8d1d643f2a98f598e6ab0a1cf)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:40.408944 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc764e6-eca5-42f9-b27d-2dbe1283291e admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:40.518278 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 813/1616] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:25:40 2021] PUT /identity/v3/projects/11257010d54549a98c2a8e6c91860717/users/b3d9794a3ae04adb91ee66fac1a48cce/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:25:40.521239 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c9fad-8bf0-44a1-8d2f-a68ca7c5a00d None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:40.521726 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c9fad-8bf0-44a1-8d2f-a68ca7c5a00d None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:40.523111 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c9fad-8bf0-44a1-8d2f-a68ca7c5a00d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:40.579170 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-d90c9fad-8bf0-44a1-8d2f-a68ca7c5a00d None None] MFA Rules not processed for user `b3d9794a3ae04adb91ee66fac1a48cce`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:25:40.599708 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-d90c9fad-8bf0-44a1-8d2f-a68ca7c5a00d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:40.733599 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 804/1617] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:25:40 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:25:40.740911 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc764e6-eca5-42f9-b27d-2dbe1283291e admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:40.841353 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90c9fad-8bf0-44a1-8d2f-a68ca7c5a00d None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:40.843418 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-d90c9fad-8bf0-44a1-8d2f-a68ca7c5a00d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:40.965826 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc764e6-eca5-42f9-b27d-2dbe1283291e admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:40.973203 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9873df2-94ac-4183-94fb-49486f5ea899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:40.975083 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9873df2-94ac-4183-94fb-49486f5ea899 admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:40.975703 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9873df2-94ac-4183-94fb-49486f5ea899 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:40.976271 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9873df2-94ac-4183-94fb-49486f5ea899 admin admin] PATH_INFO: `/v3/projects` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:40.977391 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9873df2-94ac-4183-94fb-49486f5ea899 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:41.002854 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9873df2-94ac-4183-94fb-49486f5ea899 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:41.013237 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90c9fad-8bf0-44a1-8d2f-a68ca7c5a00d None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:41.019244 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c879b57d-9a8e-4872-8374-b7f8e38fd1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:41.024917 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879b57d-9a8e-4872-8374-b7f8e38fd1e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:41.024917 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879b57d-9a8e-4872-8374-b7f8e38fd1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:41.024917 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879b57d-9a8e-4872-8374-b7f8e38fd1e1 admin admin] PATH_INFO: `/v3/users/548ce7f3a2b74ce5bc70afbc0463f391` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:41.024917 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c879b57d-9a8e-4872-8374-b7f8e38fd1e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=548ce7f3a2b74ce5bc70afbc0463f391)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:41.025632 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c879b57d-9a8e-4872-8374-b7f8e38fd1e1 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:41.158316 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 814/1618] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:25:40 2021] POST /identity/v3/projects => generated 373 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:25:41.158316 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb25bea-b211-493e-b0ea-070e8145e06f None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:41.158316 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb25bea-b211-493e-b0ea-070e8145e06f None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:41.158316 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb25bea-b211-493e-b0ea-070e8145e06f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:41.213358 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-6bb25bea-b211-493e-b0ea-070e8145e06f None None] MFA Rules not processed for user `74acf90c734149808a501de7754b5943`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:25:41.215487 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-6bb25bea-b211-493e-b0ea-070e8145e06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:41.513905 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 815/1619] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:25:41 2021] POST /identity/v3/auth/tokens => generated 3409 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:25:41.513905 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb25bea-b211-493e-b0ea-070e8145e06f None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:41.516345 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-c879b57d-9a8e-4872-8374-b7f8e38fd1e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '548ce7f3a2b74ce5bc70afbc0463f391'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:41.545555 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb25bea-b211-493e-b0ea-070e8145e06f None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:41.545820 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-c879b57d-9a8e-4872-8374-b7f8e38fd1e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '548ce7f3a2b74ce5bc70afbc0463f391'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:41.546428 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceefaf9-9e87-49f7-a1cd-020f5a5557b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:41.546428 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceefaf9-9e87-49f7-a1cd-020f5a5557b6 admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:41.546428 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceefaf9-9e87-49f7-a1cd-020f5a5557b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:41.546428 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceefaf9-9e87-49f7-a1cd-020f5a5557b6 admin admin] PATH_INFO: `/v3/users` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:41.546713 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceefaf9-9e87-49f7-a1cd-020f5a5557b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:41.546713 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceefaf9-9e87-49f7-a1cd-020f5a5557b6 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:41.546824 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-c879b57d-9a8e-4872-8374-b7f8e38fd1e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '548ce7f3a2b74ce5bc70afbc0463f391'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:41.783685 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-c879b57d-9a8e-4872-8374-b7f8e38fd1e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '548ce7f3a2b74ce5bc70afbc0463f391'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:41.784337 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-c879b57d-9a8e-4872-8374-b7f8e38fd1e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '548ce7f3a2b74ce5bc70afbc0463f391'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:41.797808 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 805/1620] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:25:40 2021] DELETE /identity/v3/users/548ce7f3a2b74ce5bc70afbc0463f391 => generated 0 bytes in 954 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:25:41.799281 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c879b57d-9a8e-4872-8374-b7f8e38fd1e1 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:41.800743 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-c879b57d-9a8e-4872-8374-b7f8e38fd1e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:41.805351 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 816/1621] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:25:41 2021] POST /identity/v3/users => generated 293 bytes in 447 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:25:41.821002 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceefaf9-9e87-49f7-a1cd-020f5a5557b6 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:41.823136 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-3ceefaf9-9e87-49f7-a1cd-020f5a5557b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:41.839179 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceefaf9-9e87-49f7-a1cd-020f5a5557b6 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:41.930598 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ede571b-704e-4c75-b789-d0b07b8341cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:41.931676 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede571b-704e-4c75-b789-d0b07b8341cd admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:41.932516 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede571b-704e-4c75-b789-d0b07b8341cd admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:41.932934 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede571b-704e-4c75-b789-d0b07b8341cd admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:41.934243 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ede571b-704e-4c75-b789-d0b07b8341cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:41.936268 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ede571b-704e-4c75-b789-d0b07b8341cd admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:41.960284 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 817/1622] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:25:41 2021] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:25:41.962553 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce662dd6-3830-48d9-bb84-30e383e5ca84 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:41.963101 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce662dd6-3830-48d9-bb84-30e383e5ca84 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:41.963656 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce662dd6-3830-48d9-bb84-30e383e5ca84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:42.009691 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c879b57d-9a8e-4872-8374-b7f8e38fd1e1 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:42.017817 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d45c45-5564-4df3-b402-1f0d418971f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3417097a280b499086b36df9a2548239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:42.018465 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d45c45-5564-4df3-b402-1f0d418971f4 service nova] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:42.018750 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d45c45-5564-4df3-b402-1f0d418971f4 service nova] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:42.023438 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d45c45-5564-4df3-b402-1f0d418971f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:42.023438 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-16d45c45-5564-4df3-b402-1f0d418971f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:42.028981 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-ce662dd6-3830-48d9-bb84-30e383e5ca84 None None] MFA Rules not processed for user `835bbb43ae5f48bfa14b22cb0a47cb4e`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:25:42.030466 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-ce662dd6-3830-48d9-bb84-30e383e5ca84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:42.120121 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 818/1623] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:25:41 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:25:42.121333 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce662dd6-3830-48d9-bb84-30e383e5ca84 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:42.134685 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce662dd6-3830-48d9-bb84-30e383e5ca84 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:42.142473 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec1fbcc-42d9-4d40-8ccb-6eb28af5ad05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:42.143503 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1fbcc-42d9-4d40-8ccb-6eb28af5ad05 admin admin] REQUEST_METHOD: `PUT` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:42.143785 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1fbcc-42d9-4d40-8ccb-6eb28af5ad05 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:42.144056 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1fbcc-42d9-4d40-8ccb-6eb28af5ad05 admin admin] PATH_INFO: `/v3/projects/2b165876393841e1b8a0178f5e0cf9d1/users/f3e2687dc9654715886e011e0ce1c331/roles/6c54f239944d46e3b027ccce97eb8b49` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:42.183560 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec1fbcc-42d9-4d40-8ccb-6eb28af5ad05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b165876393841e1b8a0178f5e0cf9d1, user_id=f3e2687dc9654715886e011e0ce1c331, role_id=6c54f239944d46e3b027ccce97eb8b49)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:42.186443 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d45c45-5564-4df3-b402-1f0d418971f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:42.188176 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d45c45-5564-4df3-b402-1f0d418971f4 service nova] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:42.188293 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec1fbcc-42d9-4d40-8ccb-6eb28af5ad05 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:42.213953 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 806/1624] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:25:41 2021] GET /identity/v3/auth/tokens => generated 3409 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:25:42.221737 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d45c45-5564-4df3-b402-1f0d418971f4 service nova] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:42.223037 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-16d45c45-5564-4df3-b402-1f0d418971f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:42.237944 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d45c45-5564-4df3-b402-1f0d418971f4 service nova] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:42.245452 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7966ff-a754-446e-aff6-78b58fa81ead service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3417097a280b499086b36df9a2548239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:42.246134 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7966ff-a754-446e-aff6-78b58fa81ead service nova] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:42.246449 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7966ff-a754-446e-aff6-78b58fa81ead service nova] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:42.246838 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7966ff-a754-446e-aff6-78b58fa81ead service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:42.256195 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7966ff-a754-446e-aff6-78b58fa81ead service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:42.265828 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7966ff-a754-446e-aff6-78b58fa81ead service nova] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:42.277258 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 807/1625] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:25:42 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:25:42.278132 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7966ff-a754-446e-aff6-78b58fa81ead service nova] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:42.279667 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-8c7966ff-a754-446e-aff6-78b58fa81ead service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:42.293917 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7966ff-a754-446e-aff6-78b58fa81ead service nova] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:42.299581 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e729470-4125-4a5b-a936-c926d97d76d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:42.300587 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e729470-4125-4a5b-a936-c926d97d76d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:42.300988 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e729470-4125-4a5b-a936-c926d97d76d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:42.301332 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e729470-4125-4a5b-a936-c926d97d76d6 admin admin] PATH_INFO: `/v3/projects/0e8e9dc83e25477dae45ac51e7fee2c6` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:42.303515 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e729470-4125-4a5b-a936-c926d97d76d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e8e9dc83e25477dae45ac51e7fee2c6)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:42.304783 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: WARNING py.warnings [None req-0e729470-4125-4a5b-a936-c926d97d76d6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:25:42.304783 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: warnings.warn(msg) Oct 12 18:25:42.304783 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: Oct 12 18:25:42.306085 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e729470-4125-4a5b-a936-c926d97d76d6 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:42.315177 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 819/1626] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:25:42 2021] PUT /identity/v3/projects/2b165876393841e1b8a0178f5e0cf9d1/users/f3e2687dc9654715886e011e0ce1c331/roles/6c54f239944d46e3b027ccce97eb8b49 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:25:42.319508 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec1fbcc-42d9-4d40-8ccb-6eb28af5ad05 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:42.443895 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec1fbcc-42d9-4d40-8ccb-6eb28af5ad05 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:42.470946 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de68fdbe-004b-4a81-9215-15b8f89ccf6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:42.471855 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de68fdbe-004b-4a81-9215-15b8f89ccf6b admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:42.472183 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de68fdbe-004b-4a81-9215-15b8f89ccf6b admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:42.472768 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de68fdbe-004b-4a81-9215-15b8f89ccf6b admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:42.474432 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de68fdbe-004b-4a81-9215-15b8f89ccf6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:42.487021 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de68fdbe-004b-4a81-9215-15b8f89ccf6b admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:42.508646 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 820/1627] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:25:42 2021] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 18:25:42.509996 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de68fdbe-004b-4a81-9215-15b8f89ccf6b admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:42.534662 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de68fdbe-004b-4a81-9215-15b8f89ccf6b admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:42.535605 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-0e729470-4125-4a5b-a936-c926d97d76d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e8e9dc83e25477dae45ac51e7fee2c6', 'request_id': 'req-0e729470-4125-4a5b-a936-c926d97d76d6'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:42.622956 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-0e729470-4125-4a5b-a936-c926d97d76d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e8e9dc83e25477dae45ac51e7fee2c6', 'request_id': 'req-0e729470-4125-4a5b-a936-c926d97d76d6'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:42.647643 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-0e729470-4125-4a5b-a936-c926d97d76d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e8e9dc83e25477dae45ac51e7fee2c6', 'request_id': 'req-0e729470-4125-4a5b-a936-c926d97d76d6'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:42.693787 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-0e729470-4125-4a5b-a936-c926d97d76d6 admin admin] The token cache is being invalidate because project 0e8e9dc83e25477dae45ac51e7fee2c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:25:42.693787 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-0e729470-4125-4a5b-a936-c926d97d76d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:42.694478 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c85887-17d4-43da-8598-20cd5d6e78c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:42.699424 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c85887-17d4-43da-8598-20cd5d6e78c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:42.699424 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c85887-17d4-43da-8598-20cd5d6e78c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:42.699424 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c85887-17d4-43da-8598-20cd5d6e78c7 admin admin] PATH_INFO: `/v3/projects/2b165876393841e1b8a0178f5e0cf9d1/users/f3e2687dc9654715886e011e0ce1c331/roles/6c54f239944d46e3b027ccce97eb8b49` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:42.700974 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-0e729470-4125-4a5b-a936-c926d97d76d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:42.701408 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c85887-17d4-43da-8598-20cd5d6e78c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b165876393841e1b8a0178f5e0cf9d1, user_id=f3e2687dc9654715886e011e0ce1c331, role_id=6c54f239944d46e3b027ccce97eb8b49)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:42.707420 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 808/1628] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:25:42 2021] DELETE /identity/v3/projects/0e8e9dc83e25477dae45ac51e7fee2c6 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:25:42.709896 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c85887-17d4-43da-8598-20cd5d6e78c7 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:42.711826 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e729470-4125-4a5b-a936-c926d97d76d6 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:42.714327 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-0e729470-4125-4a5b-a936-c926d97d76d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:42.740239 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e729470-4125-4a5b-a936-c926d97d76d6 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:42.740648 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 821/1629] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:25:42 2021] PUT /identity/v3/projects/2b165876393841e1b8a0178f5e0cf9d1/users/f3e2687dc9654715886e011e0ce1c331/roles/6c54f239944d46e3b027ccce97eb8b49 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:25:42.816062 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6341128-f429-49f2-8287-137227382b49 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:42.816357 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6341128-f429-49f2-8287-137227382b49 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:42.816675 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6341128-f429-49f2-8287-137227382b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:42.890684 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-d6341128-f429-49f2-8287-137227382b49 None None] MFA Rules not processed for user `f3e2687dc9654715886e011e0ce1c331`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:25:42.891942 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-d6341128-f429-49f2-8287-137227382b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:42.996722 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf84b23-b7f7-4d85-bf36-5f3f6adf08a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:42.998422 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf84b23-b7f7-4d85-bf36-5f3f6adf08a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:42.999846 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf84b23-b7f7-4d85-bf36-5f3f6adf08a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:43.000346 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf84b23-b7f7-4d85-bf36-5f3f6adf08a1 admin admin] PATH_INFO: `/v3/users/b9dca4bb37fa428f92980078b2d566d3` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:43.001995 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf84b23-b7f7-4d85-bf36-5f3f6adf08a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9dca4bb37fa428f92980078b2d566d3)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:43.005863 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf84b23-b7f7-4d85-bf36-5f3f6adf08a1 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:43.184479 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 822/1630] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:25:42 2021] POST /identity/v3/auth/tokens => generated 3460 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:25:43.239128 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-ddf84b23-b7f7-4d85-bf36-5f3f6adf08a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9dca4bb37fa428f92980078b2d566d3'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:43.261637 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-ddf84b23-b7f7-4d85-bf36-5f3f6adf08a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9dca4bb37fa428f92980078b2d566d3'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:43.296315 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-ddf84b23-b7f7-4d85-bf36-5f3f6adf08a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9dca4bb37fa428f92980078b2d566d3'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:43.349378 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6341128-f429-49f2-8287-137227382b49 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:43.351448 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-d6341128-f429-49f2-8287-137227382b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:43.389145 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-ddf84b23-b7f7-4d85-bf36-5f3f6adf08a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9dca4bb37fa428f92980078b2d566d3'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:43.390098 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-ddf84b23-b7f7-4d85-bf36-5f3f6adf08a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9dca4bb37fa428f92980078b2d566d3'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:43.408761 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 809/1631] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:25:42 2021] DELETE /identity/v3/users/b9dca4bb37fa428f92980078b2d566d3 => generated 0 bytes in 697 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 18:25:43.560337 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6341128-f429-49f2-8287-137227382b49 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:43.819917 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c324f1bf-c857-47f0-99c2-bb7aeec6e2d2 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:43.820820 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c324f1bf-c857-47f0-99c2-bb7aeec6e2d2 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:43.820820 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c324f1bf-c857-47f0-99c2-bb7aeec6e2d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:43.826724 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0967eff9-4e33-4783-a76c-d2e2a52a07a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6966ce0774f4437a9b688494e9d0574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:43.827450 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0967eff9-4e33-4783-a76c-d2e2a52a07a3 service cinder] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:43.827732 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0967eff9-4e33-4783-a76c-d2e2a52a07a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:43.828063 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0967eff9-4e33-4783-a76c-d2e2a52a07a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:43.830307 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-0967eff9-4e33-4783-a76c-d2e2a52a07a3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:43.862062 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-c324f1bf-c857-47f0-99c2-bb7aeec6e2d2 None None] MFA Rules not processed for user `8f6a3a7064754fb79a0a06b3ad4a7d05`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:25:43.863401 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-c324f1bf-c857-47f0-99c2-bb7aeec6e2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:43.964202 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 810/1632] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Oct 12 18:25:43 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:25:43.967194 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0967eff9-4e33-4783-a76c-d2e2a52a07a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:43.968587 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0967eff9-4e33-4783-a76c-d2e2a52a07a3 service cinder] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:43.983539 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 823/1633] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:25:43 2021] GET /identity/v3/auth/tokens => generated 3460 bytes in 633 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:25:44.510357 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c324f1bf-c857-47f0-99c2-bb7aeec6e2d2 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:44.514626 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-c324f1bf-c857-47f0-99c2-bb7aeec6e2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:44.551492 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0967eff9-4e33-4783-a76c-d2e2a52a07a3 service cinder] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:44.554443 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-0967eff9-4e33-4783-a76c-d2e2a52a07a3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:44.751274 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c324f1bf-c857-47f0-99c2-bb7aeec6e2d2 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:44.760033 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c979f704-a0ac-42be-b779-a111b2468453 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f527f925af24eba8cabffe457fceb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:44.761821 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c979f704-a0ac-42be-b779-a111b2468453 service swift] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:44.762270 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c979f704-a0ac-42be-b779-a111b2468453 service swift] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:44.762696 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c979f704-a0ac-42be-b779-a111b2468453 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:44.792743 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c979f704-a0ac-42be-b779-a111b2468453 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:44.797358 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c979f704-a0ac-42be-b779-a111b2468453 service swift] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:44.805087 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0967eff9-4e33-4783-a76c-d2e2a52a07a3 service cinder] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:44.824815 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 811/1634] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Oct 12 18:25:44 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 12 18:25:44.825543 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f614ee5-5ad2-4b6d-8572-aa87b95ccc2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:44.826437 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f614ee5-5ad2-4b6d-8572-aa87b95ccc2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:44.826715 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f614ee5-5ad2-4b6d-8572-aa87b95ccc2a admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:44.827143 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f614ee5-5ad2-4b6d-8572-aa87b95ccc2a admin admin] PATH_INFO: `/v3/projects/6ffaaf836e7a49e6965a7d80f3fd4400` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:44.835400 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f614ee5-5ad2-4b6d-8572-aa87b95ccc2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ffaaf836e7a49e6965a7d80f3fd4400)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:44.839253 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f614ee5-5ad2-4b6d-8572-aa87b95ccc2a admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:45.041679 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-2f614ee5-5ad2-4b6d-8572-aa87b95ccc2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ffaaf836e7a49e6965a7d80f3fd4400', 'request_id': 'req-2f614ee5-5ad2-4b6d-8572-aa87b95ccc2a'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:45.067211 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-2f614ee5-5ad2-4b6d-8572-aa87b95ccc2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ffaaf836e7a49e6965a7d80f3fd4400', 'request_id': 'req-2f614ee5-5ad2-4b6d-8572-aa87b95ccc2a'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:45.093289 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-2f614ee5-5ad2-4b6d-8572-aa87b95ccc2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ffaaf836e7a49e6965a7d80f3fd4400', 'request_id': 'req-2f614ee5-5ad2-4b6d-8572-aa87b95ccc2a'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:45.224918 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-2f614ee5-5ad2-4b6d-8572-aa87b95ccc2a admin admin] The token cache is being invalidate because project 6ffaaf836e7a49e6965a7d80f3fd4400 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74005) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:25:45.225521 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-2f614ee5-5ad2-4b6d-8572-aa87b95ccc2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:45.226454 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-2f614ee5-5ad2-4b6d-8572-aa87b95ccc2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:45.229915 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 824/1635] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:25:44 2021] DELETE /identity/v3/projects/6ffaaf836e7a49e6965a7d80f3fd4400 => generated 0 bytes in 679 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:25:45.236312 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c06bc-e024-4d97-9d2e-1d01e2e226e4 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:45.236639 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c06bc-e024-4d97-9d2e-1d01e2e226e4 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:45.237087 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c06bc-e024-4d97-9d2e-1d01e2e226e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:45.301210 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-c80c06bc-e024-4d97-9d2e-1d01e2e226e4 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:25:45.305761 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-c80c06bc-e024-4d97-9d2e-1d01e2e226e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:45.442253 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 812/1636] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:25:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:25:45.450550 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247744f-3cd8-48c4-add2-6009de476da8 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:45.450843 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247744f-3cd8-48c4-add2-6009de476da8 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:45.451124 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247744f-3cd8-48c4-add2-6009de476da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:45.491308 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-f247744f-3cd8-48c4-add2-6009de476da8 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:25:45.494574 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-f247744f-3cd8-48c4-add2-6009de476da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:45.518428 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 825/1637] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:25:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:25:45.519731 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80c06bc-e024-4d97-9d2e-1d01e2e226e4 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:45.540096 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80c06bc-e024-4d97-9d2e-1d01e2e226e4 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:45.565233 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e599716-abcc-4aa7-a79e-525815130ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:45.568291 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e599716-abcc-4aa7-a79e-525815130ba3 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:45.569188 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e599716-abcc-4aa7-a79e-525815130ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:45.569679 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e599716-abcc-4aa7-a79e-525815130ba3 admin admin] PATH_INFO: `/v3/domains` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:45.571549 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e599716-abcc-4aa7-a79e-525815130ba3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:25:45.572781 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e599716-abcc-4aa7-a79e-525815130ba3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:45.577844 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e599716-abcc-4aa7-a79e-525815130ba3 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:45.601411 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 813/1638] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 12 18:25:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:25:45.607243 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f247744f-3cd8-48c4-add2-6009de476da8 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:45.630687 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f247744f-3cd8-48c4-add2-6009de476da8 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:45.647038 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a6eb43-6277-4d17-b7cb-c569f1c1546d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:45.649236 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a6eb43-6277-4d17-b7cb-c569f1c1546d admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:45.649236 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a6eb43-6277-4d17-b7cb-c569f1c1546d admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:45.649236 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a6eb43-6277-4d17-b7cb-c569f1c1546d admin admin] PATH_INFO: `/v3/projects` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:45.650434 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a6eb43-6277-4d17-b7cb-c569f1c1546d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:45.652933 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a6eb43-6277-4d17-b7cb-c569f1c1546d admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:45.712274 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e599716-abcc-4aa7-a79e-525815130ba3 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:45.714782 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-1e599716-abcc-4aa7-a79e-525815130ba3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:45.776257 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e599716-abcc-4aa7-a79e-525815130ba3 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:45.801074 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb54a46f-746b-4aa2-bd34-a9e4d054c401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:45.806954 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54a46f-746b-4aa2-bd34-a9e4d054c401 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:45.807448 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54a46f-746b-4aa2-bd34-a9e4d054c401 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:45.807879 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54a46f-746b-4aa2-bd34-a9e4d054c401 admin admin] PATH_INFO: `/v3/users/b3d9794a3ae04adb91ee66fac1a48cce` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:45.809789 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 826/1639] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:25:45 2021] POST /identity/v3/projects => generated 367 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 18:25:45.810724 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb54a46f-746b-4aa2-bd34-a9e4d054c401 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3d9794a3ae04adb91ee66fac1a48cce)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:45.813894 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a6eb43-6277-4d17-b7cb-c569f1c1546d admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:45.815008 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb54a46f-746b-4aa2-bd34-a9e4d054c401 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:46.050814 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a6eb43-6277-4d17-b7cb-c569f1c1546d admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:46.057013 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6175c34c-38f1-4094-95f4-adeb0c63a9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:46.058031 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6175c34c-38f1-4094-95f4-adeb0c63a9db admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:46.058314 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6175c34c-38f1-4094-95f4-adeb0c63a9db admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:46.058591 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6175c34c-38f1-4094-95f4-adeb0c63a9db admin admin] PATH_INFO: `/v3/users` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:46.059716 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6175c34c-38f1-4094-95f4-adeb0c63a9db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:46.065464 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6175c34c-38f1-4094-95f4-adeb0c63a9db admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:46.176247 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-fb54a46f-746b-4aa2-bd34-a9e4d054c401 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3d9794a3ae04adb91ee66fac1a48cce'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:46.187917 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-fb54a46f-746b-4aa2-bd34-a9e4d054c401 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3d9794a3ae04adb91ee66fac1a48cce'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:46.205294 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-fb54a46f-746b-4aa2-bd34-a9e4d054c401 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3d9794a3ae04adb91ee66fac1a48cce'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:46.260381 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 827/1640] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:25:45 2021] POST /identity/v3/users => generated 284 bytes in 447 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:25:46.262065 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6175c34c-38f1-4094-95f4-adeb0c63a9db admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:46.292744 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6175c34c-38f1-4094-95f4-adeb0c63a9db admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:46.305333 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84841eb3-0a1e-4faf-8ff2-770751359aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:46.306464 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84841eb3-0a1e-4faf-8ff2-770751359aca admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:46.307223 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84841eb3-0a1e-4faf-8ff2-770751359aca admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:46.309837 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-fb54a46f-746b-4aa2-bd34-a9e4d054c401 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3d9794a3ae04adb91ee66fac1a48cce'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:46.310704 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-fb54a46f-746b-4aa2-bd34-a9e4d054c401 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3d9794a3ae04adb91ee66fac1a48cce'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:46.313145 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84841eb3-0a1e-4faf-8ff2-770751359aca admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:46.318924 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 814/1641] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:25:45 2021] DELETE /identity/v3/users/b3d9794a3ae04adb91ee66fac1a48cce => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 18:25:46.319600 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84841eb3-0a1e-4faf-8ff2-770751359aca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:46.324571 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb43dd54-b508-4fe2-9988-be86b81c89fa None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:46.327904 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb43dd54-b508-4fe2-9988-be86b81c89fa None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:46.331074 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb43dd54-b508-4fe2-9988-be86b81c89fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:46.331185 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84841eb3-0a1e-4faf-8ff2-770751359aca admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:46.385552 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 828/1642] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:25:46 2021] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:25:46.386491 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84841eb3-0a1e-4faf-8ff2-770751359aca admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:46.407208 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-84841eb3-0a1e-4faf-8ff2-770751359aca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:46.409540 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-bb43dd54-b508-4fe2-9988-be86b81c89fa None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:25:46.411997 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-bb43dd54-b508-4fe2-9988-be86b81c89fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:46.437544 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84841eb3-0a1e-4faf-8ff2-770751359aca admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:46.648596 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 815/1643] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:25:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:25:46.655519 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb43dd54-b508-4fe2-9988-be86b81c89fa None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:46.663146 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-bb43dd54-b508-4fe2-9988-be86b81c89fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:46.685206 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788cfcac-3871-40ba-8fc2-60698109ba9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:46.686698 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788cfcac-3871-40ba-8fc2-60698109ba9e admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:46.687611 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788cfcac-3871-40ba-8fc2-60698109ba9e admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:46.687611 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788cfcac-3871-40ba-8fc2-60698109ba9e admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:46.688098 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788cfcac-3871-40ba-8fc2-60698109ba9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:46.689879 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788cfcac-3871-40ba-8fc2-60698109ba9e admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:46.714076 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 829/1644] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:25:46 2021] GET /identity/v3/roles => generated 1420 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:25:46.717420 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788cfcac-3871-40ba-8fc2-60698109ba9e admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:46.734288 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788cfcac-3871-40ba-8fc2-60698109ba9e admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:46.746195 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609098b2-eaa5-4aea-b1f7-92f4655a5bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:46.747111 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609098b2-eaa5-4aea-b1f7-92f4655a5bfe admin admin] REQUEST_METHOD: `PUT` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:46.749200 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609098b2-eaa5-4aea-b1f7-92f4655a5bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:46.749360 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609098b2-eaa5-4aea-b1f7-92f4655a5bfe admin admin] PATH_INFO: `/v3/projects/5c5d044672434a279ace9e729a1f5f21/users/6963d25612444ddcbb9ea5cadd96cc7c/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:46.779781 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609098b2-eaa5-4aea-b1f7-92f4655a5bfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c5d044672434a279ace9e729a1f5f21, user_id=6963d25612444ddcbb9ea5cadd96cc7c, role_id=33b8a5a8d1d643f2a98f598e6ab0a1cf)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:46.786767 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb43dd54-b508-4fe2-9988-be86b81c89fa None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:46.788905 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609098b2-eaa5-4aea-b1f7-92f4655a5bfe admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:46.792234 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c67431-0421-402e-ae56-a037949a153d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:46.794751 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c67431-0421-402e-ae56-a037949a153d service neutron] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:46.794751 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c67431-0421-402e-ae56-a037949a153d service neutron] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:46.794751 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c67431-0421-402e-ae56-a037949a153d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:46.817208 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c67431-0421-402e-ae56-a037949a153d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:46.819687 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c67431-0421-402e-ae56-a037949a153d service neutron] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:46.835595 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 816/1645] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:25:46 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 18:25:46.897963 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 830/1646] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:25:46 2021] PUT /identity/v3/projects/5c5d044672434a279ace9e729a1f5f21/users/6963d25612444ddcbb9ea5cadd96cc7c/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:25:46.909643 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf80132-6023-476f-891a-d382cf163766 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:46.909932 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf80132-6023-476f-891a-d382cf163766 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:46.910204 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf80132-6023-476f-891a-d382cf163766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:46.969345 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-9bf80132-6023-476f-891a-d382cf163766 None None] MFA Rules not processed for user `6963d25612444ddcbb9ea5cadd96cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:25:46.971159 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-9bf80132-6023-476f-891a-d382cf163766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:47.160293 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 817/1647] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:25:46 2021] POST /identity/v3/auth/tokens => generated 3387 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:25:47.162601 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609098b2-eaa5-4aea-b1f7-92f4655a5bfe admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:47.352054 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609098b2-eaa5-4aea-b1f7-92f4655a5bfe admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:47.365878 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e44e6c-aa7d-4c33-a912-05a242625a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:47.366703 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e44e6c-aa7d-4c33-a912-05a242625a99 admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:47.366998 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e44e6c-aa7d-4c33-a912-05a242625a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:47.367272 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e44e6c-aa7d-4c33-a912-05a242625a99 admin admin] PATH_INFO: `/v3/projects` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:47.367996 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e44e6c-aa7d-4c33-a912-05a242625a99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:47.370121 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e44e6c-aa7d-4c33-a912-05a242625a99 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:47.496872 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 831/1648] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:25:47 2021] POST /identity/v3/projects => generated 367 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:25:47.497851 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf80132-6023-476f-891a-d382cf163766 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:47.522523 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf80132-6023-476f-891a-d382cf163766 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:47.686014 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f044ba46-119c-4ccd-beb8-cd5f921b1726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:47.687700 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f044ba46-119c-4ccd-beb8-cd5f921b1726 admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:47.688336 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f044ba46-119c-4ccd-beb8-cd5f921b1726 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:47.690208 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f044ba46-119c-4ccd-beb8-cd5f921b1726 admin admin] PATH_INFO: `/v3/users` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:47.691936 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f044ba46-119c-4ccd-beb8-cd5f921b1726 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:47.695283 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f044ba46-119c-4ccd-beb8-cd5f921b1726 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:47.768214 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 818/1649] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:25:47 2021] POST /identity/v3/users => generated 290 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:25:47.769650 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e44e6c-aa7d-4c33-a912-05a242625a99 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:47.785783 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e44e6c-aa7d-4c33-a912-05a242625a99 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:47.811657 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b785ff74-3a84-40a8-97be-742f7aa2ddc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:47.812788 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785ff74-3a84-40a8-97be-742f7aa2ddc8 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:47.813271 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785ff74-3a84-40a8-97be-742f7aa2ddc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:47.813726 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785ff74-3a84-40a8-97be-742f7aa2ddc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:47.814705 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b785ff74-3a84-40a8-97be-742f7aa2ddc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:47.816600 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b785ff74-3a84-40a8-97be-742f7aa2ddc8 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:47.836964 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f044ba46-119c-4ccd-beb8-cd5f921b1726 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:47.842292 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 832/1650] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:25:47 2021] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:25:47.861021 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f044ba46-119c-4ccd-beb8-cd5f921b1726 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:47.868330 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b0a2b2-6eaf-4a46-850e-811e3c9b786d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:47.869587 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0a2b2-6eaf-4a46-850e-811e3c9b786d admin admin] REQUEST_METHOD: `PUT` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:47.870082 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0a2b2-6eaf-4a46-850e-811e3c9b786d admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:47.870570 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0a2b2-6eaf-4a46-850e-811e3c9b786d admin admin] PATH_INFO: `/v3/projects/cd7097254e0d484094eedd5fd7ba3b15/users/9a4e8c8d64734917be1ecd47c2d0e780/roles/6c54f239944d46e3b027ccce97eb8b49` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:47.921671 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b0a2b2-6eaf-4a46-850e-811e3c9b786d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd7097254e0d484094eedd5fd7ba3b15, user_id=9a4e8c8d64734917be1ecd47c2d0e780, role_id=6c54f239944d46e3b027ccce97eb8b49)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:47.921671 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b0a2b2-6eaf-4a46-850e-811e3c9b786d admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:48.004961 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 819/1651] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:25:47 2021] PUT /identity/v3/projects/cd7097254e0d484094eedd5fd7ba3b15/users/9a4e8c8d64734917be1ecd47c2d0e780/roles/6c54f239944d46e3b027ccce97eb8b49 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 18:25:48.008730 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b785ff74-3a84-40a8-97be-742f7aa2ddc8 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:48.023373 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b785ff74-3a84-40a8-97be-742f7aa2ddc8 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:48.086169 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b0a2b2-6eaf-4a46-850e-811e3c9b786d admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:48.088011 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-c3b0a2b2-6eaf-4a46-850e-811e3c9b786d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:48.168919 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32439c6d-ee74-4213-9d83-9671de8abbbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:48.173275 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32439c6d-ee74-4213-9d83-9671de8abbbb admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:48.173275 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32439c6d-ee74-4213-9d83-9671de8abbbb admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:48.173275 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32439c6d-ee74-4213-9d83-9671de8abbbb admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:48.173275 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32439c6d-ee74-4213-9d83-9671de8abbbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:48.179761 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32439c6d-ee74-4213-9d83-9671de8abbbb admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:48.203999 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 833/1652] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:25:48 2021] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:25:48.208890 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32439c6d-ee74-4213-9d83-9671de8abbbb admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:48.222255 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32439c6d-ee74-4213-9d83-9671de8abbbb admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:48.236623 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bc1128-f624-45e2-b72c-7af6d66ad25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:48.237827 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc1128-f624-45e2-b72c-7af6d66ad25c admin admin] REQUEST_METHOD: `PUT` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:48.238351 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc1128-f624-45e2-b72c-7af6d66ad25c admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:48.239417 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc1128-f624-45e2-b72c-7af6d66ad25c admin admin] PATH_INFO: `/v3/projects/cd7097254e0d484094eedd5fd7ba3b15/users/9a4e8c8d64734917be1ecd47c2d0e780/roles/6c54f239944d46e3b027ccce97eb8b49` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:48.242584 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bc1128-f624-45e2-b72c-7af6d66ad25c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd7097254e0d484094eedd5fd7ba3b15, user_id=9a4e8c8d64734917be1ecd47c2d0e780, role_id=6c54f239944d46e3b027ccce97eb8b49)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:48.246107 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bc1128-f624-45e2-b72c-7af6d66ad25c admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:48.277304 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 834/1653] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:25:48 2021] PUT /identity/v3/projects/cd7097254e0d484094eedd5fd7ba3b15/users/9a4e8c8d64734917be1ecd47c2d0e780/roles/6c54f239944d46e3b027ccce97eb8b49 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:25:48.338789 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b0a2b2-6eaf-4a46-850e-811e3c9b786d admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:48.341611 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d4e4b-31e9-421a-aaf6-d2d7324657b0 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:48.345126 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d4e4b-31e9-421a-aaf6-d2d7324657b0 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:48.345126 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d4e4b-31e9-421a-aaf6-d2d7324657b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:48.373451 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-947d4e4b-31e9-421a-aaf6-d2d7324657b0 None None] MFA Rules not processed for user `9a4e8c8d64734917be1ecd47c2d0e780`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:25:48.374917 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-947d4e4b-31e9-421a-aaf6-d2d7324657b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:48.478103 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 835/1654] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:25:48 2021] POST /identity/v3/auth/tokens => generated 3454 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:25:48.492463 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947d4e4b-31e9-421a-aaf6-d2d7324657b0 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:48.494707 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-947d4e4b-31e9-421a-aaf6-d2d7324657b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:48.544614 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42d7993-c20d-446e-8f45-8309d742ab60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:48.544614 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d7993-c20d-446e-8f45-8309d742ab60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:48.544614 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d7993-c20d-446e-8f45-8309d742ab60 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:48.544614 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d7993-c20d-446e-8f45-8309d742ab60 admin admin] PATH_INFO: `/v3/projects/11257010d54549a98c2a8e6c91860717` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:48.547472 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42d7993-c20d-446e-8f45-8309d742ab60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11257010d54549a98c2a8e6c91860717)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:48.549523 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42d7993-c20d-446e-8f45-8309d742ab60 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:48.603234 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947d4e4b-31e9-421a-aaf6-d2d7324657b0 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:48.607987 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12ed401-2bce-412b-b73c-b418327ef777 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6966ce0774f4437a9b688494e9d0574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:48.610097 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ed401-2bce-412b-b73c-b418327ef777 service cinder] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:48.610097 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ed401-2bce-412b-b73c-b418327ef777 service cinder] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:48.610097 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ed401-2bce-412b-b73c-b418327ef777 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:48.623583 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12ed401-2bce-412b-b73c-b418327ef777 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:48.625350 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12ed401-2bce-412b-b73c-b418327ef777 service cinder] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:48.649894 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 836/1655] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:25:48 2021] GET /identity/v3/auth/tokens => generated 3454 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 18:25:48.656174 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c5b48-6111-44b5-ac16-249f8297fd60 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:48.656174 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c5b48-6111-44b5-ac16-249f8297fd60 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:48.656174 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c5b48-6111-44b5-ac16-249f8297fd60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:48.674808 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-c42d7993-c20d-446e-8f45-8309d742ab60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11257010d54549a98c2a8e6c91860717', 'request_id': 'req-c42d7993-c20d-446e-8f45-8309d742ab60'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:48.694328 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-ed0c5b48-6111-44b5-ac16-249f8297fd60 None None] MFA Rules not processed for user `74acf90c734149808a501de7754b5943`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:25:48.695771 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-ed0c5b48-6111-44b5-ac16-249f8297fd60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:48.753888 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-c42d7993-c20d-446e-8f45-8309d742ab60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11257010d54549a98c2a8e6c91860717', 'request_id': 'req-c42d7993-c20d-446e-8f45-8309d742ab60'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:48.758208 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-c42d7993-c20d-446e-8f45-8309d742ab60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11257010d54549a98c2a8e6c91860717', 'request_id': 'req-c42d7993-c20d-446e-8f45-8309d742ab60'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:48.770306 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-c42d7993-c20d-446e-8f45-8309d742ab60 admin admin] The token cache is being invalidate because project 11257010d54549a98c2a8e6c91860717 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:25:48.770606 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-c42d7993-c20d-446e-8f45-8309d742ab60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:48.771344 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-c42d7993-c20d-446e-8f45-8309d742ab60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:48.777333 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 820/1656] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:25:48 2021] DELETE /identity/v3/projects/11257010d54549a98c2a8e6c91860717 => generated 0 bytes in 688 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:25:48.778382 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42d7993-c20d-446e-8f45-8309d742ab60 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:48.779987 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-c42d7993-c20d-446e-8f45-8309d742ab60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:48.793938 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 837/1657] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:25:48 2021] POST /identity/v3/auth/tokens => generated 3409 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:25:48.795952 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0c5b48-6111-44b5-ac16-249f8297fd60 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:48.797890 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-ed0c5b48-6111-44b5-ac16-249f8297fd60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:48.884124 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42d7993-c20d-446e-8f45-8309d742ab60 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:48.895486 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b191e28-513d-4e32-8d98-714c114f8f7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6966ce0774f4437a9b688494e9d0574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:48.896059 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b191e28-513d-4e32-8d98-714c114f8f7c service cinder] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:48.896344 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b191e28-513d-4e32-8d98-714c114f8f7c service cinder] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:48.896649 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b191e28-513d-4e32-8d98-714c114f8f7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:48.901425 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-4b191e28-513d-4e32-8d98-714c114f8f7c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:48.952820 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0c5b48-6111-44b5-ac16-249f8297fd60 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:48.970136 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525f752c-aa4c-47c1-8db9-6ad24c9d7f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:48.973273 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525f752c-aa4c-47c1-8db9-6ad24c9d7f83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:48.974090 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525f752c-aa4c-47c1-8db9-6ad24c9d7f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:48.974385 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525f752c-aa4c-47c1-8db9-6ad24c9d7f83 admin admin] PATH_INFO: `/v3/users/f3e2687dc9654715886e011e0ce1c331` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:48.979722 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525f752c-aa4c-47c1-8db9-6ad24c9d7f83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3e2687dc9654715886e011e0ce1c331)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:48.983015 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525f752c-aa4c-47c1-8db9-6ad24c9d7f83 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:49.058497 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b191e28-513d-4e32-8d98-714c114f8f7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:49.060216 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b191e28-513d-4e32-8d98-714c114f8f7c service cinder] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:49.107142 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 821/1658] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:25:48 2021] GET /identity/v3/auth/tokens => generated 3387 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:25:49.108561 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1896cbff-ecfd-4600-9e5d-15d6408bf7af None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:49.110109 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1896cbff-ecfd-4600-9e5d-15d6408bf7af None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:49.110404 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1896cbff-ecfd-4600-9e5d-15d6408bf7af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:49.165696 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-1896cbff-ecfd-4600-9e5d-15d6408bf7af None None] MFA Rules not processed for user `835bbb43ae5f48bfa14b22cb0a47cb4e`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:25:49.167038 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-1896cbff-ecfd-4600-9e5d-15d6408bf7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:49.173680 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-525f752c-aa4c-47c1-8db9-6ad24c9d7f83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3e2687dc9654715886e011e0ce1c331'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:49.174277 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-525f752c-aa4c-47c1-8db9-6ad24c9d7f83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3e2687dc9654715886e011e0ce1c331'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:49.236200 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-525f752c-aa4c-47c1-8db9-6ad24c9d7f83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3e2687dc9654715886e011e0ce1c331'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:49.236200 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-525f752c-aa4c-47c1-8db9-6ad24c9d7f83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3e2687dc9654715886e011e0ce1c331'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:49.236200 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-525f752c-aa4c-47c1-8db9-6ad24c9d7f83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3e2687dc9654715886e011e0ce1c331'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:49.376455 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 822/1659] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:25:49 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:25:49.550679 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 838/1660] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:25:48 2021] DELETE /identity/v3/users/f3e2687dc9654715886e011e0ce1c331 => generated 0 bytes in 755 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:25:49.856797 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae28595-de8e-4a2a-a862-4a890a69f8aa None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:49.856797 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae28595-de8e-4a2a-a862-4a890a69f8aa None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:49.856797 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae28595-de8e-4a2a-a862-4a890a69f8aa None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:49.859637 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 823/1661] 10.222.0.18 () {54 vars in 912 bytes} [Tue Oct 12 18:25:49 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:25:49.866961 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807baffb-26cb-4a50-9a59-78d5cc21a3b2 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:49.868159 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807baffb-26cb-4a50-9a59-78d5cc21a3b2 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:49.868760 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807baffb-26cb-4a50-9a59-78d5cc21a3b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:49.892007 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-807baffb-26cb-4a50-9a59-78d5cc21a3b2 None None] MFA Rules not processed for user `9a1ea6f47a7c41aba102ad481f5ad5c8`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:25:49.893545 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-807baffb-26cb-4a50-9a59-78d5cc21a3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:50.004558 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 839/1662] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Oct 12 18:25:49 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:25:50.033647 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae28595-de8e-4a2a-a862-4a890a69f8aa None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:50.035774 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-7ae28595-de8e-4a2a-a862-4a890a69f8aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:50.055238 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae28595-de8e-4a2a-a862-4a890a69f8aa None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:50.061662 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35783f48-5533-4d38-8a40-6d859f69fd24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:50.062633 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35783f48-5533-4d38-8a40-6d859f69fd24 service neutron] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:50.062937 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35783f48-5533-4d38-8a40-6d859f69fd24 service neutron] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:50.063283 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35783f48-5533-4d38-8a40-6d859f69fd24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:50.073931 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35783f48-5533-4d38-8a40-6d859f69fd24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:50.075911 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35783f48-5533-4d38-8a40-6d859f69fd24 service neutron] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:50.087266 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 824/1663] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:25:50 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:25:50.694675 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807baffb-26cb-4a50-9a59-78d5cc21a3b2 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:50.696237 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-807baffb-26cb-4a50-9a59-78d5cc21a3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:50.787201 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807baffb-26cb-4a50-9a59-78d5cc21a3b2 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:50.792765 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcb74f9-4950-433f-bc1e-e996d5ee34fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:50.794023 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb74f9-4950-433f-bc1e-e996d5ee34fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:50.794381 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb74f9-4950-433f-bc1e-e996d5ee34fa admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:50.794777 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb74f9-4950-433f-bc1e-e996d5ee34fa admin admin] PATH_INFO: `/v3/projects/2b165876393841e1b8a0178f5e0cf9d1` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:50.796151 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcb74f9-4950-433f-bc1e-e996d5ee34fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b165876393841e1b8a0178f5e0cf9d1)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:50.798527 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcb74f9-4950-433f-bc1e-e996d5ee34fa admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:51.014233 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-8bcb74f9-4950-433f-bc1e-e996d5ee34fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b165876393841e1b8a0178f5e0cf9d1', 'request_id': 'req-8bcb74f9-4950-433f-bc1e-e996d5ee34fa'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:51.021734 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-8bcb74f9-4950-433f-bc1e-e996d5ee34fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b165876393841e1b8a0178f5e0cf9d1', 'request_id': 'req-8bcb74f9-4950-433f-bc1e-e996d5ee34fa'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:51.032567 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-8bcb74f9-4950-433f-bc1e-e996d5ee34fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b165876393841e1b8a0178f5e0cf9d1', 'request_id': 'req-8bcb74f9-4950-433f-bc1e-e996d5ee34fa'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:51.586198 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-8bcb74f9-4950-433f-bc1e-e996d5ee34fa admin admin] The token cache is being invalidate because project 2b165876393841e1b8a0178f5e0cf9d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74005) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:25:51.588159 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-8bcb74f9-4950-433f-bc1e-e996d5ee34fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:51.592782 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-8bcb74f9-4950-433f-bc1e-e996d5ee34fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:51.595021 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 840/1664] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:25:50 2021] DELETE /identity/v3/projects/2b165876393841e1b8a0178f5e0cf9d1 => generated 0 bytes in 901 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:25:51.601233 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84269164-f42c-4367-b0bc-d53123147d23 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:51.601680 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84269164-f42c-4367-b0bc-d53123147d23 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:51.601783 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84269164-f42c-4367-b0bc-d53123147d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:51.664785 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-84269164-f42c-4367-b0bc-d53123147d23 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:25:51.664785 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-84269164-f42c-4367-b0bc-d53123147d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:51.773702 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcb74f9-4950-433f-bc1e-e996d5ee34fa admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:51.775798 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-8bcb74f9-4950-433f-bc1e-e996d5ee34fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:51.846499 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 825/1665] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:25:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:25:51.860043 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cea0bb-6208-48ba-9182-77fa23de61ce None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:51.860704 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cea0bb-6208-48ba-9182-77fa23de61ce None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:51.861173 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cea0bb-6208-48ba-9182-77fa23de61ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:51.890987 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-03cea0bb-6208-48ba-9182-77fa23de61ce None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:25:51.893007 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-03cea0bb-6208-48ba-9182-77fa23de61ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:51.943823 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 826/1666] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:25:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:25:51.943823 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cea0bb-6208-48ba-9182-77fa23de61ce None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:51.944493 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcb74f9-4950-433f-bc1e-e996d5ee34fa admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:51.944878 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cea0bb-6208-48ba-9182-77fa23de61ce None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:51.945148 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cbac06-fc85-45be-a399-312af2b0c2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:51.945148 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cbac06-fc85-45be-a399-312af2b0c2cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:51.945148 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cbac06-fc85-45be-a399-312af2b0c2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:51.945148 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cbac06-fc85-45be-a399-312af2b0c2cb admin admin] PATH_INFO: `/v3/users/da3fa02babfb4f0fa23376cbd6782519` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:51.945609 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cbac06-fc85-45be-a399-312af2b0c2cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=da3fa02babfb4f0fa23376cbd6782519)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:51.945609 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cbac06-fc85-45be-a399-312af2b0c2cb admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:51.949102 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d5f3e4-1898-42da-b00a-4b856f1f25a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:51.950648 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5f3e4-1898-42da-b00a-4b856f1f25a1 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:51.950648 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5f3e4-1898-42da-b00a-4b856f1f25a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:51.951054 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5f3e4-1898-42da-b00a-4b856f1f25a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:51.952339 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d5f3e4-1898-42da-b00a-4b856f1f25a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:25:51.952995 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d5f3e4-1898-42da-b00a-4b856f1f25a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:51.955525 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d5f3e4-1898-42da-b00a-4b856f1f25a1 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:51.972962 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 827/1667] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 12 18:25:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:25:51.979902 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d5f3e4-1898-42da-b00a-4b856f1f25a1 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:51.998171 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d5f3e4-1898-42da-b00a-4b856f1f25a1 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:52.003159 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6de76d-3949-4f6d-83c8-5e3cccd9fef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:52.004108 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6de76d-3949-4f6d-83c8-5e3cccd9fef3 admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:52.004530 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6de76d-3949-4f6d-83c8-5e3cccd9fef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:52.005018 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6de76d-3949-4f6d-83c8-5e3cccd9fef3 admin admin] PATH_INFO: `/v3/projects` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:52.005860 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6de76d-3949-4f6d-83c8-5e3cccd9fef3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:52.009506 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6de76d-3949-4f6d-83c8-5e3cccd9fef3 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:52.112501 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 828/1668] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:25:51 2021] POST /identity/v3/projects => generated 379 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:25:52.114607 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6de76d-3949-4f6d-83c8-5e3cccd9fef3 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:52.150173 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-63cbac06-fc85-45be-a399-312af2b0c2cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da3fa02babfb4f0fa23376cbd6782519'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:52.151472 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-63cbac06-fc85-45be-a399-312af2b0c2cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da3fa02babfb4f0fa23376cbd6782519'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:52.175931 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-63cbac06-fc85-45be-a399-312af2b0c2cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da3fa02babfb4f0fa23376cbd6782519'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:52.185080 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-63cbac06-fc85-45be-a399-312af2b0c2cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da3fa02babfb4f0fa23376cbd6782519'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:52.201981 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-63cbac06-fc85-45be-a399-312af2b0c2cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da3fa02babfb4f0fa23376cbd6782519'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:52.240366 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6de76d-3949-4f6d-83c8-5e3cccd9fef3 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:52.240366 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dacc970-aeb6-487a-b1bf-df4b60ad9c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:52.240366 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dacc970-aeb6-487a-b1bf-df4b60ad9c82 admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:52.240876 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dacc970-aeb6-487a-b1bf-df4b60ad9c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:52.240978 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dacc970-aeb6-487a-b1bf-df4b60ad9c82 admin admin] PATH_INFO: `/v3/users` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:52.241651 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dacc970-aeb6-487a-b1bf-df4b60ad9c82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:52.243727 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dacc970-aeb6-487a-b1bf-df4b60ad9c82 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:52.451533 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 841/1669] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:25:51 2021] DELETE /identity/v3/users/da3fa02babfb4f0fa23376cbd6782519 => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 18:25:52.453219 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da814a1-fa84-49dc-a607-1261801249c8 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:52.453474 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da814a1-fa84-49dc-a607-1261801249c8 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:52.453903 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da814a1-fa84-49dc-a607-1261801249c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:52.479249 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-6da814a1-fa84-49dc-a607-1261801249c8 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:25:52.485206 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-6da814a1-fa84-49dc-a607-1261801249c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:52.528622 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 829/1670] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:25:52 2021] POST /identity/v3/users => generated 290 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:25:52.533539 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dacc970-aeb6-487a-b1bf-df4b60ad9c82 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:52.539825 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-7dacc970-aeb6-487a-b1bf-df4b60ad9c82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:52.593416 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dacc970-aeb6-487a-b1bf-df4b60ad9c82 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:52.598704 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 842/1671] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:25:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:25:52.618433 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637ca3ca-6a07-421c-b848-95693176d23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:52.619142 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637ca3ca-6a07-421c-b848-95693176d23a admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:52.619466 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637ca3ca-6a07-421c-b848-95693176d23a admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:52.619747 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637ca3ca-6a07-421c-b848-95693176d23a admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:52.620961 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637ca3ca-6a07-421c-b848-95693176d23a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:52.623855 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da814a1-fa84-49dc-a607-1261801249c8 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:52.626114 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-6da814a1-fa84-49dc-a607-1261801249c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:52.636526 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637ca3ca-6a07-421c-b848-95693176d23a admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:52.657947 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 830/1672] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:25:52 2021] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:25:52.658926 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637ca3ca-6a07-421c-b848-95693176d23a admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:52.670908 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637ca3ca-6a07-421c-b848-95693176d23a admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:52.680693 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fc81ad-e7eb-43eb-a18a-d6d0e74fa950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:52.685371 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc81ad-e7eb-43eb-a18a-d6d0e74fa950 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:52.685371 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc81ad-e7eb-43eb-a18a-d6d0e74fa950 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:52.685371 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc81ad-e7eb-43eb-a18a-d6d0e74fa950 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:52.685371 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fc81ad-e7eb-43eb-a18a-d6d0e74fa950 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:52.685371 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fc81ad-e7eb-43eb-a18a-d6d0e74fa950 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:52.702370 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 831/1673] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:25:52 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:25:52.707334 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fc81ad-e7eb-43eb-a18a-d6d0e74fa950 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:52.721067 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fc81ad-e7eb-43eb-a18a-d6d0e74fa950 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:52.737277 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3c0913-29e0-42e1-80c5-da9bb02c80dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:52.738199 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c0913-29e0-42e1-80c5-da9bb02c80dc admin admin] REQUEST_METHOD: `PUT` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:52.753159 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c0913-29e0-42e1-80c5-da9bb02c80dc admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:52.753159 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c0913-29e0-42e1-80c5-da9bb02c80dc admin admin] PATH_INFO: `/v3/projects/4e7818666d9a4c1080117d4a7eca7a7e/users/02da70eee29c4c24bfa5570a53b413cd/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:52.772660 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3c0913-29e0-42e1-80c5-da9bb02c80dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e7818666d9a4c1080117d4a7eca7a7e, user_id=02da70eee29c4c24bfa5570a53b413cd, role_id=33b8a5a8d1d643f2a98f598e6ab0a1cf)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:52.776034 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3c0913-29e0-42e1-80c5-da9bb02c80dc admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:52.789246 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da814a1-fa84-49dc-a607-1261801249c8 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:52.794459 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264e2e5f-2961-4012-9a12-be4c029c2028 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:52.795393 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e2e5f-2961-4012-9a12-be4c029c2028 service neutron] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:52.795839 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e2e5f-2961-4012-9a12-be4c029c2028 service neutron] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:52.796278 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e2e5f-2961-4012-9a12-be4c029c2028 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:52.811605 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264e2e5f-2961-4012-9a12-be4c029c2028 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:52.813137 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264e2e5f-2961-4012-9a12-be4c029c2028 service neutron] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:52.846424 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 843/1674] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:25:52 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:25:53.111558 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 832/1675] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:25:52 2021] PUT /identity/v3/projects/4e7818666d9a4c1080117d4a7eca7a7e/users/02da70eee29c4c24bfa5570a53b413cd/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:25:53.123271 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00295e2e-3a10-461a-b2a0-ab46b08392a8 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:53.123555 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00295e2e-3a10-461a-b2a0-ab46b08392a8 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:53.123837 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00295e2e-3a10-461a-b2a0-ab46b08392a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:53.174281 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-00295e2e-3a10-461a-b2a0-ab46b08392a8 None None] MFA Rules not processed for user `02da70eee29c4c24bfa5570a53b413cd`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:25:53.175399 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-00295e2e-3a10-461a-b2a0-ab46b08392a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:53.354033 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 844/1676] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:25:53 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:25:53.354412 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3c0913-29e0-42e1-80c5-da9bb02c80dc admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:53.493825 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3c0913-29e0-42e1-80c5-da9bb02c80dc admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:53.493825 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8a0b2d-36d0-4a13-ba64-b0036a74bbc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:53.493825 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a0b2d-36d0-4a13-ba64-b0036a74bbc5 admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:53.493825 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a0b2d-36d0-4a13-ba64-b0036a74bbc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:53.500866 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a0b2d-36d0-4a13-ba64-b0036a74bbc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:53.500866 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8a0b2d-36d0-4a13-ba64-b0036a74bbc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:53.500866 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8a0b2d-36d0-4a13-ba64-b0036a74bbc5 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:53.521171 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00295e2e-3a10-461a-b2a0-ab46b08392a8 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:53.522750 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-00295e2e-3a10-461a-b2a0-ab46b08392a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:53.537296 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00295e2e-3a10-461a-b2a0-ab46b08392a8 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:53.542728 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b330f70a-786e-466d-9c32-edf87f55aad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:53.544030 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b330f70a-786e-466d-9c32-edf87f55aad5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:53.544301 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b330f70a-786e-466d-9c32-edf87f55aad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:53.544661 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b330f70a-786e-466d-9c32-edf87f55aad5 admin admin] PATH_INFO: `/v3/users/1f761babee1a4a9ea7dc0deb5eb9db79` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:53.546049 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b330f70a-786e-466d-9c32-edf87f55aad5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f761babee1a4a9ea7dc0deb5eb9db79)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:53.548017 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b330f70a-786e-466d-9c32-edf87f55aad5 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:53.733308 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 833/1677] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:25:53 2021] POST /identity/v3/projects => generated 379 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:25:53.735418 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8a0b2d-36d0-4a13-ba64-b0036a74bbc5 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:53.737797 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-bc8a0b2d-36d0-4a13-ba64-b0036a74bbc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:53.808639 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-b330f70a-786e-466d-9c32-edf87f55aad5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f761babee1a4a9ea7dc0deb5eb9db79'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:53.809309 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-b330f70a-786e-466d-9c32-edf87f55aad5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f761babee1a4a9ea7dc0deb5eb9db79'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:53.825606 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-b330f70a-786e-466d-9c32-edf87f55aad5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f761babee1a4a9ea7dc0deb5eb9db79'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:53.826510 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-b330f70a-786e-466d-9c32-edf87f55aad5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f761babee1a4a9ea7dc0deb5eb9db79'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:53.835302 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-b330f70a-786e-466d-9c32-edf87f55aad5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f761babee1a4a9ea7dc0deb5eb9db79'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:53.894863 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8a0b2d-36d0-4a13-ba64-b0036a74bbc5 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:53.900832 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bec885-f163-4456-854a-938815ee0d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:53.901740 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bec885-f163-4456-854a-938815ee0d68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:53.902025 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bec885-f163-4456-854a-938815ee0d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:53.902305 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bec885-f163-4456-854a-938815ee0d68 admin admin] PATH_INFO: `/v3/projects/e27b9516947040f79544fc7b3b9f847a` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:53.903661 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bec885-f163-4456-854a-938815ee0d68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e27b9516947040f79544fc7b3b9f847a)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:53.905637 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bec885-f163-4456-854a-938815ee0d68 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:54.064551 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 845/1678] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:25:53 2021] DELETE /identity/v3/users/1f761babee1a4a9ea7dc0deb5eb9db79 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 18:25:54.066118 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b330f70a-786e-466d-9c32-edf87f55aad5 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:54.068852 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-b330f70a-786e-466d-9c32-edf87f55aad5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:54.167841 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b330f70a-786e-466d-9c32-edf87f55aad5 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:54.172755 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21934ee-b277-4b00-a682-ef6614eb1c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:54.173462 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21934ee-b277-4b00-a682-ef6614eb1c9e admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:54.173757 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21934ee-b277-4b00-a682-ef6614eb1c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:54.174033 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21934ee-b277-4b00-a682-ef6614eb1c9e admin admin] PATH_INFO: `/v3/users` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:54.174859 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21934ee-b277-4b00-a682-ef6614eb1c9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:54.176924 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21934ee-b277-4b00-a682-ef6614eb1c9e admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:54.320252 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-77bec885-f163-4456-854a-938815ee0d68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e27b9516947040f79544fc7b3b9f847a', 'request_id': 'req-77bec885-f163-4456-854a-938815ee0d68'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:54.481136 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 846/1679] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:25:54 2021] POST /identity/v3/users => generated 296 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:25:54.488506 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd732ce-70ab-474c-b3e3-221631b2a887 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:54.488506 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd732ce-70ab-474c-b3e3-221631b2a887 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:54.488506 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd732ce-70ab-474c-b3e3-221631b2a887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:54.497541 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-77bec885-f163-4456-854a-938815ee0d68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e27b9516947040f79544fc7b3b9f847a', 'request_id': 'req-77bec885-f163-4456-854a-938815ee0d68'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:54.503294 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-ecd732ce-70ab-474c-b3e3-221631b2a887 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:25:54.505426 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-77bec885-f163-4456-854a-938815ee0d68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e27b9516947040f79544fc7b3b9f847a', 'request_id': 'req-77bec885-f163-4456-854a-938815ee0d68'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:54.505560 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-ecd732ce-70ab-474c-b3e3-221631b2a887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:54.519983 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-77bec885-f163-4456-854a-938815ee0d68 admin admin] The token cache is being invalidate because project e27b9516947040f79544fc7b3b9f847a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:25:54.520978 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-77bec885-f163-4456-854a-938815ee0d68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:54.521738 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-77bec885-f163-4456-854a-938815ee0d68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:54.527997 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 834/1680] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:25:53 2021] DELETE /identity/v3/projects/e27b9516947040f79544fc7b3b9f847a => generated 0 bytes in 789 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:25:54.529028 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bec885-f163-4456-854a-938815ee0d68 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:54.530463 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-77bec885-f163-4456-854a-938815ee0d68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:54.588573 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 847/1681] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:25:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:25:54.588573 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b753438-0481-4a7d-945b-bdb8f3068ed8 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:54.588573 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b753438-0481-4a7d-945b-bdb8f3068ed8 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:54.588573 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b753438-0481-4a7d-945b-bdb8f3068ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:54.632968 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bec885-f163-4456-854a-938815ee0d68 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:54.638409 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273fd66c-9f7a-4272-ade2-ab6972886779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:54.639528 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273fd66c-9f7a-4272-ade2-ab6972886779 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:54.639706 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-7b753438-0481-4a7d-945b-bdb8f3068ed8 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:25:54.640010 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273fd66c-9f7a-4272-ade2-ab6972886779 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:54.640386 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273fd66c-9f7a-4272-ade2-ab6972886779 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:54.641028 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-7b753438-0481-4a7d-945b-bdb8f3068ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:54.641536 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273fd66c-9f7a-4272-ade2-ab6972886779 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:54.643288 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273fd66c-9f7a-4272-ade2-ab6972886779 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:54.653457 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 848/1682] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:25:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:25:54.654726 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b753438-0481-4a7d-945b-bdb8f3068ed8 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:54.655802 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-7b753438-0481-4a7d-945b-bdb8f3068ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:54.664708 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 835/1683] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:25:54 2021] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:25:54.666303 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0046d40d-5dcf-4e61-b6b7-9b3aa4dc8b30 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:54.667228 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0046d40d-5dcf-4e61-b6b7-9b3aa4dc8b30 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:54.667633 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0046d40d-5dcf-4e61-b6b7-9b3aa4dc8b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:54.694115 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-0046d40d-5dcf-4e61-b6b7-9b3aa4dc8b30 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:25:54.695442 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-0046d40d-5dcf-4e61-b6b7-9b3aa4dc8b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:54.709771 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 836/1684] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:25:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:25:54.716816 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0046d40d-5dcf-4e61-b6b7-9b3aa4dc8b30 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:54.720869 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0046d40d-5dcf-4e61-b6b7-9b3aa4dc8b30 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:54.729263 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57344fa-22d1-49ea-b251-5b7e0a1118fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:54.731001 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57344fa-22d1-49ea-b251-5b7e0a1118fd admin admin] REQUEST_METHOD: `PUT` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:54.731504 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57344fa-22d1-49ea-b251-5b7e0a1118fd admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:54.731616 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b753438-0481-4a7d-945b-bdb8f3068ed8 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:54.732093 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57344fa-22d1-49ea-b251-5b7e0a1118fd admin admin] PATH_INFO: `/v3/projects/083e19f6dba843879319b9bd255379d3/users/67a6967e1a814a37bc5ed625d5cd7741/roles/6c54f239944d46e3b027ccce97eb8b49` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:54.735673 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7efb4b8-3d60-4886-a080-3d003e8f4033 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:54.736440 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7efb4b8-3d60-4886-a080-3d003e8f4033 service neutron] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:54.737297 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7efb4b8-3d60-4886-a080-3d003e8f4033 service neutron] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:54.737297 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7efb4b8-3d60-4886-a080-3d003e8f4033 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:54.747862 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7efb4b8-3d60-4886-a080-3d003e8f4033 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:54.749348 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7efb4b8-3d60-4886-a080-3d003e8f4033 service neutron] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:54.750825 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57344fa-22d1-49ea-b251-5b7e0a1118fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=083e19f6dba843879319b9bd255379d3, user_id=67a6967e1a814a37bc5ed625d5cd7741, role_id=6c54f239944d46e3b027ccce97eb8b49)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:54.754298 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57344fa-22d1-49ea-b251-5b7e0a1118fd admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:54.762622 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 849/1685] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:25:54 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:25:54.762622 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7efb4b8-3d60-4886-a080-3d003e8f4033 service neutron] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:54.783833 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7efb4b8-3d60-4886-a080-3d003e8f4033 service neutron] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:54.789173 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c66b06f-9865-4347-89f6-8034f4729b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:54.794360 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66b06f-9865-4347-89f6-8034f4729b44 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:54.794360 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66b06f-9865-4347-89f6-8034f4729b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:54.794360 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66b06f-9865-4347-89f6-8034f4729b44 admin admin] PATH_INFO: `/v3/domains` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:54.794360 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c66b06f-9865-4347-89f6-8034f4729b44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:25:54.794360 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c66b06f-9865-4347-89f6-8034f4729b44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:54.794360 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c66b06f-9865-4347-89f6-8034f4729b44 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:54.806974 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 850/1686] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 12 18:25:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:25:54.811282 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c66b06f-9865-4347-89f6-8034f4729b44 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:54.825938 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c66b06f-9865-4347-89f6-8034f4729b44 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:54.827348 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96fb47d-83fd-495a-8b30-09c23fa3abbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:54.828022 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96fb47d-83fd-495a-8b30-09c23fa3abbf admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:54.828381 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96fb47d-83fd-495a-8b30-09c23fa3abbf admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:54.828705 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96fb47d-83fd-495a-8b30-09c23fa3abbf admin admin] PATH_INFO: `/v3/projects` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:54.829483 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96fb47d-83fd-495a-8b30-09c23fa3abbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:54.831932 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96fb47d-83fd-495a-8b30-09c23fa3abbf admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:54.875704 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 837/1687] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:25:54 2021] PUT /identity/v3/projects/083e19f6dba843879319b9bd255379d3/users/67a6967e1a814a37bc5ed625d5cd7741/roles/6c54f239944d46e3b027ccce97eb8b49 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:25:54.880778 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57344fa-22d1-49ea-b251-5b7e0a1118fd admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:54.962132 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57344fa-22d1-49ea-b251-5b7e0a1118fd admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:54.967167 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde7d162-1dd7-4c01-b1bf-791672b9ba21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:54.968171 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde7d162-1dd7-4c01-b1bf-791672b9ba21 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:54.968467 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde7d162-1dd7-4c01-b1bf-791672b9ba21 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:54.968774 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde7d162-1dd7-4c01-b1bf-791672b9ba21 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:54.969481 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde7d162-1dd7-4c01-b1bf-791672b9ba21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:54.971296 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde7d162-1dd7-4c01-b1bf-791672b9ba21 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:54.983859 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 838/1688] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:25:54 2021] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:25:54.994886 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde7d162-1dd7-4c01-b1bf-791672b9ba21 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:55.022180 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 851/1689] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:25:54 2021] POST /identity/v3/projects => generated 381 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 18:25:55.024237 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96fb47d-83fd-495a-8b30-09c23fa3abbf admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:55.034351 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde7d162-1dd7-4c01-b1bf-791672b9ba21 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:55.143214 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96fb47d-83fd-495a-8b30-09c23fa3abbf admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:55.163847 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcee082-1d9d-4645-a1e6-6aed28f02446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:55.165129 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcee082-1d9d-4645-a1e6-6aed28f02446 admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:55.165624 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcee082-1d9d-4645-a1e6-6aed28f02446 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:55.166094 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcee082-1d9d-4645-a1e6-6aed28f02446 admin admin] PATH_INFO: `/v3/users` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:55.167491 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcee082-1d9d-4645-a1e6-6aed28f02446 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:55.180558 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bdc8b0-83c5-49f5-82cd-1f479d3071d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:55.181477 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bdc8b0-83c5-49f5-82cd-1f479d3071d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:55.181753 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bdc8b0-83c5-49f5-82cd-1f479d3071d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:55.182024 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bdc8b0-83c5-49f5-82cd-1f479d3071d4 admin admin] PATH_INFO: `/v3/projects/083e19f6dba843879319b9bd255379d3/users/67a6967e1a814a37bc5ed625d5cd7741/roles/6c54f239944d46e3b027ccce97eb8b49` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:55.191000 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bdc8b0-83c5-49f5-82cd-1f479d3071d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=083e19f6dba843879319b9bd255379d3, user_id=67a6967e1a814a37bc5ed625d5cd7741, role_id=6c54f239944d46e3b027ccce97eb8b49)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:55.193855 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bdc8b0-83c5-49f5-82cd-1f479d3071d4 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:55.198037 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcee082-1d9d-4645-a1e6-6aed28f02446 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:55.234280 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 839/1690] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:25:54 2021] PUT /identity/v3/projects/083e19f6dba843879319b9bd255379d3/users/67a6967e1a814a37bc5ed625d5cd7741/roles/6c54f239944d46e3b027ccce97eb8b49 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:25:55.244989 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d0f64-ad1e-4662-adce-01ff81c12768 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:55.245284 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d0f64-ad1e-4662-adce-01ff81c12768 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:55.245555 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d0f64-ad1e-4662-adce-01ff81c12768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:55.296089 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-ea5d0f64-ad1e-4662-adce-01ff81c12768 None None] MFA Rules not processed for user `67a6967e1a814a37bc5ed625d5cd7741`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:25:55.297605 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-ea5d0f64-ad1e-4662-adce-01ff81c12768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:55.415375 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 840/1691] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:25:55 2021] POST /identity/v3/auth/tokens => generated 3466 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:25:55.432246 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5d0f64-ad1e-4662-adce-01ff81c12768 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:55.433861 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-ea5d0f64-ad1e-4662-adce-01ff81c12768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:55.498347 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5d0f64-ad1e-4662-adce-01ff81c12768 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:55.502331 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037be0ba-a371-461c-81bd-4b7b9178f07e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6966ce0774f4437a9b688494e9d0574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:55.503515 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037be0ba-a371-461c-81bd-4b7b9178f07e service cinder] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:55.503515 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037be0ba-a371-461c-81bd-4b7b9178f07e service cinder] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:55.503722 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 852/1692] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:25:55 2021] POST /identity/v3/users => generated 291 bytes in 481 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:25:55.503828 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037be0ba-a371-461c-81bd-4b7b9178f07e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:55.507427 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcee082-1d9d-4645-a1e6-6aed28f02446 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:55.513867 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037be0ba-a371-461c-81bd-4b7b9178f07e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:55.515388 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037be0ba-a371-461c-81bd-4b7b9178f07e service cinder] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:55.517382 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcee082-1d9d-4645-a1e6-6aed28f02446 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:55.542989 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 841/1693] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:25:55 2021] GET /identity/v3/auth/tokens => generated 3466 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 18:25:55.561326 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037be0ba-a371-461c-81bd-4b7b9178f07e service cinder] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:55.563089 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-037be0ba-a371-461c-81bd-4b7b9178f07e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:55.632747 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ccb09-c23d-40b2-82ca-aa5c7079a18d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:55.632991 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ccb09-c23d-40b2-82ca-aa5c7079a18d admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:55.633289 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ccb09-c23d-40b2-82ca-aa5c7079a18d admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:55.633568 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ccb09-c23d-40b2-82ca-aa5c7079a18d admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:55.634324 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336ccb09-c23d-40b2-82ca-aa5c7079a18d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:55.636070 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336ccb09-c23d-40b2-82ca-aa5c7079a18d admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:55.653364 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 853/1694] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:25:55 2021] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 18:25:55.654759 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ccb09-c23d-40b2-82ca-aa5c7079a18d admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:55.667354 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ccb09-c23d-40b2-82ca-aa5c7079a18d admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:55.674761 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037be0ba-a371-461c-81bd-4b7b9178f07e service cinder] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:55.674882 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a4a958-54e8-4a53-ab57-b11854ab40b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:55.675499 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4a958-54e8-4a53-ab57-b11854ab40b3 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:55.675910 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4a958-54e8-4a53-ab57-b11854ab40b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:55.676410 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4a958-54e8-4a53-ab57-b11854ab40b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:55.677275 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a4a958-54e8-4a53-ab57-b11854ab40b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:55.680061 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a4a958-54e8-4a53-ab57-b11854ab40b3 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:55.681155 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35959135-b83b-46ab-941c-635fe01bf61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:55.682520 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35959135-b83b-46ab-941c-635fe01bf61b admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:55.683395 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35959135-b83b-46ab-941c-635fe01bf61b admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:55.683826 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35959135-b83b-46ab-941c-635fe01bf61b admin admin] PATH_INFO: `/v3/projects/7bb2dcb9d8864f24912572fd4757f9ac` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:55.686104 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35959135-b83b-46ab-941c-635fe01bf61b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bb2dcb9d8864f24912572fd4757f9ac)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:55.689840 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35959135-b83b-46ab-941c-635fe01bf61b admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:55.693202 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 854/1695] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:25:55 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:25:55.697634 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a4a958-54e8-4a53-ab57-b11854ab40b3 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:55.709473 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a4a958-54e8-4a53-ab57-b11854ab40b3 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:55.714357 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33cf242-0323-40e6-8431-4505e29faba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:55.715274 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33cf242-0323-40e6-8431-4505e29faba6 admin admin] REQUEST_METHOD: `PUT` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:55.715554 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33cf242-0323-40e6-8431-4505e29faba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:55.715826 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33cf242-0323-40e6-8431-4505e29faba6 admin admin] PATH_INFO: `/v3/projects/93688b321b6941d38ac96e6ba19680bb/users/3a15e66d878e40cdb2aa5727b220542f/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:55.738116 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33cf242-0323-40e6-8431-4505e29faba6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93688b321b6941d38ac96e6ba19680bb, user_id=3a15e66d878e40cdb2aa5727b220542f, role_id=33b8a5a8d1d643f2a98f598e6ab0a1cf)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:55.741114 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33cf242-0323-40e6-8431-4505e29faba6 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:56.030732 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 855/1696] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:25:55 2021] PUT /identity/v3/projects/93688b321b6941d38ac96e6ba19680bb/users/3a15e66d878e40cdb2aa5727b220542f/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 18:25:56.047043 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-35959135-b83b-46ab-941c-635fe01bf61b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bb2dcb9d8864f24912572fd4757f9ac', 'request_id': 'req-35959135-b83b-46ab-941c-635fe01bf61b'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:56.065898 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677cf6c0-4cae-4932-b8c4-e6121c4fc3fb None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:56.068882 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677cf6c0-4cae-4932-b8c4-e6121c4fc3fb None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:56.069357 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677cf6c0-4cae-4932-b8c4-e6121c4fc3fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:56.128657 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-677cf6c0-4cae-4932-b8c4-e6121c4fc3fb None None] MFA Rules not processed for user `3a15e66d878e40cdb2aa5727b220542f`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:25:56.134362 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-677cf6c0-4cae-4932-b8c4-e6121c4fc3fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:56.214037 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 856/1697] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:25:56 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:25:56.218649 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677cf6c0-4cae-4932-b8c4-e6121c4fc3fb None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:56.253927 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-35959135-b83b-46ab-941c-635fe01bf61b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bb2dcb9d8864f24912572fd4757f9ac', 'request_id': 'req-35959135-b83b-46ab-941c-635fe01bf61b'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:56.265170 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-35959135-b83b-46ab-941c-635fe01bf61b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bb2dcb9d8864f24912572fd4757f9ac', 'request_id': 'req-35959135-b83b-46ab-941c-635fe01bf61b'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:56.280627 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-35959135-b83b-46ab-941c-635fe01bf61b admin admin] The token cache is being invalidate because project 7bb2dcb9d8864f24912572fd4757f9ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:25:56.281321 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-35959135-b83b-46ab-941c-635fe01bf61b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:56.282363 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-35959135-b83b-46ab-941c-635fe01bf61b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:56.285186 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 842/1698] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:25:55 2021] DELETE /identity/v3/projects/7bb2dcb9d8864f24912572fd4757f9ac => generated 0 bytes in 724 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 18:25:56.292744 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf4666-84da-4ba9-af71-fd06b4d5bcc9 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:56.298111 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf4666-84da-4ba9-af71-fd06b4d5bcc9 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:56.298111 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf4666-84da-4ba9-af71-fd06b4d5bcc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:56.307201 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677cf6c0-4cae-4932-b8c4-e6121c4fc3fb None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:56.314356 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3be223-3735-4d09-bb9e-a0a30ce8e0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:56.315311 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3be223-3735-4d09-bb9e-a0a30ce8e0d8 admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:56.315493 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-66bf4666-84da-4ba9-af71-fd06b4d5bcc9 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:25:56.315948 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3be223-3735-4d09-bb9e-a0a30ce8e0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:56.316366 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3be223-3735-4d09-bb9e-a0a30ce8e0d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:56.317593 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-66bf4666-84da-4ba9-af71-fd06b4d5bcc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:56.318119 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3be223-3735-4d09-bb9e-a0a30ce8e0d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:56.320287 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3be223-3735-4d09-bb9e-a0a30ce8e0d8 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:56.327979 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 843/1699] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:25:56 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:25:56.337070 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ffbb58-47bd-4774-9b0f-e81532f653c5 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:56.337310 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ffbb58-47bd-4774-9b0f-e81532f653c5 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:56.337603 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ffbb58-47bd-4774-9b0f-e81532f653c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:56.357860 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-60ffbb58-47bd-4774-9b0f-e81532f653c5 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:25:56.359234 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-60ffbb58-47bd-4774-9b0f-e81532f653c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:56.367924 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 844/1700] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:25:56 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:25:56.372574 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ffbb58-47bd-4774-9b0f-e81532f653c5 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:56.389153 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ffbb58-47bd-4774-9b0f-e81532f653c5 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:56.394659 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74949157-30f4-4f1e-876e-4377ec0c1495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:56.395565 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74949157-30f4-4f1e-876e-4377ec0c1495 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:56.395670 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74949157-30f4-4f1e-876e-4377ec0c1495 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:56.395908 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74949157-30f4-4f1e-876e-4377ec0c1495 admin admin] PATH_INFO: `/v3/domains` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:56.396678 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74949157-30f4-4f1e-876e-4377ec0c1495 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:25:56.398333 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74949157-30f4-4f1e-876e-4377ec0c1495 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:56.398954 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74949157-30f4-4f1e-876e-4377ec0c1495 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:56.415393 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 845/1701] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 12 18:25:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:25:56.416335 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74949157-30f4-4f1e-876e-4377ec0c1495 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:56.427251 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74949157-30f4-4f1e-876e-4377ec0c1495 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:56.432696 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82efdf48-5d02-4849-af27-69cc46a531e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:56.433523 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82efdf48-5d02-4849-af27-69cc46a531e3 admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:56.433808 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82efdf48-5d02-4849-af27-69cc46a531e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:56.434164 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82efdf48-5d02-4849-af27-69cc46a531e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:56.434882 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82efdf48-5d02-4849-af27-69cc46a531e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:56.436890 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82efdf48-5d02-4849-af27-69cc46a531e3 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:56.575072 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 857/1702] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:25:56 2021] POST /identity/v3/projects => generated 381 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 18:25:56.582230 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3be223-3735-4d09-bb9e-a0a30ce8e0d8 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:56.586333 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-2e3be223-3735-4d09-bb9e-a0a30ce8e0d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:56.598030 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 846/1703] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:25:56 2021] POST /identity/v3/projects => generated 367 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:25:56.605670 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82efdf48-5d02-4849-af27-69cc46a531e3 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:56.702278 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82efdf48-5d02-4849-af27-69cc46a531e3 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:56.707797 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3274ebcf-a57b-42e0-9b6f-7ee35f1d0742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:56.708886 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3274ebcf-a57b-42e0-9b6f-7ee35f1d0742 admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:56.710005 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3274ebcf-a57b-42e0-9b6f-7ee35f1d0742 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:56.710587 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3274ebcf-a57b-42e0-9b6f-7ee35f1d0742 admin admin] PATH_INFO: `/v3/users` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:56.711467 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3274ebcf-a57b-42e0-9b6f-7ee35f1d0742 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:56.713921 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3274ebcf-a57b-42e0-9b6f-7ee35f1d0742 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:56.714547 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3be223-3735-4d09-bb9e-a0a30ce8e0d8 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:56.721187 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8754e1f9-6e7e-46db-b655-860ceb3dd2fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:56.722285 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754e1f9-6e7e-46db-b655-860ceb3dd2fe admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:56.722859 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754e1f9-6e7e-46db-b655-860ceb3dd2fe admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:56.723737 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754e1f9-6e7e-46db-b655-860ceb3dd2fe admin admin] PATH_INFO: `/v3/users` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:56.724643 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8754e1f9-6e7e-46db-b655-860ceb3dd2fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:56.727408 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8754e1f9-6e7e-46db-b655-860ceb3dd2fe admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:56.851197 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 847/1704] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:25:56 2021] POST /identity/v3/users => generated 284 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 18:25:56.854609 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 858/1705] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:25:56 2021] POST /identity/v3/users => generated 297 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 18:25:56.856763 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3274ebcf-a57b-42e0-9b6f-7ee35f1d0742 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:56.859331 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8754e1f9-6e7e-46db-b655-860ceb3dd2fe admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:56.867664 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3274ebcf-a57b-42e0-9b6f-7ee35f1d0742 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:56.877743 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a1c53-77ab-40a5-a1f7-d5c2e5e12718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:56.878537 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8754e1f9-6e7e-46db-b655-860ceb3dd2fe admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:56.878813 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a1c53-77ab-40a5-a1f7-d5c2e5e12718 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:56.879867 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a1c53-77ab-40a5-a1f7-d5c2e5e12718 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:56.880300 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a1c53-77ab-40a5-a1f7-d5c2e5e12718 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:56.881268 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42a1c53-77ab-40a5-a1f7-d5c2e5e12718 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:56.883086 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42a1c53-77ab-40a5-a1f7-d5c2e5e12718 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:56.885665 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1841ccd1-6a7b-413b-985f-369269a2cbde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:56.886638 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1841ccd1-6a7b-413b-985f-369269a2cbde admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:56.887082 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1841ccd1-6a7b-413b-985f-369269a2cbde admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:56.887511 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1841ccd1-6a7b-413b-985f-369269a2cbde admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:56.888843 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1841ccd1-6a7b-413b-985f-369269a2cbde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:56.891490 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1841ccd1-6a7b-413b-985f-369269a2cbde admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:56.897415 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 848/1706] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:25:56 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:25:56.903549 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a1c53-77ab-40a5-a1f7-d5c2e5e12718 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:56.915979 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 859/1707] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:25:56 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:25:56.921125 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a1c53-77ab-40a5-a1f7-d5c2e5e12718 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:56.922310 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1841ccd1-6a7b-413b-985f-369269a2cbde admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:56.926777 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a103d7b0-72d1-44cb-93cf-05d96d539d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:56.927567 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a103d7b0-72d1-44cb-93cf-05d96d539d57 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:56.927937 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a103d7b0-72d1-44cb-93cf-05d96d539d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:56.928317 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a103d7b0-72d1-44cb-93cf-05d96d539d57 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:56.929454 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a103d7b0-72d1-44cb-93cf-05d96d539d57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:56.930861 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a103d7b0-72d1-44cb-93cf-05d96d539d57 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:56.937157 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1841ccd1-6a7b-413b-985f-369269a2cbde admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:56.942254 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 849/1708] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:25:56 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 18:25:56.945389 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540c8d73-4dda-48e8-b97b-3657512ef8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:56.947346 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c8d73-4dda-48e8-b97b-3657512ef8d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:56.947804 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c8d73-4dda-48e8-b97b-3657512ef8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:56.947946 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a103d7b0-72d1-44cb-93cf-05d96d539d57 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:56.948293 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c8d73-4dda-48e8-b97b-3657512ef8d0 admin admin] PATH_INFO: `/v3/projects/de04ae45378c42c199c4680a0df0a30d/users/275b79d18198465f9ac67aad6a94075b/roles/6c54f239944d46e3b027ccce97eb8b49` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:56.958920 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a103d7b0-72d1-44cb-93cf-05d96d539d57 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:56.964874 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb8ed77-6a44-4b16-ad16-36cdb511726e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:56.965176 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb8ed77-6a44-4b16-ad16-36cdb511726e admin admin] REQUEST_METHOD: `PUT` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:56.965563 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb8ed77-6a44-4b16-ad16-36cdb511726e admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:56.965911 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb8ed77-6a44-4b16-ad16-36cdb511726e admin admin] PATH_INFO: `/v3/projects/374e4241c3e24a6a83ee72c64c1f8799/users/d0770576fe3047b4af7ec7b9f4640594/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:56.975193 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540c8d73-4dda-48e8-b97b-3657512ef8d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de04ae45378c42c199c4680a0df0a30d, user_id=275b79d18198465f9ac67aad6a94075b, role_id=6c54f239944d46e3b027ccce97eb8b49)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:56.979722 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540c8d73-4dda-48e8-b97b-3657512ef8d0 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:56.987443 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb8ed77-6a44-4b16-ad16-36cdb511726e admin admin] RBAC: Authorizing `identity:create_grant(project_id=374e4241c3e24a6a83ee72c64c1f8799, user_id=d0770576fe3047b4af7ec7b9f4640594, role_id=33b8a5a8d1d643f2a98f598e6ab0a1cf)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:56.990341 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb8ed77-6a44-4b16-ad16-36cdb511726e admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:57.152442 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 860/1709] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:25:56 2021] PUT /identity/v3/projects/de04ae45378c42c199c4680a0df0a30d/users/275b79d18198465f9ac67aad6a94075b/roles/6c54f239944d46e3b027ccce97eb8b49 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 18:25:57.157446 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540c8d73-4dda-48e8-b97b-3657512ef8d0 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:57.158839 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 850/1710] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:25:56 2021] PUT /identity/v3/projects/374e4241c3e24a6a83ee72c64c1f8799/users/d0770576fe3047b4af7ec7b9f4640594/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:25:57.172634 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35384a92-477a-44b7-8d81-6eea5c99547e None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:57.172634 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35384a92-477a-44b7-8d81-6eea5c99547e None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:57.172634 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35384a92-477a-44b7-8d81-6eea5c99547e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:57.251572 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-35384a92-477a-44b7-8d81-6eea5c99547e None None] MFA Rules not processed for user `d0770576fe3047b4af7ec7b9f4640594`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:25:57.253752 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-35384a92-477a-44b7-8d81-6eea5c99547e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:57.328470 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540c8d73-4dda-48e8-b97b-3657512ef8d0 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:57.369455 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 851/1711] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:25:57 2021] POST /identity/v3/auth/tokens => generated 3387 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:25:57.370769 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35384a92-477a-44b7-8d81-6eea5c99547e None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:57.372644 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-35384a92-477a-44b7-8d81-6eea5c99547e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:57.400067 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cc8abd-f55f-4c6f-8b07-38ac8db7e416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:57.400789 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc8abd-f55f-4c6f-8b07-38ac8db7e416 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:57.401160 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc8abd-f55f-4c6f-8b07-38ac8db7e416 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:57.401449 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc8abd-f55f-4c6f-8b07-38ac8db7e416 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:57.402183 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cc8abd-f55f-4c6f-8b07-38ac8db7e416 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:57.404250 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cc8abd-f55f-4c6f-8b07-38ac8db7e416 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:57.417124 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 861/1712] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:25:57 2021] GET /identity/v3/roles => generated 1420 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 18:25:57.418111 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cc8abd-f55f-4c6f-8b07-38ac8db7e416 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:57.437580 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cc8abd-f55f-4c6f-8b07-38ac8db7e416 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:57.444681 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfff7456-3cac-4a89-8d8d-89d2093dd1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:57.445627 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff7456-3cac-4a89-8d8d-89d2093dd1b2 admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:57.448725 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff7456-3cac-4a89-8d8d-89d2093dd1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:57.449162 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff7456-3cac-4a89-8d8d-89d2093dd1b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:57.449976 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfff7456-3cac-4a89-8d8d-89d2093dd1b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:57.454334 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfff7456-3cac-4a89-8d8d-89d2093dd1b2 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:57.482498 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35384a92-477a-44b7-8d81-6eea5c99547e None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:57.493231 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c104d0-0335-4bb8-8f45-6bd0b1a94825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:57.493231 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c104d0-0335-4bb8-8f45-6bd0b1a94825 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:57.493231 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c104d0-0335-4bb8-8f45-6bd0b1a94825 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:57.493231 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c104d0-0335-4bb8-8f45-6bd0b1a94825 admin admin] PATH_INFO: `/v3/users/6963d25612444ddcbb9ea5cadd96cc7c` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:57.494995 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c104d0-0335-4bb8-8f45-6bd0b1a94825 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6963d25612444ddcbb9ea5cadd96cc7c)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:57.494995 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c104d0-0335-4bb8-8f45-6bd0b1a94825 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:57.550877 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 862/1713] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:25:57 2021] POST /identity/v3/projects => generated 365 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:25:57.552580 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfff7456-3cac-4a89-8d8d-89d2093dd1b2 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:57.627083 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfff7456-3cac-4a89-8d8d-89d2093dd1b2 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:57.634457 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79207f09-6ff0-4fd0-a971-bccd6a2fca04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:57.636384 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79207f09-6ff0-4fd0-a971-bccd6a2fca04 admin admin] REQUEST_METHOD: `PUT` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:57.636384 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79207f09-6ff0-4fd0-a971-bccd6a2fca04 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:57.636384 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79207f09-6ff0-4fd0-a971-bccd6a2fca04 admin admin] PATH_INFO: `/v3/projects/de04ae45378c42c199c4680a0df0a30d/users/275b79d18198465f9ac67aad6a94075b/roles/6c54f239944d46e3b027ccce97eb8b49` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:57.638445 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79207f09-6ff0-4fd0-a971-bccd6a2fca04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de04ae45378c42c199c4680a0df0a30d, user_id=275b79d18198465f9ac67aad6a94075b, role_id=6c54f239944d46e3b027ccce97eb8b49)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:57.641239 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79207f09-6ff0-4fd0-a971-bccd6a2fca04 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:57.654773 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 863/1714] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:25:57 2021] PUT /identity/v3/projects/de04ae45378c42c199c4680a0df0a30d/users/275b79d18198465f9ac67aad6a94075b/roles/6c54f239944d46e3b027ccce97eb8b49 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:25:57.657277 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79207f09-6ff0-4fd0-a971-bccd6a2fca04 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:57.665944 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-79207f09-6ff0-4fd0-a971-bccd6a2fca04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:57.681644 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-59c104d0-0335-4bb8-8f45-6bd0b1a94825 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6963d25612444ddcbb9ea5cadd96cc7c'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:57.688463 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-59c104d0-0335-4bb8-8f45-6bd0b1a94825 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6963d25612444ddcbb9ea5cadd96cc7c'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:57.701434 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-59c104d0-0335-4bb8-8f45-6bd0b1a94825 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6963d25612444ddcbb9ea5cadd96cc7c'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:57.744661 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79207f09-6ff0-4fd0-a971-bccd6a2fca04 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:57.749492 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18441c59-ee97-443c-a800-310ecb7e6745 tempest-VolumeQuotaClassesTest-369917611 tempest-VolumeQuotaClassesTest-369917611-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67a6967e1a814a37bc5ed625d5cd7741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083e19f6dba843879319b9bd255379d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:57.750154 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18441c59-ee97-443c-a800-310ecb7e6745 tempest-VolumeQuotaClassesTest-369917611 tempest-VolumeQuotaClassesTest-369917611-project-admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:57.750441 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18441c59-ee97-443c-a800-310ecb7e6745 tempest-VolumeQuotaClassesTest-369917611 tempest-VolumeQuotaClassesTest-369917611-project-admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:57.750722 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18441c59-ee97-443c-a800-310ecb7e6745 tempest-VolumeQuotaClassesTest-369917611 tempest-VolumeQuotaClassesTest-369917611-project-admin] PATH_INFO: `/v3/domains` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:57.751459 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18441c59-ee97-443c-a800-310ecb7e6745 tempest-VolumeQuotaClassesTest-369917611 tempest-VolumeQuotaClassesTest-369917611-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:25:57.751767 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18441c59-ee97-443c-a800-310ecb7e6745 tempest-VolumeQuotaClassesTest-369917611 tempest-VolumeQuotaClassesTest-369917611-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:57.753420 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18441c59-ee97-443c-a800-310ecb7e6745 tempest-VolumeQuotaClassesTest-369917611 tempest-VolumeQuotaClassesTest-369917611-project-admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:57.765276 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 864/1715] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 12 18:25:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:25:57.767295 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18441c59-ee97-443c-a800-310ecb7e6745 tempest-VolumeQuotaClassesTest-369917611 tempest-VolumeQuotaClassesTest-369917611-project-admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:57.782952 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-59c104d0-0335-4bb8-8f45-6bd0b1a94825 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6963d25612444ddcbb9ea5cadd96cc7c'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:57.783664 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-59c104d0-0335-4bb8-8f45-6bd0b1a94825 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6963d25612444ddcbb9ea5cadd96cc7c'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:57.791322 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 852/1716] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:25:57 2021] DELETE /identity/v3/users/6963d25612444ddcbb9ea5cadd96cc7c => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:25:57.792550 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c104d0-0335-4bb8-8f45-6bd0b1a94825 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:57.793808 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-59c104d0-0335-4bb8-8f45-6bd0b1a94825 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:57.858888 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c104d0-0335-4bb8-8f45-6bd0b1a94825 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:57.863440 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb7fe13-2ed0-4a5c-a2fb-8518359520e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:57.864323 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb7fe13-2ed0-4a5c-a2fb-8518359520e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:57.864672 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb7fe13-2ed0-4a5c-a2fb-8518359520e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:57.864946 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb7fe13-2ed0-4a5c-a2fb-8518359520e7 admin admin] PATH_INFO: `/v3/users/f4f1ad3b929548c294a741a27ae2a093` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:57.866186 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb7fe13-2ed0-4a5c-a2fb-8518359520e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4f1ad3b929548c294a741a27ae2a093)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:57.868109 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb7fe13-2ed0-4a5c-a2fb-8518359520e7 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:57.869190 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18441c59-ee97-443c-a800-310ecb7e6745 tempest-VolumeQuotaClassesTest-369917611 tempest-VolumeQuotaClassesTest-369917611-project-admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:57.876417 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a080a0-b82b-4c6a-86cb-f46a0d192af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:57.877464 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a080a0-b82b-4c6a-86cb-f46a0d192af2 admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:57.877914 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a080a0-b82b-4c6a-86cb-f46a0d192af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:57.878352 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a080a0-b82b-4c6a-86cb-f46a0d192af2 admin admin] PATH_INFO: `/v3/users` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:57.879553 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a080a0-b82b-4c6a-86cb-f46a0d192af2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:57.882852 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a080a0-b82b-4c6a-86cb-f46a0d192af2 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:58.045025 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 865/1717] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:25:57 2021] POST /identity/v3/users => generated 289 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:25:58.046366 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949ab4f-0c69-46e6-8af0-4f2d3baf6412 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:58.046697 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949ab4f-0c69-46e6-8af0-4f2d3baf6412 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:58.046975 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949ab4f-0c69-46e6-8af0-4f2d3baf6412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:58.073405 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-9949ab4f-0c69-46e6-8af0-4f2d3baf6412 None None] MFA Rules not processed for user `275b79d18198465f9ac67aad6a94075b`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:25:58.074628 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-9949ab4f-0c69-46e6-8af0-4f2d3baf6412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:58.099633 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-8cb7fe13-2ed0-4a5c-a2fb-8518359520e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4f1ad3b929548c294a741a27ae2a093'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:58.106807 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-8cb7fe13-2ed0-4a5c-a2fb-8518359520e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4f1ad3b929548c294a741a27ae2a093'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:58.119233 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-8cb7fe13-2ed0-4a5c-a2fb-8518359520e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4f1ad3b929548c294a741a27ae2a093'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:58.149827 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 866/1718] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:25:58 2021] POST /identity/v3/auth/tokens => generated 3468 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:25:58.151322 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9949ab4f-0c69-46e6-8af0-4f2d3baf6412 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:58.153212 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-9949ab4f-0c69-46e6-8af0-4f2d3baf6412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:58.235075 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9949ab4f-0c69-46e6-8af0-4f2d3baf6412 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:58.240424 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a190281b-16bb-41a1-bbe1-39e9becd5cf6 tempest-VolumeQuotaClassesTest-369917611 tempest-VolumeQuotaClassesTest-369917611-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67a6967e1a814a37bc5ed625d5cd7741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083e19f6dba843879319b9bd255379d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:58.241076 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a190281b-16bb-41a1-bbe1-39e9becd5cf6 tempest-VolumeQuotaClassesTest-369917611 tempest-VolumeQuotaClassesTest-369917611-project-admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:58.241363 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a190281b-16bb-41a1-bbe1-39e9becd5cf6 tempest-VolumeQuotaClassesTest-369917611 tempest-VolumeQuotaClassesTest-369917611-project-admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:58.241641 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a190281b-16bb-41a1-bbe1-39e9becd5cf6 tempest-VolumeQuotaClassesTest-369917611 tempest-VolumeQuotaClassesTest-369917611-project-admin] PATH_INFO: `/v3/projects` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:58.242338 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a190281b-16bb-41a1-bbe1-39e9becd5cf6 tempest-VolumeQuotaClassesTest-369917611 tempest-VolumeQuotaClassesTest-369917611-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:58.244268 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a190281b-16bb-41a1-bbe1-39e9becd5cf6 tempest-VolumeQuotaClassesTest-369917611 tempest-VolumeQuotaClassesTest-369917611-project-admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:58.251345 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-8cb7fe13-2ed0-4a5c-a2fb-8518359520e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4f1ad3b929548c294a741a27ae2a093'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:58.252007 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-8cb7fe13-2ed0-4a5c-a2fb-8518359520e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4f1ad3b929548c294a741a27ae2a093'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:58.258853 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 853/1719] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:25:57 2021] DELETE /identity/v3/users/f4f1ad3b929548c294a741a27ae2a093 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:25:58.263574 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923c7e2-18c0-44fb-9afd-e0304413d56a None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:58.263574 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923c7e2-18c0-44fb-9afd-e0304413d56a None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:58.263574 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923c7e2-18c0-44fb-9afd-e0304413d56a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:58.281060 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-3923c7e2-18c0-44fb-9afd-e0304413d56a None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:25:58.282296 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-3923c7e2-18c0-44fb-9afd-e0304413d56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:58.341534 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 854/1720] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:25:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:25:58.342401 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3923c7e2-18c0-44fb-9afd-e0304413d56a None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:58.344154 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-3923c7e2-18c0-44fb-9afd-e0304413d56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:58.360084 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3923c7e2-18c0-44fb-9afd-e0304413d56a None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:58.363941 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 867/1721] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:25:58 2021] POST /identity/v3/projects => generated 354 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:25:58.363941 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a190281b-16bb-41a1-bbe1-39e9becd5cf6 tempest-VolumeQuotaClassesTest-369917611 tempest-VolumeQuotaClassesTest-369917611-project-admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:58.366326 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-a190281b-16bb-41a1-bbe1-39e9becd5cf6 tempest-VolumeQuotaClassesTest-369917611 tempest-VolumeQuotaClassesTest-369917611-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:58.435984 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0010ebce-288e-43b0-acb8-2e061c093479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:58.436821 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010ebce-288e-43b0-acb8-2e061c093479 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:58.437200 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010ebce-288e-43b0-acb8-2e061c093479 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:58.437585 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010ebce-288e-43b0-acb8-2e061c093479 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:58.438593 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0010ebce-288e-43b0-acb8-2e061c093479 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:58.440993 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0010ebce-288e-43b0-acb8-2e061c093479 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:58.444669 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a190281b-16bb-41a1-bbe1-39e9becd5cf6 tempest-VolumeQuotaClassesTest-369917611 tempest-VolumeQuotaClassesTest-369917611-project-admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:58.457089 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 855/1722] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:25:58 2021] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:25:58.457089 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800be791-9aa1-4f1c-8484-7be728699ad5 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:58.457089 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800be791-9aa1-4f1c-8484-7be728699ad5 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:58.457089 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800be791-9aa1-4f1c-8484-7be728699ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:58.459488 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02bcb6e-6a72-4ba0-8c54-4618cbbf4444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:58.460481 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02bcb6e-6a72-4ba0-8c54-4618cbbf4444 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:58.460768 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02bcb6e-6a72-4ba0-8c54-4618cbbf4444 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:58.461082 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02bcb6e-6a72-4ba0-8c54-4618cbbf4444 admin admin] PATH_INFO: `/v3/users/3a15e66d878e40cdb2aa5727b220542f` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:58.462331 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02bcb6e-6a72-4ba0-8c54-4618cbbf4444 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a15e66d878e40cdb2aa5727b220542f)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:58.464522 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02bcb6e-6a72-4ba0-8c54-4618cbbf4444 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:58.474902 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-800be791-9aa1-4f1c-8484-7be728699ad5 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:25:58.476225 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-800be791-9aa1-4f1c-8484-7be728699ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:58.485336 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 856/1723] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:25:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:25:58.486108 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800be791-9aa1-4f1c-8484-7be728699ad5 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:58.487567 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-800be791-9aa1-4f1c-8484-7be728699ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:58.544353 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800be791-9aa1-4f1c-8484-7be728699ad5 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:58.548039 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ff5dfc-505c-42b2-a19c-20a2f2eedcee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:58.548707 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff5dfc-505c-42b2-a19c-20a2f2eedcee service neutron] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:58.548990 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff5dfc-505c-42b2-a19c-20a2f2eedcee service neutron] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:58.549274 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff5dfc-505c-42b2-a19c-20a2f2eedcee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:58.558299 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ff5dfc-505c-42b2-a19c-20a2f2eedcee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:58.559723 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ff5dfc-505c-42b2-a19c-20a2f2eedcee service neutron] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:58.569387 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 857/1724] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:25:58 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:25:58.570358 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ff5dfc-505c-42b2-a19c-20a2f2eedcee service neutron] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:58.571731 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-49ff5dfc-505c-42b2-a19c-20a2f2eedcee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:58.639747 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-f02bcb6e-6a72-4ba0-8c54-4618cbbf4444 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a15e66d878e40cdb2aa5727b220542f'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:58.640488 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-f02bcb6e-6a72-4ba0-8c54-4618cbbf4444 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a15e66d878e40cdb2aa5727b220542f'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:58.653482 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-f02bcb6e-6a72-4ba0-8c54-4618cbbf4444 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a15e66d878e40cdb2aa5727b220542f'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:58.654817 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-f02bcb6e-6a72-4ba0-8c54-4618cbbf4444 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a15e66d878e40cdb2aa5727b220542f'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:58.658511 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ff5dfc-505c-42b2-a19c-20a2f2eedcee service neutron] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:58.664031 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d759116e-ddb7-4260-baba-a2fa073472db tempest-VolumeQuotaClassesTest-369917611 tempest-VolumeQuotaClassesTest-369917611-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67a6967e1a814a37bc5ed625d5cd7741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083e19f6dba843879319b9bd255379d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:58.665704 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-f02bcb6e-6a72-4ba0-8c54-4618cbbf4444 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a15e66d878e40cdb2aa5727b220542f'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:58.666200 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d759116e-ddb7-4260-baba-a2fa073472db tempest-VolumeQuotaClassesTest-369917611 tempest-VolumeQuotaClassesTest-369917611-project-admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:58.666492 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d759116e-ddb7-4260-baba-a2fa073472db tempest-VolumeQuotaClassesTest-369917611 tempest-VolumeQuotaClassesTest-369917611-project-admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:58.669932 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d759116e-ddb7-4260-baba-a2fa073472db tempest-VolumeQuotaClassesTest-369917611 tempest-VolumeQuotaClassesTest-369917611-project-admin] PATH_INFO: `/v3/domains` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:58.669932 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d759116e-ddb7-4260-baba-a2fa073472db tempest-VolumeQuotaClassesTest-369917611 tempest-VolumeQuotaClassesTest-369917611-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:25:58.669932 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d759116e-ddb7-4260-baba-a2fa073472db tempest-VolumeQuotaClassesTest-369917611 tempest-VolumeQuotaClassesTest-369917611-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:58.669932 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d759116e-ddb7-4260-baba-a2fa073472db tempest-VolumeQuotaClassesTest-369917611 tempest-VolumeQuotaClassesTest-369917611-project-admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:58.682566 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 858/1725] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 12 18:25:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:25:58.683409 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d759116e-ddb7-4260-baba-a2fa073472db tempest-VolumeQuotaClassesTest-369917611 tempest-VolumeQuotaClassesTest-369917611-project-admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:58.689219 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-d759116e-ddb7-4260-baba-a2fa073472db tempest-VolumeQuotaClassesTest-369917611 tempest-VolumeQuotaClassesTest-369917611-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:58.714167 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d759116e-ddb7-4260-baba-a2fa073472db tempest-VolumeQuotaClassesTest-369917611 tempest-VolumeQuotaClassesTest-369917611-project-admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:58.721724 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb5d836-1cac-476e-bbbb-64fa307899b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:58.723196 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5d836-1cac-476e-bbbb-64fa307899b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:58.723671 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5d836-1cac-476e-bbbb-64fa307899b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:58.724155 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5d836-1cac-476e-bbbb-64fa307899b4 admin admin] PATH_INFO: `/v3/projects/f019c4f9699c4f5389efeee040069e22/users/3cf3a2256b0e481691c7f224cf603140/roles/6c54f239944d46e3b027ccce97eb8b49` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:58.743149 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 868/1726] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:25:58 2021] DELETE /identity/v3/users/3a15e66d878e40cdb2aa5727b220542f => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:25:58.744230 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02bcb6e-6a72-4ba0-8c54-4618cbbf4444 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:58.745713 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-f02bcb6e-6a72-4ba0-8c54-4618cbbf4444 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:58.748477 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb5d836-1cac-476e-bbbb-64fa307899b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f019c4f9699c4f5389efeee040069e22, user_id=3cf3a2256b0e481691c7f224cf603140, role_id=6c54f239944d46e3b027ccce97eb8b49)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:58.754212 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb5d836-1cac-476e-bbbb-64fa307899b4 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:58.805511 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02bcb6e-6a72-4ba0-8c54-4618cbbf4444 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:58.815355 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24590118-c71d-49b7-9bdb-7216401f61ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:58.815355 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24590118-c71d-49b7-9bdb-7216401f61ee service neutron] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:58.815355 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24590118-c71d-49b7-9bdb-7216401f61ee service neutron] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:58.815355 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24590118-c71d-49b7-9bdb-7216401f61ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:58.826099 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-24590118-c71d-49b7-9bdb-7216401f61ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:58.889776 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24590118-c71d-49b7-9bdb-7216401f61ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:58.891133 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24590118-c71d-49b7-9bdb-7216401f61ee service neutron] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:58.904008 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 869/1727] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:25:58 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:25:58.904964 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24590118-c71d-49b7-9bdb-7216401f61ee service neutron] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:58.910871 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-24590118-c71d-49b7-9bdb-7216401f61ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:58.935735 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 859/1728] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:25:58 2021] PUT /identity/v3/projects/f019c4f9699c4f5389efeee040069e22/users/3cf3a2256b0e481691c7f224cf603140/roles/6c54f239944d46e3b027ccce97eb8b49 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:25:58.939602 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4b814c-4d43-4d77-9c39-aacd5c5470bb None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:58.940467 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4b814c-4d43-4d77-9c39-aacd5c5470bb None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:58.941100 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4b814c-4d43-4d77-9c39-aacd5c5470bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:58.971291 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-bd4b814c-4d43-4d77-9c39-aacd5c5470bb None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:25:58.973267 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-bd4b814c-4d43-4d77-9c39-aacd5c5470bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:58.993405 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24590118-c71d-49b7-9bdb-7216401f61ee service neutron] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:59.060433 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077e2632-4773-4689-ab04-6d3b65fdb351 tempest-VolumeQuotaClassesTest-369917611 tempest-VolumeQuotaClassesTest-369917611-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67a6967e1a814a37bc5ed625d5cd7741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083e19f6dba843879319b9bd255379d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:59.060433 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077e2632-4773-4689-ab04-6d3b65fdb351 tempest-VolumeQuotaClassesTest-369917611 tempest-VolumeQuotaClassesTest-369917611-project-admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:59.060796 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077e2632-4773-4689-ab04-6d3b65fdb351 tempest-VolumeQuotaClassesTest-369917611 tempest-VolumeQuotaClassesTest-369917611-project-admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:59.061069 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077e2632-4773-4689-ab04-6d3b65fdb351 tempest-VolumeQuotaClassesTest-369917611 tempest-VolumeQuotaClassesTest-369917611-project-admin] PATH_INFO: `/v3/projects/73eb48622fce4a02927c32c84f2ec57d` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:59.062290 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077e2632-4773-4689-ab04-6d3b65fdb351 tempest-VolumeQuotaClassesTest-369917611 tempest-VolumeQuotaClassesTest-369917611-project-admin] RBAC: Authorizing `identity:delete_project(project_id=73eb48622fce4a02927c32c84f2ec57d)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:59.064364 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077e2632-4773-4689-ab04-6d3b65fdb351 tempest-VolumeQuotaClassesTest-369917611 tempest-VolumeQuotaClassesTest-369917611-project-admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:59.085156 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 860/1729] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:25:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:25:59.087036 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4b814c-4d43-4d77-9c39-aacd5c5470bb None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:59.104543 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4b814c-4d43-4d77-9c39-aacd5c5470bb None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:59.110150 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bd6560-f16e-43cf-8205-3702e7047c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:59.110817 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd6560-f16e-43cf-8205-3702e7047c1b admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:59.111107 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd6560-f16e-43cf-8205-3702e7047c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:59.111389 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd6560-f16e-43cf-8205-3702e7047c1b admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:59.112134 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bd6560-f16e-43cf-8205-3702e7047c1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:59.114310 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bd6560-f16e-43cf-8205-3702e7047c1b admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:59.125430 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 861/1730] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:25:59 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:25:59.126535 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bd6560-f16e-43cf-8205-3702e7047c1b admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:59.195973 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-077e2632-4773-4689-ab04-6d3b65fdb351 tempest-VolumeQuotaClassesTest-369917611 tempest-VolumeQuotaClassesTest-369917611-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73eb48622fce4a02927c32c84f2ec57d', 'request_id': 'req-077e2632-4773-4689-ab04-6d3b65fdb351'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:59.206695 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-077e2632-4773-4689-ab04-6d3b65fdb351 tempest-VolumeQuotaClassesTest-369917611 tempest-VolumeQuotaClassesTest-369917611-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73eb48622fce4a02927c32c84f2ec57d', 'request_id': 'req-077e2632-4773-4689-ab04-6d3b65fdb351'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:59.215193 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-077e2632-4773-4689-ab04-6d3b65fdb351 tempest-VolumeQuotaClassesTest-369917611 tempest-VolumeQuotaClassesTest-369917611-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73eb48622fce4a02927c32c84f2ec57d', 'request_id': 'req-077e2632-4773-4689-ab04-6d3b65fdb351'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:59.225617 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bd6560-f16e-43cf-8205-3702e7047c1b admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:59.279264 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e522a48-d733-47bb-bb12-41928c752890 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:59.280307 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e522a48-d733-47bb-bb12-41928c752890 service neutron] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:59.280849 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e522a48-d733-47bb-bb12-41928c752890 service neutron] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:59.281230 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e522a48-d733-47bb-bb12-41928c752890 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:59.290901 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-077e2632-4773-4689-ab04-6d3b65fdb351 tempest-VolumeQuotaClassesTest-369917611 tempest-VolumeQuotaClassesTest-369917611-project-admin] The token cache is being invalidate because project 73eb48622fce4a02927c32c84f2ec57d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74005) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:25:59.291555 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-077e2632-4773-4689-ab04-6d3b65fdb351 tempest-VolumeQuotaClassesTest-369917611 tempest-VolumeQuotaClassesTest-369917611-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:59.292553 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-077e2632-4773-4689-ab04-6d3b65fdb351 tempest-VolumeQuotaClassesTest-369917611 tempest-VolumeQuotaClassesTest-369917611-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:59.294530 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 870/1731] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:25:58 2021] DELETE /identity/v3/projects/73eb48622fce4a02927c32c84f2ec57d => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:25:59.295776 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077e2632-4773-4689-ab04-6d3b65fdb351 tempest-VolumeQuotaClassesTest-369917611 tempest-VolumeQuotaClassesTest-369917611-project-admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:59.297348 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-077e2632-4773-4689-ab04-6d3b65fdb351 tempest-VolumeQuotaClassesTest-369917611 tempest-VolumeQuotaClassesTest-369917611-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:59.356062 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e522a48-d733-47bb-bb12-41928c752890 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:59.357523 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e522a48-d733-47bb-bb12-41928c752890 service neutron] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:59.368534 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 862/1732] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:25:59 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:25:59.369275 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e522a48-d733-47bb-bb12-41928c752890 service neutron] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:59.371520 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-9e522a48-d733-47bb-bb12-41928c752890 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:59.384741 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e522a48-d733-47bb-bb12-41928c752890 service neutron] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:59.389691 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28211737-ba35-4f50-b7e6-dc6616311fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:59.390852 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28211737-ba35-4f50-b7e6-dc6616311fbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:59.390852 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28211737-ba35-4f50-b7e6-dc6616311fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:59.391178 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28211737-ba35-4f50-b7e6-dc6616311fbb admin admin] PATH_INFO: `/v3/projects/5c5d044672434a279ace9e729a1f5f21` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:59.393505 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28211737-ba35-4f50-b7e6-dc6616311fbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c5d044672434a279ace9e729a1f5f21)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:59.397591 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28211737-ba35-4f50-b7e6-dc6616311fbb admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:59.403041 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077e2632-4773-4689-ab04-6d3b65fdb351 tempest-VolumeQuotaClassesTest-369917611 tempest-VolumeQuotaClassesTest-369917611-project-admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:59.408510 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fd4e2b-5d72-4bf0-9c6d-4c14611273f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:59.410836 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fd4e2b-5d72-4bf0-9c6d-4c14611273f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:59.410836 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fd4e2b-5d72-4bf0-9c6d-4c14611273f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:59.410836 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fd4e2b-5d72-4bf0-9c6d-4c14611273f2 admin admin] PATH_INFO: `/v3/projects/f019c4f9699c4f5389efeee040069e22/users/3cf3a2256b0e481691c7f224cf603140/roles/6c54f239944d46e3b027ccce97eb8b49` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:59.415530 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fd4e2b-5d72-4bf0-9c6d-4c14611273f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f019c4f9699c4f5389efeee040069e22, user_id=3cf3a2256b0e481691c7f224cf603140, role_id=6c54f239944d46e3b027ccce97eb8b49)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:59.418391 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fd4e2b-5d72-4bf0-9c6d-4c14611273f2 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:59.430879 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 871/1733] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:25:59 2021] PUT /identity/v3/projects/f019c4f9699c4f5389efeee040069e22/users/3cf3a2256b0e481691c7f224cf603140/roles/6c54f239944d46e3b027ccce97eb8b49 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:25:59.432168 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fd4e2b-5d72-4bf0-9c6d-4c14611273f2 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:59.433894 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-c1fd4e2b-5d72-4bf0-9c6d-4c14611273f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:59.547509 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-28211737-ba35-4f50-b7e6-dc6616311fbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c5d044672434a279ace9e729a1f5f21', 'request_id': 'req-28211737-ba35-4f50-b7e6-dc6616311fbb'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:59.550893 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fd4e2b-5d72-4bf0-9c6d-4c14611273f2 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:59.622626 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-28211737-ba35-4f50-b7e6-dc6616311fbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c5d044672434a279ace9e729a1f5f21', 'request_id': 'req-28211737-ba35-4f50-b7e6-dc6616311fbb'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:59.629601 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-28211737-ba35-4f50-b7e6-dc6616311fbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c5d044672434a279ace9e729a1f5f21', 'request_id': 'req-28211737-ba35-4f50-b7e6-dc6616311fbb'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:59.631201 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dffc5f-7c86-493b-a3ce-e62d9a2d9556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:59.632575 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dffc5f-7c86-493b-a3ce-e62d9a2d9556 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:59.633033 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dffc5f-7c86-493b-a3ce-e62d9a2d9556 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:59.633450 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dffc5f-7c86-493b-a3ce-e62d9a2d9556 admin admin] PATH_INFO: `/v3/projects/511ac684e82943649bfee26494105d12` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:59.635269 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dffc5f-7c86-493b-a3ce-e62d9a2d9556 admin admin] RBAC: Authorizing `identity:delete_project(project_id=511ac684e82943649bfee26494105d12)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:59.638480 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dffc5f-7c86-493b-a3ce-e62d9a2d9556 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:59.640983 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-28211737-ba35-4f50-b7e6-dc6616311fbb admin admin] The token cache is being invalidate because project 5c5d044672434a279ace9e729a1f5f21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:25:59.641271 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-28211737-ba35-4f50-b7e6-dc6616311fbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:59.641948 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-28211737-ba35-4f50-b7e6-dc6616311fbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:59.643578 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 863/1734] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:25:59 2021] DELETE /identity/v3/projects/5c5d044672434a279ace9e729a1f5f21 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:25:59.644853 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef2988-a7aa-4a98-bbbe-c79b601c8524 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:59.645167 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef2988-a7aa-4a98-bbbe-c79b601c8524 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:59.645443 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef2988-a7aa-4a98-bbbe-c79b601c8524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:59.673800 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-1aef2988-a7aa-4a98-bbbe-c79b601c8524 None None] MFA Rules not processed for user `3cf3a2256b0e481691c7f224cf603140`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:25:59.674928 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-1aef2988-a7aa-4a98-bbbe-c79b601c8524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:59.752115 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 864/1735] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:25:59 2021] POST /identity/v3/auth/tokens => generated 3452 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:25:59.753199 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aef2988-a7aa-4a98-bbbe-c79b601c8524 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:59.754703 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-1aef2988-a7aa-4a98-bbbe-c79b601c8524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:59.768971 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aef2988-a7aa-4a98-bbbe-c79b601c8524 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:59.769191 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-d2dffc5f-7c86-493b-a3ce-e62d9a2d9556 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '511ac684e82943649bfee26494105d12', 'request_id': 'req-d2dffc5f-7c86-493b-a3ce-e62d9a2d9556'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:59.776305 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-d2dffc5f-7c86-493b-a3ce-e62d9a2d9556 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '511ac684e82943649bfee26494105d12', 'request_id': 'req-d2dffc5f-7c86-493b-a3ce-e62d9a2d9556'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:59.782297 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-d2dffc5f-7c86-493b-a3ce-e62d9a2d9556 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '511ac684e82943649bfee26494105d12', 'request_id': 'req-d2dffc5f-7c86-493b-a3ce-e62d9a2d9556'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:59.838708 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebf7ad7-3963-43d4-aa55-ba33745dd7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:59.840149 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf7ad7-3963-43d4-aa55-ba33745dd7d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:59.840471 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf7ad7-3963-43d4-aa55-ba33745dd7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:59.840807 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf7ad7-3963-43d4-aa55-ba33745dd7d9 admin admin] PATH_INFO: `/v3/users/9a4e8c8d64734917be1ecd47c2d0e780` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:59.842139 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebf7ad7-3963-43d4-aa55-ba33745dd7d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a4e8c8d64734917be1ecd47c2d0e780)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:25:59.845119 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebf7ad7-3963-43d4-aa55-ba33745dd7d9 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:25:59.898397 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-d2dffc5f-7c86-493b-a3ce-e62d9a2d9556 admin admin] The token cache is being invalidate because project 511ac684e82943649bfee26494105d12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74005) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:25:59.898794 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-d2dffc5f-7c86-493b-a3ce-e62d9a2d9556 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:59.901989 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-d2dffc5f-7c86-493b-a3ce-e62d9a2d9556 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:25:59.903626 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 872/1736] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:25:59 2021] DELETE /identity/v3/projects/511ac684e82943649bfee26494105d12 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:25:59.904428 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dffc5f-7c86-493b-a3ce-e62d9a2d9556 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:25:59.905783 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-d2dffc5f-7c86-493b-a3ce-e62d9a2d9556 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:25:59.966525 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dffc5f-7c86-493b-a3ce-e62d9a2d9556 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:25:59.970330 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346eff57-a870-4863-9934-28974866ef8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6966ce0774f4437a9b688494e9d0574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:25:59.972923 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346eff57-a870-4863-9934-28974866ef8c service cinder] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:25:59.972923 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346eff57-a870-4863-9934-28974866ef8c service cinder] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:25:59.972923 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346eff57-a870-4863-9934-28974866ef8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:25:59.974027 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-346eff57-a870-4863-9934-28974866ef8c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:00.052569 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346eff57-a870-4863-9934-28974866ef8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:00.054022 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346eff57-a870-4863-9934-28974866ef8c service cinder] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:00.063317 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 873/1737] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:25:59 2021] GET /identity/v3/auth/tokens => generated 3452 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:26:00.064174 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346eff57-a870-4863-9934-28974866ef8c service cinder] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:00.065657 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-346eff57-a870-4863-9934-28974866ef8c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:00.078916 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346eff57-a870-4863-9934-28974866ef8c service cinder] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:00.084321 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8420193b-08a6-4040-8745-db8baa4175c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:00.085206 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8420193b-08a6-4040-8745-db8baa4175c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:00.085489 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8420193b-08a6-4040-8745-db8baa4175c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:00.085765 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8420193b-08a6-4040-8745-db8baa4175c8 admin admin] PATH_INFO: `/v3/users/5379be23b0a74f4f970c2958c53c3960` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:00.086975 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8420193b-08a6-4040-8745-db8baa4175c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5379be23b0a74f4f970c2958c53c3960)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:00.088945 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8420193b-08a6-4040-8745-db8baa4175c8 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:00.111697 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-bebf7ad7-3963-43d4-aa55-ba33745dd7d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a4e8c8d64734917be1ecd47c2d0e780'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:00.120468 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-bebf7ad7-3963-43d4-aa55-ba33745dd7d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a4e8c8d64734917be1ecd47c2d0e780'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:00.139756 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-bebf7ad7-3963-43d4-aa55-ba33745dd7d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a4e8c8d64734917be1ecd47c2d0e780'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:00.195372 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-bebf7ad7-3963-43d4-aa55-ba33745dd7d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a4e8c8d64734917be1ecd47c2d0e780'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:00.196070 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-bebf7ad7-3963-43d4-aa55-ba33745dd7d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a4e8c8d64734917be1ecd47c2d0e780'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:00.203806 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 865/1738] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:25:59 2021] DELETE /identity/v3/users/9a4e8c8d64734917be1ecd47c2d0e780 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:26:00.205284 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebf7ad7-3963-43d4-aa55-ba33745dd7d9 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:00.208563 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-bebf7ad7-3963-43d4-aa55-ba33745dd7d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:00.253848 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-8420193b-08a6-4040-8745-db8baa4175c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5379be23b0a74f4f970c2958c53c3960'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:00.255618 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-8420193b-08a6-4040-8745-db8baa4175c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5379be23b0a74f4f970c2958c53c3960'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:00.280660 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-8420193b-08a6-4040-8745-db8baa4175c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5379be23b0a74f4f970c2958c53c3960'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:00.281409 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-8420193b-08a6-4040-8745-db8baa4175c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5379be23b0a74f4f970c2958c53c3960'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:00.289276 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-8420193b-08a6-4040-8745-db8baa4175c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5379be23b0a74f4f970c2958c53c3960'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:00.307397 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebf7ad7-3963-43d4-aa55-ba33745dd7d9 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:00.313110 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38acb558-ac7a-4647-ba7f-ba44eed11e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:00.314044 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38acb558-ac7a-4647-ba7f-ba44eed11e0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:00.314360 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38acb558-ac7a-4647-ba7f-ba44eed11e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:00.314616 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38acb558-ac7a-4647-ba7f-ba44eed11e0c admin admin] PATH_INFO: `/v3/projects/93688b321b6941d38ac96e6ba19680bb` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:00.316049 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38acb558-ac7a-4647-ba7f-ba44eed11e0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=93688b321b6941d38ac96e6ba19680bb)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:00.318653 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38acb558-ac7a-4647-ba7f-ba44eed11e0c admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:00.374303 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 874/1739] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:26:00 2021] DELETE /identity/v3/users/5379be23b0a74f4f970c2958c53c3960 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:26:00.375473 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8420193b-08a6-4040-8745-db8baa4175c8 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:00.377234 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-8420193b-08a6-4040-8745-db8baa4175c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:00.459588 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8420193b-08a6-4040-8745-db8baa4175c8 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:00.466555 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70070efe-02db-464c-b299-2c19fcfc80c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:00.467933 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70070efe-02db-464c-b299-2c19fcfc80c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:00.468352 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70070efe-02db-464c-b299-2c19fcfc80c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:00.468826 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70070efe-02db-464c-b299-2c19fcfc80c7 admin admin] PATH_INFO: `/v3/users/02da70eee29c4c24bfa5570a53b413cd` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:00.470739 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70070efe-02db-464c-b299-2c19fcfc80c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02da70eee29c4c24bfa5570a53b413cd)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:00.475232 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70070efe-02db-464c-b299-2c19fcfc80c7 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:00.521494 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-38acb558-ac7a-4647-ba7f-ba44eed11e0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93688b321b6941d38ac96e6ba19680bb', 'request_id': 'req-38acb558-ac7a-4647-ba7f-ba44eed11e0c'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:00.617266 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-38acb558-ac7a-4647-ba7f-ba44eed11e0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93688b321b6941d38ac96e6ba19680bb', 'request_id': 'req-38acb558-ac7a-4647-ba7f-ba44eed11e0c'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:00.634587 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-38acb558-ac7a-4647-ba7f-ba44eed11e0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93688b321b6941d38ac96e6ba19680bb', 'request_id': 'req-38acb558-ac7a-4647-ba7f-ba44eed11e0c'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:00.648614 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-38acb558-ac7a-4647-ba7f-ba44eed11e0c admin admin] The token cache is being invalidate because project 93688b321b6941d38ac96e6ba19680bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:26:00.648981 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-38acb558-ac7a-4647-ba7f-ba44eed11e0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:00.650288 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-38acb558-ac7a-4647-ba7f-ba44eed11e0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:00.652177 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 866/1740] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:26:00 2021] DELETE /identity/v3/projects/93688b321b6941d38ac96e6ba19680bb => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:26:00.653412 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38acb558-ac7a-4647-ba7f-ba44eed11e0c admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:00.654999 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-38acb558-ac7a-4647-ba7f-ba44eed11e0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:00.742713 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-70070efe-02db-464c-b299-2c19fcfc80c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02da70eee29c4c24bfa5570a53b413cd'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:00.743446 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-70070efe-02db-464c-b299-2c19fcfc80c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02da70eee29c4c24bfa5570a53b413cd'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:00.751677 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38acb558-ac7a-4647-ba7f-ba44eed11e0c admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:00.756697 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab338e7f-81ef-4f9a-b956-a532d4d70d06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6966ce0774f4437a9b688494e9d0574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:00.757240 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-70070efe-02db-464c-b299-2c19fcfc80c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02da70eee29c4c24bfa5570a53b413cd'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:00.757596 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab338e7f-81ef-4f9a-b956-a532d4d70d06 service cinder] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:00.757938 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-70070efe-02db-464c-b299-2c19fcfc80c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02da70eee29c4c24bfa5570a53b413cd'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:00.758219 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab338e7f-81ef-4f9a-b956-a532d4d70d06 service cinder] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:00.758611 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab338e7f-81ef-4f9a-b956-a532d4d70d06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:00.760720 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-ab338e7f-81ef-4f9a-b956-a532d4d70d06 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:00.765234 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-70070efe-02db-464c-b299-2c19fcfc80c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02da70eee29c4c24bfa5570a53b413cd'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:00.829723 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab338e7f-81ef-4f9a-b956-a532d4d70d06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:00.831923 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab338e7f-81ef-4f9a-b956-a532d4d70d06 service cinder] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:00.850774 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 867/1741] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:26:00 2021] GET /identity/v3/auth/tokens => generated 3387 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:26:00.852465 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db51ef0-fa92-4a66-bc48-c3740ae21515 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:00.852655 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db51ef0-fa92-4a66-bc48-c3740ae21515 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:00.853075 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db51ef0-fa92-4a66-bc48-c3740ae21515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:00.858765 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 875/1742] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:26:00 2021] DELETE /identity/v3/users/02da70eee29c4c24bfa5570a53b413cd => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:26:00.859823 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70070efe-02db-464c-b299-2c19fcfc80c7 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:00.862913 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-70070efe-02db-464c-b299-2c19fcfc80c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:00.873238 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-3db51ef0-fa92-4a66-bc48-c3740ae21515 None None] MFA Rules not processed for user `9a1ea6f47a7c41aba102ad481f5ad5c8`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:00.874523 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-3db51ef0-fa92-4a66-bc48-c3740ae21515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:00.938051 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 868/1743] 10.222.0.42 () {58 vars in 1015 bytes} [Tue Oct 12 18:26:00 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:26:00.939524 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db51ef0-fa92-4a66-bc48-c3740ae21515 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:00.941325 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-3db51ef0-fa92-4a66-bc48-c3740ae21515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:00.944000 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70070efe-02db-464c-b299-2c19fcfc80c7 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:00.956529 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e319ae0-bdcd-4611-8f65-56fea360222e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:00.957846 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e319ae0-bdcd-4611-8f65-56fea360222e admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:00.958137 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e319ae0-bdcd-4611-8f65-56fea360222e admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:00.958448 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e319ae0-bdcd-4611-8f65-56fea360222e admin admin] PATH_INFO: `/v3/users/275b79d18198465f9ac67aad6a94075b` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:00.960283 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e319ae0-bdcd-4611-8f65-56fea360222e admin admin] RBAC: Authorizing `identity:delete_user(user_id=275b79d18198465f9ac67aad6a94075b)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:00.961714 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db51ef0-fa92-4a66-bc48-c3740ae21515 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:00.962418 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e319ae0-bdcd-4611-8f65-56fea360222e admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:00.968001 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c564f19-e05e-4dc2-aff1-ca26afd0d431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:00.970008 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c564f19-e05e-4dc2-aff1-ca26afd0d431 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:00.970456 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c564f19-e05e-4dc2-aff1-ca26afd0d431 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:00.970828 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c564f19-e05e-4dc2-aff1-ca26afd0d431 admin admin] PATH_INFO: `/v3/projects/cd7097254e0d484094eedd5fd7ba3b15` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:00.972221 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c564f19-e05e-4dc2-aff1-ca26afd0d431 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd7097254e0d484094eedd5fd7ba3b15)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:00.975389 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c564f19-e05e-4dc2-aff1-ca26afd0d431 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:01.234091 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-3e319ae0-bdcd-4611-8f65-56fea360222e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '275b79d18198465f9ac67aad6a94075b'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:01.234918 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-3e319ae0-bdcd-4611-8f65-56fea360222e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '275b79d18198465f9ac67aad6a94075b'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:01.236336 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-5c564f19-e05e-4dc2-aff1-ca26afd0d431 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd7097254e0d484094eedd5fd7ba3b15', 'request_id': 'req-5c564f19-e05e-4dc2-aff1-ca26afd0d431'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:01.250686 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-3e319ae0-bdcd-4611-8f65-56fea360222e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '275b79d18198465f9ac67aad6a94075b'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:01.251493 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-3e319ae0-bdcd-4611-8f65-56fea360222e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '275b79d18198465f9ac67aad6a94075b'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:01.259069 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-3e319ae0-bdcd-4611-8f65-56fea360222e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '275b79d18198465f9ac67aad6a94075b'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:01.291151 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-5c564f19-e05e-4dc2-aff1-ca26afd0d431 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd7097254e0d484094eedd5fd7ba3b15', 'request_id': 'req-5c564f19-e05e-4dc2-aff1-ca26afd0d431'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:01.298001 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-5c564f19-e05e-4dc2-aff1-ca26afd0d431 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd7097254e0d484094eedd5fd7ba3b15', 'request_id': 'req-5c564f19-e05e-4dc2-aff1-ca26afd0d431'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:01.309648 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-5c564f19-e05e-4dc2-aff1-ca26afd0d431 admin admin] The token cache is being invalidate because project cd7097254e0d484094eedd5fd7ba3b15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:26:01.310256 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-5c564f19-e05e-4dc2-aff1-ca26afd0d431 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:01.310587 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-5c564f19-e05e-4dc2-aff1-ca26afd0d431 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:01.312165 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 869/1744] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:26:00 2021] DELETE /identity/v3/projects/cd7097254e0d484094eedd5fd7ba3b15 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:26:01.313458 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d22fce-7874-4ce5-be6c-e34ff1d38e9c None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:01.313736 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d22fce-7874-4ce5-be6c-e34ff1d38e9c None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:01.314581 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d22fce-7874-4ce5-be6c-e34ff1d38e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:01.333267 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-60d22fce-7874-4ce5-be6c-e34ff1d38e9c None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:01.334494 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-60d22fce-7874-4ce5-be6c-e34ff1d38e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:01.345937 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 876/1745] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:26:00 2021] DELETE /identity/v3/users/275b79d18198465f9ac67aad6a94075b => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:26:01.345937 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e319ae0-bdcd-4611-8f65-56fea360222e admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:01.345937 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-3e319ae0-bdcd-4611-8f65-56fea360222e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:01.424331 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e319ae0-bdcd-4611-8f65-56fea360222e admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:01.428468 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58514ecf-2857-4d87-b1d3-1d20de565d82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:01.429176 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58514ecf-2857-4d87-b1d3-1d20de565d82 service neutron] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:01.429460 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58514ecf-2857-4d87-b1d3-1d20de565d82 service neutron] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:01.429818 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58514ecf-2857-4d87-b1d3-1d20de565d82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:01.431852 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-58514ecf-2857-4d87-b1d3-1d20de565d82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:01.440022 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 870/1746] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:26:01.441646 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d22fce-7874-4ce5-be6c-e34ff1d38e9c None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:01.444324 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-60d22fce-7874-4ce5-be6c-e34ff1d38e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:01.450843 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58514ecf-2857-4d87-b1d3-1d20de565d82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:01.450843 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58514ecf-2857-4d87-b1d3-1d20de565d82 service neutron] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:01.461278 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 877/1747] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:26:01 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:26:01.462841 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8dfb0-3a3c-4c9b-abd9-0ccac2013aa5 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:01.463139 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8dfb0-3a3c-4c9b-abd9-0ccac2013aa5 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:01.463546 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8dfb0-3a3c-4c9b-abd9-0ccac2013aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:01.485507 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-93f8dfb0-3a3c-4c9b-abd9-0ccac2013aa5 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:01.486830 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-93f8dfb0-3a3c-4c9b-abd9-0ccac2013aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:01.502549 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d22fce-7874-4ce5-be6c-e34ff1d38e9c None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:01.589873 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 878/1748] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:26:01.590945 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f8dfb0-3a3c-4c9b-abd9-0ccac2013aa5 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:01.594650 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-93f8dfb0-3a3c-4c9b-abd9-0ccac2013aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:01.617470 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f8dfb0-3a3c-4c9b-abd9-0ccac2013aa5 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:01.633598 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a6142-9c4e-45f0-9c3c-53af8d742d6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:01.634461 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a6142-9c4e-45f0-9c3c-53af8d742d6e service neutron] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:01.634938 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a6142-9c4e-45f0-9c3c-53af8d742d6e service neutron] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:01.635221 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a6142-9c4e-45f0-9c3c-53af8d742d6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:01.647334 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118a6142-9c4e-45f0-9c3c-53af8d742d6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:01.651147 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118a6142-9c4e-45f0-9c3c-53af8d742d6e service neutron] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:01.661497 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 879/1749] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:26:01 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:26:01.663349 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416132cb-54a4-4afb-a9ae-0dfce3dffd83 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:01.663649 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416132cb-54a4-4afb-a9ae-0dfce3dffd83 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:01.663987 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416132cb-54a4-4afb-a9ae-0dfce3dffd83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:01.686139 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1be04f-29f5-425b-81f4-43c8366a9f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:01.690368 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1be04f-29f5-425b-81f4-43c8366a9f2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:01.690862 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1be04f-29f5-425b-81f4-43c8366a9f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:01.691351 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1be04f-29f5-425b-81f4-43c8366a9f2c admin admin] PATH_INFO: `/v3/projects/7ad9357fd44b492783bb48fc51831bf2` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:01.696765 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-416132cb-54a4-4afb-a9ae-0dfce3dffd83 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:01.697479 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-416132cb-54a4-4afb-a9ae-0dfce3dffd83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:01.699003 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1be04f-29f5-425b-81f4-43c8366a9f2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ad9357fd44b492783bb48fc51831bf2)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:01.707802 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1be04f-29f5-425b-81f4-43c8366a9f2c admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:01.719223 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 880/1750] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:26:01.742015 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416132cb-54a4-4afb-a9ae-0dfce3dffd83 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:01.757065 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416132cb-54a4-4afb-a9ae-0dfce3dffd83 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:01.771939 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ddec88-371d-4f37-ae18-0906e2ed09c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:01.772800 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ddec88-371d-4f37-ae18-0906e2ed09c2 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:01.773091 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ddec88-371d-4f37-ae18-0906e2ed09c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:01.773366 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ddec88-371d-4f37-ae18-0906e2ed09c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:01.774112 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ddec88-371d-4f37-ae18-0906e2ed09c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:26:01.774417 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ddec88-371d-4f37-ae18-0906e2ed09c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:01.780739 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ddec88-371d-4f37-ae18-0906e2ed09c2 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:01.810388 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 881/1751] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 12 18:26:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:26:01.815083 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ddec88-371d-4f37-ae18-0906e2ed09c2 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:01.844335 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ddec88-371d-4f37-ae18-0906e2ed09c2 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:01.856444 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22daae12-d22a-4888-903e-a84c66d838cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:01.857604 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22daae12-d22a-4888-903e-a84c66d838cc admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:01.858103 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22daae12-d22a-4888-903e-a84c66d838cc admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:01.858540 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22daae12-d22a-4888-903e-a84c66d838cc admin admin] PATH_INFO: `/v3/projects` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:01.859868 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22daae12-d22a-4888-903e-a84c66d838cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:01.864684 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22daae12-d22a-4888-903e-a84c66d838cc admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:01.937548 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-5d1be04f-29f5-425b-81f4-43c8366a9f2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ad9357fd44b492783bb48fc51831bf2', 'request_id': 'req-5d1be04f-29f5-425b-81f4-43c8366a9f2c'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:02.018288 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-5d1be04f-29f5-425b-81f4-43c8366a9f2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ad9357fd44b492783bb48fc51831bf2', 'request_id': 'req-5d1be04f-29f5-425b-81f4-43c8366a9f2c'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:02.031467 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 882/1752] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:26:01 2021] POST /identity/v3/projects => generated 387 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:26:02.036251 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22daae12-d22a-4888-903e-a84c66d838cc admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:02.036640 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-5d1be04f-29f5-425b-81f4-43c8366a9f2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ad9357fd44b492783bb48fc51831bf2', 'request_id': 'req-5d1be04f-29f5-425b-81f4-43c8366a9f2c'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:02.036829 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-22daae12-d22a-4888-903e-a84c66d838cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:02.056742 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-5d1be04f-29f5-425b-81f4-43c8366a9f2c admin admin] The token cache is being invalidate because project 7ad9357fd44b492783bb48fc51831bf2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:26:02.058328 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-5d1be04f-29f5-425b-81f4-43c8366a9f2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:02.060060 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-5d1be04f-29f5-425b-81f4-43c8366a9f2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:02.067103 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 871/1753] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:26:01 2021] DELETE /identity/v3/projects/7ad9357fd44b492783bb48fc51831bf2 => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:26:02.067103 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1be04f-29f5-425b-81f4-43c8366a9f2c admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:02.067103 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-5d1be04f-29f5-425b-81f4-43c8366a9f2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:02.153520 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22daae12-d22a-4888-903e-a84c66d838cc admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:02.162399 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717d9262-c0dd-48f5-96e1-b5c53617f430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:02.163642 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d9262-c0dd-48f5-96e1-b5c53617f430 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:02.164003 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d9262-c0dd-48f5-96e1-b5c53617f430 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:02.164530 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d9262-c0dd-48f5-96e1-b5c53617f430 admin admin] PATH_INFO: `/v3/projects/de04ae45378c42c199c4680a0df0a30d` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:02.168919 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717d9262-c0dd-48f5-96e1-b5c53617f430 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de04ae45378c42c199c4680a0df0a30d)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:02.173257 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717d9262-c0dd-48f5-96e1-b5c53617f430 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:02.208284 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1be04f-29f5-425b-81f4-43c8366a9f2c admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:02.219010 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c758dc-f1b6-41d2-b00e-a14e4069ef6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:02.229402 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c758dc-f1b6-41d2-b00e-a14e4069ef6e admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:02.229692 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c758dc-f1b6-41d2-b00e-a14e4069ef6e admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:02.235428 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c758dc-f1b6-41d2-b00e-a14e4069ef6e admin admin] PATH_INFO: `/v3/users` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:02.235428 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c758dc-f1b6-41d2-b00e-a14e4069ef6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:02.235428 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c758dc-f1b6-41d2-b00e-a14e4069ef6e admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:02.322595 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 872/1754] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:26:02 2021] POST /identity/v3/users => generated 294 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:26:02.324140 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd2270-0fac-4800-9279-0cc617f1268a None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:02.324580 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd2270-0fac-4800-9279-0cc617f1268a None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:02.324969 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd2270-0fac-4800-9279-0cc617f1268a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:02.329624 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-717d9262-c0dd-48f5-96e1-b5c53617f430 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de04ae45378c42c199c4680a0df0a30d', 'request_id': 'req-717d9262-c0dd-48f5-96e1-b5c53617f430'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:02.350799 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-e2fd2270-0fac-4800-9279-0cc617f1268a None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:02.351965 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-717d9262-c0dd-48f5-96e1-b5c53617f430 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de04ae45378c42c199c4680a0df0a30d', 'request_id': 'req-717d9262-c0dd-48f5-96e1-b5c53617f430'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:02.353178 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-e2fd2270-0fac-4800-9279-0cc617f1268a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:02.375033 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-717d9262-c0dd-48f5-96e1-b5c53617f430 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de04ae45378c42c199c4680a0df0a30d', 'request_id': 'req-717d9262-c0dd-48f5-96e1-b5c53617f430'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:02.451361 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 873/1755] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:26:02.452893 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fd2270-0fac-4800-9279-0cc617f1268a None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:02.474557 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fd2270-0fac-4800-9279-0cc617f1268a None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:02.481470 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290be08b-ca50-4ed8-8d04-7ee3dfa5f5d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:02.486670 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290be08b-ca50-4ed8-8d04-7ee3dfa5f5d8 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:02.486670 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290be08b-ca50-4ed8-8d04-7ee3dfa5f5d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:02.486670 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290be08b-ca50-4ed8-8d04-7ee3dfa5f5d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:02.486670 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290be08b-ca50-4ed8-8d04-7ee3dfa5f5d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:02.487296 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-717d9262-c0dd-48f5-96e1-b5c53617f430 admin admin] The token cache is being invalidate because project de04ae45378c42c199c4680a0df0a30d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74005) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:26:02.487296 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-717d9262-c0dd-48f5-96e1-b5c53617f430 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:02.488077 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290be08b-ca50-4ed8-8d04-7ee3dfa5f5d8 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:02.488653 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-717d9262-c0dd-48f5-96e1-b5c53617f430 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:02.493066 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 883/1756] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:26:02 2021] DELETE /identity/v3/projects/de04ae45378c42c199c4680a0df0a30d => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:26:02.495866 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8048278e-965d-46ea-a929-f62e5bf6c988 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:02.496891 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8048278e-965d-46ea-a929-f62e5bf6c988 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:02.497603 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8048278e-965d-46ea-a929-f62e5bf6c988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:02.540044 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-8048278e-965d-46ea-a929-f62e5bf6c988 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:02.541461 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 874/1757] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:26:02 2021] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:26:02.544046 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-8048278e-965d-46ea-a929-f62e5bf6c988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:02.548426 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cfb84a-47cd-4ef0-8e92-86c39e9951a3 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:02.548910 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cfb84a-47cd-4ef0-8e92-86c39e9951a3 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:02.549684 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cfb84a-47cd-4ef0-8e92-86c39e9951a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:02.570246 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 884/1758] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:26:02.570246 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8048278e-965d-46ea-a929-f62e5bf6c988 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:02.571690 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-8048278e-965d-46ea-a929-f62e5bf6c988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:02.588468 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8048278e-965d-46ea-a929-f62e5bf6c988 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:02.596451 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c012b-4132-4b7a-af87-09bd0922eeb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:02.597236 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c012b-4132-4b7a-af87-09bd0922eeb9 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:02.598926 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c012b-4132-4b7a-af87-09bd0922eeb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:02.598926 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c012b-4132-4b7a-af87-09bd0922eeb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:02.600741 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4c012b-4132-4b7a-af87-09bd0922eeb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:02.604033 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4c012b-4132-4b7a-af87-09bd0922eeb9 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:02.616829 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-c9cfb84a-47cd-4ef0-8e92-86c39e9951a3 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:02.620955 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 885/1759] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:26:02 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:26:02.621181 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-c9cfb84a-47cd-4ef0-8e92-86c39e9951a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:02.621410 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c012b-4132-4b7a-af87-09bd0922eeb9 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:02.650317 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 875/1760] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:26:02.655218 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cfb84a-47cd-4ef0-8e92-86c39e9951a3 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:02.661143 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c012b-4132-4b7a-af87-09bd0922eeb9 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:02.668064 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df06fd1-a4f2-44dd-bda1-d7b35f49fb8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:02.668837 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df06fd1-a4f2-44dd-bda1-d7b35f49fb8d admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:02.669124 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df06fd1-a4f2-44dd-bda1-d7b35f49fb8d admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:02.669455 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df06fd1-a4f2-44dd-bda1-d7b35f49fb8d admin admin] PATH_INFO: `/v3/domains` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:02.670247 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df06fd1-a4f2-44dd-bda1-d7b35f49fb8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:26:02.670560 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df06fd1-a4f2-44dd-bda1-d7b35f49fb8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:02.672228 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df06fd1-a4f2-44dd-bda1-d7b35f49fb8d admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:02.698264 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cfb84a-47cd-4ef0-8e92-86c39e9951a3 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:02.698372 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 886/1761] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 12 18:26:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:26:02.698901 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843ef697-3848-4929-81df-147c42c723c4 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:02.699191 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843ef697-3848-4929-81df-147c42c723c4 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:02.699503 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843ef697-3848-4929-81df-147c42c723c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:02.707957 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a106654-6833-43a2-b3ea-f1eff8b36806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:02.708898 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a106654-6833-43a2-b3ea-f1eff8b36806 admin admin] REQUEST_METHOD: `PUT` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:02.709184 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a106654-6833-43a2-b3ea-f1eff8b36806 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:02.709644 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a106654-6833-43a2-b3ea-f1eff8b36806 admin admin] PATH_INFO: `/v3/projects/5998337139764507aedd94669cdb1243/users/fe56c5acb0ef49cf9ef9e95b8ccd3775/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:02.726927 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a106654-6833-43a2-b3ea-f1eff8b36806 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5998337139764507aedd94669cdb1243, user_id=fe56c5acb0ef49cf9ef9e95b8ccd3775, role_id=33b8a5a8d1d643f2a98f598e6ab0a1cf)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:02.729401 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a106654-6833-43a2-b3ea-f1eff8b36806 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:02.735333 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-843ef697-3848-4929-81df-147c42c723c4 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:02.736722 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-843ef697-3848-4929-81df-147c42c723c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:02.747048 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 887/1762] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:26:02.747971 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843ef697-3848-4929-81df-147c42c723c4 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:02.767822 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843ef697-3848-4929-81df-147c42c723c4 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:02.775108 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbedb5df-21f4-4d22-8c96-fb3c95b5c07d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:02.776306 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbedb5df-21f4-4d22-8c96-fb3c95b5c07d admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:02.776855 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbedb5df-21f4-4d22-8c96-fb3c95b5c07d admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:02.777355 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbedb5df-21f4-4d22-8c96-fb3c95b5c07d admin admin] PATH_INFO: `/v3/projects` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:02.778210 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbedb5df-21f4-4d22-8c96-fb3c95b5c07d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:02.780299 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbedb5df-21f4-4d22-8c96-fb3c95b5c07d admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:02.812204 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 876/1763] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:26:02 2021] PUT /identity/v3/projects/5998337139764507aedd94669cdb1243/users/fe56c5acb0ef49cf9ef9e95b8ccd3775/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:26:02.813497 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a106654-6833-43a2-b3ea-f1eff8b36806 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:02.905635 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a106654-6833-43a2-b3ea-f1eff8b36806 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:02.911660 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a76836a-b772-4800-9a51-06a3b1ed4773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:02.912971 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a76836a-b772-4800-9a51-06a3b1ed4773 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:02.913595 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a76836a-b772-4800-9a51-06a3b1ed4773 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:02.913978 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a76836a-b772-4800-9a51-06a3b1ed4773 admin admin] PATH_INFO: `/v3/domains` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:02.914889 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a76836a-b772-4800-9a51-06a3b1ed4773 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:26:02.915209 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a76836a-b772-4800-9a51-06a3b1ed4773 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:02.916970 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a76836a-b772-4800-9a51-06a3b1ed4773 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:02.938950 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 888/1764] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:26:02 2021] POST /identity/v3/projects => generated 385 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:26:02.945014 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4e3d1-c45a-4eba-aafe-fbbf4aa9aa71 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:02.945737 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 877/1765] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 12 18:26:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:26:02.946584 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a76836a-b772-4800-9a51-06a3b1ed4773 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:02.950713 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4e3d1-c45a-4eba-aafe-fbbf4aa9aa71 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:02.951910 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4e3d1-c45a-4eba-aafe-fbbf4aa9aa71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:02.970184 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a76836a-b772-4800-9a51-06a3b1ed4773 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:03.011603 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-35b4e3d1-c45a-4eba-aafe-fbbf4aa9aa71 None None] MFA Rules not processed for user `fe56c5acb0ef49cf9ef9e95b8ccd3775`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:03.013389 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-35b4e3d1-c45a-4eba-aafe-fbbf4aa9aa71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:03.078685 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb6ca0d-bb30-46a0-8334-ffa4b7c49a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:03.079611 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb6ca0d-bb30-46a0-8334-ffa4b7c49a95 admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:03.079819 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb6ca0d-bb30-46a0-8334-ffa4b7c49a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:03.080433 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb6ca0d-bb30-46a0-8334-ffa4b7c49a95 admin admin] PATH_INFO: `/v3/users` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:03.081283 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb6ca0d-bb30-46a0-8334-ffa4b7c49a95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:03.083467 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb6ca0d-bb30-46a0-8334-ffa4b7c49a95 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:03.114093 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 889/1766] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:02 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:26:03.115310 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b4e3d1-c45a-4eba-aafe-fbbf4aa9aa71 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:03.128819 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b4e3d1-c45a-4eba-aafe-fbbf4aa9aa71 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:03.135345 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992d928e-dcb2-4b35-83b0-885b731d036c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:03.136841 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992d928e-dcb2-4b35-83b0-885b731d036c admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:03.137305 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992d928e-dcb2-4b35-83b0-885b731d036c admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:03.137731 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992d928e-dcb2-4b35-83b0-885b731d036c admin admin] PATH_INFO: `/v3/projects` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:03.138898 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992d928e-dcb2-4b35-83b0-885b731d036c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:03.141192 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992d928e-dcb2-4b35-83b0-885b731d036c admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:03.146002 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 878/1767] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:26:02 2021] POST /identity/v3/users => generated 293 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:26:03.150246 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb6ca0d-bb30-46a0-8334-ffa4b7c49a95 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:03.168367 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb6ca0d-bb30-46a0-8334-ffa4b7c49a95 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:03.174627 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc6c394-44ca-4ba0-ae72-0c30eff63d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:03.175462 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc6c394-44ca-4ba0-ae72-0c30eff63d06 admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:03.176752 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc6c394-44ca-4ba0-ae72-0c30eff63d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:03.177142 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc6c394-44ca-4ba0-ae72-0c30eff63d06 admin admin] PATH_INFO: `/v3/projects` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:03.178786 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc6c394-44ca-4ba0-ae72-0c30eff63d06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:03.180749 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc6c394-44ca-4ba0-ae72-0c30eff63d06 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:03.226995 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 890/1768] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:26:03 2021] POST /identity/v3/projects => generated 401 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:26:03.226995 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992d928e-dcb2-4b35-83b0-885b731d036c admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:03.276919 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 879/1769] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:26:03 2021] POST /identity/v3/projects => generated 387 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:26:03.276919 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc6c394-44ca-4ba0-ae72-0c30eff63d06 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:03.303784 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992d928e-dcb2-4b35-83b0-885b731d036c admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:03.396582 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc6c394-44ca-4ba0-ae72-0c30eff63d06 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:03.397995 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10c4141-e786-4a2a-bc10-265012103b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:03.399061 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c4141-e786-4a2a-bc10-265012103b52 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:03.399851 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c4141-e786-4a2a-bc10-265012103b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:03.400473 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c4141-e786-4a2a-bc10-265012103b52 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:03.401501 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10c4141-e786-4a2a-bc10-265012103b52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:03.406096 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10c4141-e786-4a2a-bc10-265012103b52 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:03.406296 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b2930-b131-4730-acc0-7dd66732bf68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:03.406296 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b2930-b131-4730-acc0-7dd66732bf68 admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:03.406707 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b2930-b131-4730-acc0-7dd66732bf68 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:03.407291 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b2930-b131-4730-acc0-7dd66732bf68 admin admin] PATH_INFO: `/v3/users` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:03.408733 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90b2930-b131-4730-acc0-7dd66732bf68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:03.411907 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90b2930-b131-4730-acc0-7dd66732bf68 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:03.418125 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 891/1770] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:26:03 2021] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:26:03.422770 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10c4141-e786-4a2a-bc10-265012103b52 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:03.434768 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10c4141-e786-4a2a-bc10-265012103b52 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:03.441175 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cfa8a3-8658-490b-b2ed-cd2fc187abfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:03.443326 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cfa8a3-8658-490b-b2ed-cd2fc187abfe admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:03.443706 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cfa8a3-8658-490b-b2ed-cd2fc187abfe admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:03.444056 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cfa8a3-8658-490b-b2ed-cd2fc187abfe admin admin] PATH_INFO: `/v3/users` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:03.446841 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cfa8a3-8658-490b-b2ed-cd2fc187abfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:03.449610 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cfa8a3-8658-490b-b2ed-cd2fc187abfe admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:03.499205 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 880/1771] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:26:03 2021] POST /identity/v3/users => generated 301 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:26:03.500165 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b2930-b131-4730-acc0-7dd66732bf68 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:03.503565 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-d90b2930-b131-4730-acc0-7dd66732bf68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:03.518012 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b2930-b131-4730-acc0-7dd66732bf68 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:03.536386 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 892/1772] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:26:03 2021] POST /identity/v3/users => generated 300 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:26:03.538266 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e149473-3dd8-4f61-a116-3e1ebf9180b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:03.539084 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e149473-3dd8-4f61-a116-3e1ebf9180b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:03.540019 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cfa8a3-8658-490b-b2ed-cd2fc187abfe admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:03.540470 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e149473-3dd8-4f61-a116-3e1ebf9180b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:03.540956 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e149473-3dd8-4f61-a116-3e1ebf9180b8 admin admin] PATH_INFO: `/v3/projects/4e7818666d9a4c1080117d4a7eca7a7e` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:03.557327 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e149473-3dd8-4f61-a116-3e1ebf9180b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e7818666d9a4c1080117d4a7eca7a7e)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:03.560621 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e149473-3dd8-4f61-a116-3e1ebf9180b8 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:03.567273 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cfa8a3-8658-490b-b2ed-cd2fc187abfe admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:03.574937 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdffe1f4-9e83-4a0f-84c0-0862933d0a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:03.576331 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdffe1f4-9e83-4a0f-84c0-0862933d0a19 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:03.577142 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdffe1f4-9e83-4a0f-84c0-0862933d0a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:03.578057 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdffe1f4-9e83-4a0f-84c0-0862933d0a19 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:03.579084 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdffe1f4-9e83-4a0f-84c0-0862933d0a19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:03.580974 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdffe1f4-9e83-4a0f-84c0-0862933d0a19 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:03.602507 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 893/1773] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:26:03 2021] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:26:03.603589 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdffe1f4-9e83-4a0f-84c0-0862933d0a19 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:03.627003 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdffe1f4-9e83-4a0f-84c0-0862933d0a19 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:03.636222 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5475ef1a-82ea-4e2a-9d94-e4b6ad76f301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:03.637151 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5475ef1a-82ea-4e2a-9d94-e4b6ad76f301 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:03.637439 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5475ef1a-82ea-4e2a-9d94-e4b6ad76f301 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:03.637768 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5475ef1a-82ea-4e2a-9d94-e4b6ad76f301 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:03.638544 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5475ef1a-82ea-4e2a-9d94-e4b6ad76f301 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:03.640323 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5475ef1a-82ea-4e2a-9d94-e4b6ad76f301 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:03.652511 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 894/1774] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:26:03 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:26:03.653452 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5475ef1a-82ea-4e2a-9d94-e4b6ad76f301 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:03.663347 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5475ef1a-82ea-4e2a-9d94-e4b6ad76f301 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:03.668393 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8073e354-1668-4856-8fa3-ebfd8a99f089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:03.669099 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8073e354-1668-4856-8fa3-ebfd8a99f089 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:03.669381 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8073e354-1668-4856-8fa3-ebfd8a99f089 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:03.669654 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8073e354-1668-4856-8fa3-ebfd8a99f089 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:03.670398 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8073e354-1668-4856-8fa3-ebfd8a99f089 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:03.672082 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8073e354-1668-4856-8fa3-ebfd8a99f089 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:03.683275 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 895/1775] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:26:03 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:26:03.684663 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8073e354-1668-4856-8fa3-ebfd8a99f089 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:03.695401 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8073e354-1668-4856-8fa3-ebfd8a99f089 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:03.711269 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-1e149473-3dd8-4f61-a116-3e1ebf9180b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e7818666d9a4c1080117d4a7eca7a7e', 'request_id': 'req-1e149473-3dd8-4f61-a116-3e1ebf9180b8'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:03.768048 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a92e6-e7ff-4829-b3fa-aeced6469581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:03.769021 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a92e6-e7ff-4829-b3fa-aeced6469581 admin admin] REQUEST_METHOD: `PUT` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:03.774963 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a92e6-e7ff-4829-b3fa-aeced6469581 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:03.774963 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a92e6-e7ff-4829-b3fa-aeced6469581 admin admin] PATH_INFO: `/v3/projects/b13572a973654203a8ce0e52642d2e69/users/c8aa6cc9d5134296b16285e99aeda37c/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:03.796420 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-1e149473-3dd8-4f61-a116-3e1ebf9180b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e7818666d9a4c1080117d4a7eca7a7e', 'request_id': 'req-1e149473-3dd8-4f61-a116-3e1ebf9180b8'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:03.805967 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133a92e6-e7ff-4829-b3fa-aeced6469581 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b13572a973654203a8ce0e52642d2e69, user_id=c8aa6cc9d5134296b16285e99aeda37c, role_id=33b8a5a8d1d643f2a98f598e6ab0a1cf)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:03.807817 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-1e149473-3dd8-4f61-a116-3e1ebf9180b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e7818666d9a4c1080117d4a7eca7a7e', 'request_id': 'req-1e149473-3dd8-4f61-a116-3e1ebf9180b8'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:03.811487 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133a92e6-e7ff-4829-b3fa-aeced6469581 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:03.831922 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-1e149473-3dd8-4f61-a116-3e1ebf9180b8 admin admin] The token cache is being invalidate because project 4e7818666d9a4c1080117d4a7eca7a7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:26:03.831922 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-1e149473-3dd8-4f61-a116-3e1ebf9180b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:03.835002 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-1e149473-3dd8-4f61-a116-3e1ebf9180b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:03.839060 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 881/1776] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:26:03 2021] DELETE /identity/v3/projects/4e7818666d9a4c1080117d4a7eca7a7e => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:26:03.839766 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e149473-3dd8-4f61-a116-3e1ebf9180b8 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:03.843946 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-1e149473-3dd8-4f61-a116-3e1ebf9180b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:03.873454 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e149473-3dd8-4f61-a116-3e1ebf9180b8 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:03.881558 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af79097d-3813-4685-9b73-1a6236d9d448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:03.882734 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af79097d-3813-4685-9b73-1a6236d9d448 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:03.882858 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af79097d-3813-4685-9b73-1a6236d9d448 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:03.883435 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af79097d-3813-4685-9b73-1a6236d9d448 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:03.884924 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af79097d-3813-4685-9b73-1a6236d9d448 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:03.886977 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af79097d-3813-4685-9b73-1a6236d9d448 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:03.887383 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 896/1777] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:26:03 2021] PUT /identity/v3/projects/b13572a973654203a8ce0e52642d2e69/users/c8aa6cc9d5134296b16285e99aeda37c/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:26:03.891319 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a92e6-e7ff-4829-b3fa-aeced6469581 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:03.894249 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-133a92e6-e7ff-4829-b3fa-aeced6469581 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:03.934614 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 882/1778] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:26:03 2021] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:26:03.936736 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af79097d-3813-4685-9b73-1a6236d9d448 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:03.940858 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-af79097d-3813-4685-9b73-1a6236d9d448 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:03.965414 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af79097d-3813-4685-9b73-1a6236d9d448 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:03.998094 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a92e6-e7ff-4829-b3fa-aeced6469581 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:04.003620 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18422073-ca2b-4902-a3bd-7ebbd4ad9f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:04.005326 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18422073-ca2b-4902-a3bd-7ebbd4ad9f30 admin admin] REQUEST_METHOD: `PUT` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:04.005619 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18422073-ca2b-4902-a3bd-7ebbd4ad9f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:04.005975 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18422073-ca2b-4902-a3bd-7ebbd4ad9f30 admin admin] PATH_INFO: `/v3/projects/d3efb4920b3a4608bcd477cd80ca6010/users/919ec0a172924ed283fd04a624ed8a98/roles/6c54f239944d46e3b027ccce97eb8b49` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:04.036472 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18422073-ca2b-4902-a3bd-7ebbd4ad9f30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3efb4920b3a4608bcd477cd80ca6010, user_id=919ec0a172924ed283fd04a624ed8a98, role_id=6c54f239944d46e3b027ccce97eb8b49)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:04.041872 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18422073-ca2b-4902-a3bd-7ebbd4ad9f30 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:04.049843 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a28f590-67a8-4096-8a50-5b618d12f672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:04.051239 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28f590-67a8-4096-8a50-5b618d12f672 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:04.051659 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28f590-67a8-4096-8a50-5b618d12f672 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:04.052067 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28f590-67a8-4096-8a50-5b618d12f672 admin admin] PATH_INFO: `/v3/users/67a6967e1a814a37bc5ed625d5cd7741` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:04.053980 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a28f590-67a8-4096-8a50-5b618d12f672 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67a6967e1a814a37bc5ed625d5cd7741)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:04.057475 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a28f590-67a8-4096-8a50-5b618d12f672 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:04.176785 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 897/1779] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:26:03 2021] PUT /identity/v3/projects/d3efb4920b3a4608bcd477cd80ca6010/users/919ec0a172924ed283fd04a624ed8a98/roles/6c54f239944d46e3b027ccce97eb8b49 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:26:04.176785 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18422073-ca2b-4902-a3bd-7ebbd4ad9f30 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:04.324615 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18422073-ca2b-4902-a3bd-7ebbd4ad9f30 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:04.325123 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42173c07-38b7-457c-a271-d261ca5e8ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:04.326607 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42173c07-38b7-457c-a271-d261ca5e8ce3 admin admin] REQUEST_METHOD: `PUT` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:04.326895 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42173c07-38b7-457c-a271-d261ca5e8ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:04.327230 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42173c07-38b7-457c-a271-d261ca5e8ce3 admin admin] PATH_INFO: `/v3/projects/5d12f55194ec48fb8d925e486472604e/users/71a6da7ace3849bd81b48f17083e1baf/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:04.353123 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42173c07-38b7-457c-a271-d261ca5e8ce3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d12f55194ec48fb8d925e486472604e, user_id=71a6da7ace3849bd81b48f17083e1baf, role_id=33b8a5a8d1d643f2a98f598e6ab0a1cf)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:04.356057 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42173c07-38b7-457c-a271-d261ca5e8ce3 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:04.582071 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-0a28f590-67a8-4096-8a50-5b618d12f672 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67a6967e1a814a37bc5ed625d5cd7741'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:04.603538 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-0a28f590-67a8-4096-8a50-5b618d12f672 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67a6967e1a814a37bc5ed625d5cd7741'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:04.633400 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-0a28f590-67a8-4096-8a50-5b618d12f672 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67a6967e1a814a37bc5ed625d5cd7741'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:04.642625 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 898/1780] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:26:04 2021] PUT /identity/v3/projects/5d12f55194ec48fb8d925e486472604e/users/71a6da7ace3849bd81b48f17083e1baf/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:26:04.650172 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b717427-5c1b-4ed9-8fd2-f860a322e6e6 None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:04.650172 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b717427-5c1b-4ed9-8fd2-f860a322e6e6 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:04.650172 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b717427-5c1b-4ed9-8fd2-f860a322e6e6 None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:04.650172 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 899/1781] 10.222.0.18 () {54 vars in 921 bytes} [Tue Oct 12 18:26:04 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:26:04.659457 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353fb14a-0113-4851-9a81-9e0cf2bb3a7b None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:04.659743 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353fb14a-0113-4851-9a81-9e0cf2bb3a7b None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:04.660030 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353fb14a-0113-4851-9a81-9e0cf2bb3a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:04.694810 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-353fb14a-0113-4851-9a81-9e0cf2bb3a7b None None] MFA Rules not processed for user `c8aa6cc9d5134296b16285e99aeda37c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:04.696126 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-353fb14a-0113-4851-9a81-9e0cf2bb3a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:04.732266 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-0a28f590-67a8-4096-8a50-5b618d12f672 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67a6967e1a814a37bc5ed625d5cd7741'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:04.733034 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-0a28f590-67a8-4096-8a50-5b618d12f672 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67a6967e1a814a37bc5ed625d5cd7741'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:04.741833 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 883/1782] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:26:03 2021] DELETE /identity/v3/users/67a6967e1a814a37bc5ed625d5cd7741 => generated 0 bytes in 807 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:26:04.742870 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a28f590-67a8-4096-8a50-5b618d12f672 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:04.749544 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-0a28f590-67a8-4096-8a50-5b618d12f672 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:04.818798 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 900/1783] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:04 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:26:04.820636 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fb7c6d-37d7-41ac-bdd8-62abbd496cfd None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:04.820934 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fb7c6d-37d7-41ac-bdd8-62abbd496cfd None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:04.821216 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fb7c6d-37d7-41ac-bdd8-62abbd496cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:04.866883 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-39fb7c6d-37d7-41ac-bdd8-62abbd496cfd None None] MFA Rules not processed for user `71a6da7ace3849bd81b48f17083e1baf`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:04.868470 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-39fb7c6d-37d7-41ac-bdd8-62abbd496cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:04.909572 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a28f590-67a8-4096-8a50-5b618d12f672 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:04.931136 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6945ba47-8869-4b39-888f-649a85629829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:04.933108 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6945ba47-8869-4b39-888f-649a85629829 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:04.933656 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6945ba47-8869-4b39-888f-649a85629829 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:04.934099 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6945ba47-8869-4b39-888f-649a85629829 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:04.935390 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6945ba47-8869-4b39-888f-649a85629829 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:04.938119 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6945ba47-8869-4b39-888f-649a85629829 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:04.951865 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 884/1784] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:26:04 2021] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:26:04.954475 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e473109f-2bae-4f8a-9af2-0e34c9a1c2ec None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:04.959685 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e473109f-2bae-4f8a-9af2-0e34c9a1c2ec None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:04.959685 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e473109f-2bae-4f8a-9af2-0e34c9a1c2ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:04.966370 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 901/1785] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:04 2021] POST /identity/v3/auth/tokens => generated 3421 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:26:04.967376 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fb7c6d-37d7-41ac-bdd8-62abbd496cfd None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:04.968843 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-39fb7c6d-37d7-41ac-bdd8-62abbd496cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:04.982165 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-e473109f-2bae-4f8a-9af2-0e34c9a1c2ec None None] MFA Rules not processed for user `3417097a280b499086b36df9a2548239`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:04.984514 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-e473109f-2bae-4f8a-9af2-0e34c9a1c2ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:04.988768 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fb7c6d-37d7-41ac-bdd8-62abbd496cfd None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:04.991704 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f170ee8-11b8-451f-b21a-ad3630408f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:04.992582 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f170ee8-11b8-451f-b21a-ad3630408f0a admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:04.992869 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f170ee8-11b8-451f-b21a-ad3630408f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:04.993152 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f170ee8-11b8-451f-b21a-ad3630408f0a admin admin] PATH_INFO: `/v3/projects` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:04.993903 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f170ee8-11b8-451f-b21a-ad3630408f0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:04.995976 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f170ee8-11b8-451f-b21a-ad3630408f0a admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:05.104820 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 902/1786] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:26:04 2021] POST /identity/v3/projects => generated 387 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:26:05.104820 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f170ee8-11b8-451f-b21a-ad3630408f0a admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:05.111071 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 885/1787] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Oct 12 18:26:04 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:26:05.113843 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e473109f-2bae-4f8a-9af2-0e34c9a1c2ec None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:05.114014 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-e473109f-2bae-4f8a-9af2-0e34c9a1c2ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:05.145513 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e473109f-2bae-4f8a-9af2-0e34c9a1c2ec None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:05.272458 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194d28b2-f3aa-403d-9c81-fccfbbacd13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:05.273630 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d28b2-f3aa-403d-9c81-fccfbbacd13e admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:05.274912 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d28b2-f3aa-403d-9c81-fccfbbacd13e admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:05.275507 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d28b2-f3aa-403d-9c81-fccfbbacd13e admin admin] PATH_INFO: `/v3/projects` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:05.276807 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194d28b2-f3aa-403d-9c81-fccfbbacd13e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:05.281964 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194d28b2-f3aa-403d-9c81-fccfbbacd13e admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:05.321344 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f170ee8-11b8-451f-b21a-ad3630408f0a admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:05.328651 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be76abfa-7d0a-45d3-b960-c1ac8be44ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:05.330124 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be76abfa-7d0a-45d3-b960-c1ac8be44ef6 admin admin] REQUEST_METHOD: `PUT` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:05.330697 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be76abfa-7d0a-45d3-b960-c1ac8be44ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:05.331201 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be76abfa-7d0a-45d3-b960-c1ac8be44ef6 admin admin] PATH_INFO: `/v3/projects/d3efb4920b3a4608bcd477cd80ca6010/users/919ec0a172924ed283fd04a624ed8a98/roles/6c54f239944d46e3b027ccce97eb8b49` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:05.335336 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be76abfa-7d0a-45d3-b960-c1ac8be44ef6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3efb4920b3a4608bcd477cd80ca6010, user_id=919ec0a172924ed283fd04a624ed8a98, role_id=6c54f239944d46e3b027ccce97eb8b49)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:05.338761 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be76abfa-7d0a-45d3-b960-c1ac8be44ef6 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:05.368443 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 903/1788] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:26:05 2021] PUT /identity/v3/projects/d3efb4920b3a4608bcd477cd80ca6010/users/919ec0a172924ed283fd04a624ed8a98/roles/6c54f239944d46e3b027ccce97eb8b49 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:26:05.368443 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be76abfa-7d0a-45d3-b960-c1ac8be44ef6 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:05.432920 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 886/1789] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:26:05 2021] POST /identity/v3/projects => generated 399 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:26:05.439383 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5e960-2327-41ce-978a-51d2e0534fea None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:05.439683 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5e960-2327-41ce-978a-51d2e0534fea None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:05.439934 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5e960-2327-41ce-978a-51d2e0534fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:05.471234 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-edc5e960-2327-41ce-978a-51d2e0534fea None None] MFA Rules not processed for user `919ec0a172924ed283fd04a624ed8a98`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:05.472519 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-edc5e960-2327-41ce-978a-51d2e0534fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:05.488570 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be76abfa-7d0a-45d3-b960-c1ac8be44ef6 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:05.556529 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 887/1790] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:05 2021] POST /identity/v3/auth/tokens => generated 3474 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:26:05.557498 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc5e960-2327-41ce-978a-51d2e0534fea None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:05.575300 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f928d4ab-fc69-4179-92a8-90aa2e19b373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:05.578166 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f928d4ab-fc69-4179-92a8-90aa2e19b373 admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:05.578166 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f928d4ab-fc69-4179-92a8-90aa2e19b373 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:05.578166 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f928d4ab-fc69-4179-92a8-90aa2e19b373 admin admin] PATH_INFO: `/v3/users` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:05.578166 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f928d4ab-fc69-4179-92a8-90aa2e19b373 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:05.581891 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f928d4ab-fc69-4179-92a8-90aa2e19b373 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:05.626545 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc5e960-2327-41ce-978a-51d2e0534fea None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:05.632272 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3857c1ff-7a99-4d1f-8557-60a86592ede3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:05.632987 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3857c1ff-7a99-4d1f-8557-60a86592ede3 admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:05.633269 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3857c1ff-7a99-4d1f-8557-60a86592ede3 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:05.633605 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3857c1ff-7a99-4d1f-8557-60a86592ede3 admin admin] PATH_INFO: `/v3/users` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:05.634314 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3857c1ff-7a99-4d1f-8557-60a86592ede3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:05.636233 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3857c1ff-7a99-4d1f-8557-60a86592ede3 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:05.720005 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 904/1791] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:26:05 2021] POST /identity/v3/users => generated 300 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:26:05.720005 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f928d4ab-fc69-4179-92a8-90aa2e19b373 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:05.723794 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-f928d4ab-fc69-4179-92a8-90aa2e19b373 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:05.779362 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 888/1792] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:26:05 2021] POST /identity/v3/users => generated 306 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:26:05.780550 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3857c1ff-7a99-4d1f-8557-60a86592ede3 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:05.785605 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-3857c1ff-7a99-4d1f-8557-60a86592ede3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:05.847221 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f928d4ab-fc69-4179-92a8-90aa2e19b373 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:05.872608 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811230df-7d1f-448d-b87d-abc1b5d07a1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3417097a280b499086b36df9a2548239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:05.873385 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811230df-7d1f-448d-b87d-abc1b5d07a1d service nova] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:05.873732 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811230df-7d1f-448d-b87d-abc1b5d07a1d service nova] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:05.874100 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811230df-7d1f-448d-b87d-abc1b5d07a1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:05.886537 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811230df-7d1f-448d-b87d-abc1b5d07a1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:05.888808 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811230df-7d1f-448d-b87d-abc1b5d07a1d service nova] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:05.904601 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3857c1ff-7a99-4d1f-8557-60a86592ede3 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:05.912734 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c72ac63-52ca-4eb4-aff1-c7e228aa9313 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6966ce0774f4437a9b688494e9d0574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:05.917297 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c72ac63-52ca-4eb4-aff1-c7e228aa9313 service cinder] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:05.917297 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c72ac63-52ca-4eb4-aff1-c7e228aa9313 service cinder] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:05.917297 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c72ac63-52ca-4eb4-aff1-c7e228aa9313 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:05.918723 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 905/1793] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:26:05 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:26:05.919760 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811230df-7d1f-448d-b87d-abc1b5d07a1d service nova] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:05.941296 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c72ac63-52ca-4eb4-aff1-c7e228aa9313 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:05.943804 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c72ac63-52ca-4eb4-aff1-c7e228aa9313 service cinder] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:05.968825 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811230df-7d1f-448d-b87d-abc1b5d07a1d service nova] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:05.972902 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bcc561-6e94-489b-bb0e-f139bd368062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:05.974160 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bcc561-6e94-489b-bb0e-f139bd368062 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:05.974634 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 889/1794] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:26:05 2021] GET /identity/v3/auth/tokens => generated 3474 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:26:05.974757 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bcc561-6e94-489b-bb0e-f139bd368062 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:05.974757 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bcc561-6e94-489b-bb0e-f139bd368062 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:05.976944 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bcc561-6e94-489b-bb0e-f139bd368062 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:05.977309 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c72ac63-52ca-4eb4-aff1-c7e228aa9313 service cinder] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:05.981931 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bcc561-6e94-489b-bb0e-f139bd368062 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:06.020656 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 906/1795] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:26:05 2021] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:26:06.020656 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bcc561-6e94-489b-bb0e-f139bd368062 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:06.028999 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c72ac63-52ca-4eb4-aff1-c7e228aa9313 service cinder] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:06.044312 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-b0bcc561-6e94-489b-bb0e-f139bd368062 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:06.054938 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3275f4ac-f74f-4b96-9292-5bec28180d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:06.055642 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275f4ac-f74f-4b96-9292-5bec28180d12 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:06.056441 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275f4ac-f74f-4b96-9292-5bec28180d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:06.056760 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275f4ac-f74f-4b96-9292-5bec28180d12 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:06.065286 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3275f4ac-f74f-4b96-9292-5bec28180d12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:06.067540 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3275f4ac-f74f-4b96-9292-5bec28180d12 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:06.074517 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bcc561-6e94-489b-bb0e-f139bd368062 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:06.095215 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 890/1796] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:26:05 2021] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:26:06.095215 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3275f4ac-f74f-4b96-9292-5bec28180d12 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:06.101039 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252161e2-33db-4846-878f-0b50f6e1370f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:06.102139 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252161e2-33db-4846-878f-0b50f6e1370f admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:06.103420 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252161e2-33db-4846-878f-0b50f6e1370f admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:06.103802 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252161e2-33db-4846-878f-0b50f6e1370f admin admin] PATH_INFO: `/v3/projects/083e19f6dba843879319b9bd255379d3` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:06.114962 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3275f4ac-f74f-4b96-9292-5bec28180d12 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:06.120797 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22c9299-018c-4323-888e-3b49f9b0a608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:06.121709 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c9299-018c-4323-888e-3b49f9b0a608 admin admin] REQUEST_METHOD: `PUT` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:06.121993 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c9299-018c-4323-888e-3b49f9b0a608 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:06.122272 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c9299-018c-4323-888e-3b49f9b0a608 admin admin] PATH_INFO: `/v3/projects/6a3d4b9d9d99452b881398292b5e3482/users/ac994e4a2c844955a529507749e636cf/roles/6c54f239944d46e3b027ccce97eb8b49` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:06.122719 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252161e2-33db-4846-878f-0b50f6e1370f admin admin] RBAC: Authorizing `identity:delete_project(project_id=083e19f6dba843879319b9bd255379d3)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:06.135916 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252161e2-33db-4846-878f-0b50f6e1370f admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:06.145603 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22c9299-018c-4323-888e-3b49f9b0a608 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a3d4b9d9d99452b881398292b5e3482, user_id=ac994e4a2c844955a529507749e636cf, role_id=6c54f239944d46e3b027ccce97eb8b49)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:06.148633 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22c9299-018c-4323-888e-3b49f9b0a608 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:06.231203 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 891/1797] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:26:06 2021] PUT /identity/v3/projects/6a3d4b9d9d99452b881398292b5e3482/users/ac994e4a2c844955a529507749e636cf/roles/6c54f239944d46e3b027ccce97eb8b49 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:26:06.232695 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22c9299-018c-4323-888e-3b49f9b0a608 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:06.321855 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-252161e2-33db-4846-878f-0b50f6e1370f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '083e19f6dba843879319b9bd255379d3', 'request_id': 'req-252161e2-33db-4846-878f-0b50f6e1370f'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:06.334439 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-252161e2-33db-4846-878f-0b50f6e1370f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '083e19f6dba843879319b9bd255379d3', 'request_id': 'req-252161e2-33db-4846-878f-0b50f6e1370f'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:06.337248 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22c9299-018c-4323-888e-3b49f9b0a608 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:06.340541 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-252161e2-33db-4846-878f-0b50f6e1370f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '083e19f6dba843879319b9bd255379d3', 'request_id': 'req-252161e2-33db-4846-878f-0b50f6e1370f'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:06.402163 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1717ec-ac99-4d9f-972c-b61f0f7a455d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:06.411202 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1717ec-ac99-4d9f-972c-b61f0f7a455d admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:06.411202 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1717ec-ac99-4d9f-972c-b61f0f7a455d admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:06.411202 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1717ec-ac99-4d9f-972c-b61f0f7a455d admin admin] PATH_INFO: `/v3/users/fe56c5acb0ef49cf9ef9e95b8ccd3775` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:06.411202 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1717ec-ac99-4d9f-972c-b61f0f7a455d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe56c5acb0ef49cf9ef9e95b8ccd3775)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:06.411202 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1717ec-ac99-4d9f-972c-b61f0f7a455d admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:06.572683 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-252161e2-33db-4846-878f-0b50f6e1370f admin admin] The token cache is being invalidate because project 083e19f6dba843879319b9bd255379d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74005) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:26:06.572683 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-252161e2-33db-4846-878f-0b50f6e1370f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:06.572683 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-252161e2-33db-4846-878f-0b50f6e1370f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:06.577815 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 907/1798] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:26:06 2021] DELETE /identity/v3/projects/083e19f6dba843879319b9bd255379d3 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:26:06.577815 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252161e2-33db-4846-878f-0b50f6e1370f admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:06.585640 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-252161e2-33db-4846-878f-0b50f6e1370f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:06.604974 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252161e2-33db-4846-878f-0b50f6e1370f admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:06.622582 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d634bb8-77fa-4ef2-9805-e782c4341a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:06.632192 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d634bb8-77fa-4ef2-9805-e782c4341a5d admin admin] REQUEST_METHOD: `PUT` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:06.632192 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d634bb8-77fa-4ef2-9805-e782c4341a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:06.632192 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d634bb8-77fa-4ef2-9805-e782c4341a5d admin admin] PATH_INFO: `/v3/projects/aa48eacd83fb4c71b9607ac6e8ae9e29/users/8c7a3dd8712c4db49caf77a4f69846e9/roles/6c54f239944d46e3b027ccce97eb8b49` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:06.655396 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d634bb8-77fa-4ef2-9805-e782c4341a5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa48eacd83fb4c71b9607ac6e8ae9e29, user_id=8c7a3dd8712c4db49caf77a4f69846e9, role_id=6c54f239944d46e3b027ccce97eb8b49)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:06.658826 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d634bb8-77fa-4ef2-9805-e782c4341a5d admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:06.683568 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-eb1717ec-ac99-4d9f-972c-b61f0f7a455d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe56c5acb0ef49cf9ef9e95b8ccd3775'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:06.692894 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-eb1717ec-ac99-4d9f-972c-b61f0f7a455d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe56c5acb0ef49cf9ef9e95b8ccd3775'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:06.709386 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-eb1717ec-ac99-4d9f-972c-b61f0f7a455d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe56c5acb0ef49cf9ef9e95b8ccd3775'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:06.782621 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 908/1799] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:26:06 2021] PUT /identity/v3/projects/aa48eacd83fb4c71b9607ac6e8ae9e29/users/8c7a3dd8712c4db49caf77a4f69846e9/roles/6c54f239944d46e3b027ccce97eb8b49 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:26:06.786899 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d634bb8-77fa-4ef2-9805-e782c4341a5d admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:06.788702 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-8d634bb8-77fa-4ef2-9805-e782c4341a5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:06.823950 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-eb1717ec-ac99-4d9f-972c-b61f0f7a455d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe56c5acb0ef49cf9ef9e95b8ccd3775'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:06.824727 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-eb1717ec-ac99-4d9f-972c-b61f0f7a455d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe56c5acb0ef49cf9ef9e95b8ccd3775'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:06.835899 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 892/1800] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:26:06 2021] DELETE /identity/v3/users/fe56c5acb0ef49cf9ef9e95b8ccd3775 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:26:06.838515 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ecc9ad-8d87-40f0-9ae2-548b70bd1202 None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:06.838892 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ecc9ad-8d87-40f0-9ae2-548b70bd1202 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:06.839160 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ecc9ad-8d87-40f0-9ae2-548b70bd1202 None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:06.842494 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 893/1801] 10.222.0.18 () {54 vars in 921 bytes} [Tue Oct 12 18:26:06 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:26:06.844840 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960a51f-d746-4d80-9561-72cf8203618a None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:06.845554 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960a51f-d746-4d80-9561-72cf8203618a None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:06.846074 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960a51f-d746-4d80-9561-72cf8203618a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:06.878686 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d634bb8-77fa-4ef2-9805-e782c4341a5d admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:06.880770 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-b960a51f-d746-4d80-9561-72cf8203618a None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:06.882796 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-b960a51f-d746-4d80-9561-72cf8203618a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:06.972381 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b994f6-b5f2-4a32-8f1e-8599b11a010d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:06.974394 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b994f6-b5f2-4a32-8f1e-8599b11a010d admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:06.974677 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b994f6-b5f2-4a32-8f1e-8599b11a010d admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:06.974996 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b994f6-b5f2-4a32-8f1e-8599b11a010d admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:06.976241 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b994f6-b5f2-4a32-8f1e-8599b11a010d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:06.978339 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b994f6-b5f2-4a32-8f1e-8599b11a010d admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:06.993543 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 894/1802] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:26:06.994696 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b960a51f-d746-4d80-9561-72cf8203618a None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:06.996796 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 909/1803] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:26:06 2021] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:26:06.998768 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a8e7d4-cce4-414c-b7c7-72114815f104 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:06.999143 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a8e7d4-cce4-414c-b7c7-72114815f104 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:06.999332 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a8e7d4-cce4-414c-b7c7-72114815f104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:07.001088 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-b960a51f-d746-4d80-9561-72cf8203618a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:07.022653 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b960a51f-d746-4d80-9561-72cf8203618a None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:07.039173 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-70a8e7d4-cce4-414c-b7c7-72114815f104 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:07.039716 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5c8fb4-7a73-4d1c-a70c-03151c865d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:07.040471 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c8fb4-7a73-4d1c-a70c-03151c865d47 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:07.040812 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c8fb4-7a73-4d1c-a70c-03151c865d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:07.041157 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c8fb4-7a73-4d1c-a70c-03151c865d47 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:07.041920 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5c8fb4-7a73-4d1c-a70c-03151c865d47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:07.042028 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-70a8e7d4-cce4-414c-b7c7-72114815f104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:07.043726 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5c8fb4-7a73-4d1c-a70c-03151c865d47 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:07.064648 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 895/1804] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:26:06 2021] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:26:07.068418 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d9971-4671-4fbe-9929-0e8819913d0e None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:07.069120 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d9971-4671-4fbe-9929-0e8819913d0e None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:07.069970 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d9971-4671-4fbe-9929-0e8819913d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:07.077115 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 910/1805] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:26:07.079154 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f9f8aa-70d5-42d3-87b1-084cad005107 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:07.079542 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f9f8aa-70d5-42d3-87b1-084cad005107 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:07.079880 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f9f8aa-70d5-42d3-87b1-084cad005107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:07.104983 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-82f9f8aa-70d5-42d3-87b1-084cad005107 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:07.108683 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-82f9f8aa-70d5-42d3-87b1-084cad005107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:07.120459 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 911/1806] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:26:07.120459 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f9f8aa-70d5-42d3-87b1-084cad005107 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:07.120459 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-82f9f8aa-70d5-42d3-87b1-084cad005107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:07.131911 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-b20d9971-4671-4fbe-9929-0e8819913d0e None None] MFA Rules not processed for user `3417097a280b499086b36df9a2548239`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:07.135596 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f9f8aa-70d5-42d3-87b1-084cad005107 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:07.140347 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-b20d9971-4671-4fbe-9929-0e8819913d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:07.142626 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901a6d00-a030-4138-870d-74025df4a4de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:07.143662 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a6d00-a030-4138-870d-74025df4a4de admin admin] REQUEST_METHOD: `PUT` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:07.144261 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a6d00-a030-4138-870d-74025df4a4de admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:07.144780 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a6d00-a030-4138-870d-74025df4a4de admin admin] PATH_INFO: `/v3/projects/6a3d4b9d9d99452b881398292b5e3482/users/ac994e4a2c844955a529507749e636cf/roles/6c54f239944d46e3b027ccce97eb8b49` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:07.147814 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901a6d00-a030-4138-870d-74025df4a4de admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a3d4b9d9d99452b881398292b5e3482, user_id=ac994e4a2c844955a529507749e636cf, role_id=6c54f239944d46e3b027ccce97eb8b49)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:07.167444 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901a6d00-a030-4138-870d-74025df4a4de admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:07.199099 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 912/1807] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:26:07 2021] PUT /identity/v3/projects/6a3d4b9d9d99452b881398292b5e3482/users/ac994e4a2c844955a529507749e636cf/roles/6c54f239944d46e3b027ccce97eb8b49 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:26:07.200596 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901a6d00-a030-4138-870d-74025df4a4de admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:07.294499 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 896/1808] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Oct 12 18:26:07 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:26:07.295656 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20d9971-4671-4fbe-9929-0e8819913d0e None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:07.304495 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901a6d00-a030-4138-870d-74025df4a4de admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:07.308847 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20d9971-4671-4fbe-9929-0e8819913d0e None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:07.315216 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b5caf7-6764-49f2-82d2-f1bdb5c8050d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:07.316194 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b5caf7-6764-49f2-82d2-f1bdb5c8050d admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:07.316773 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b5caf7-6764-49f2-82d2-f1bdb5c8050d admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:07.317468 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b5caf7-6764-49f2-82d2-f1bdb5c8050d admin admin] PATH_INFO: `/v3/domains` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:07.318585 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b5caf7-6764-49f2-82d2-f1bdb5c8050d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:26:07.319113 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b5caf7-6764-49f2-82d2-f1bdb5c8050d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:07.321178 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b5caf7-6764-49f2-82d2-f1bdb5c8050d admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:07.329377 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d671d393-80ef-4079-b3d5-3d20c667fd4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:07.330301 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d671d393-80ef-4079-b3d5-3d20c667fd4b admin admin] REQUEST_METHOD: `PUT` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:07.330601 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d671d393-80ef-4079-b3d5-3d20c667fd4b admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:07.330848 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d671d393-80ef-4079-b3d5-3d20c667fd4b admin admin] PATH_INFO: `/v3/projects/aa48eacd83fb4c71b9607ac6e8ae9e29/users/8c7a3dd8712c4db49caf77a4f69846e9/roles/6c54f239944d46e3b027ccce97eb8b49` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:07.336104 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d671d393-80ef-4079-b3d5-3d20c667fd4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa48eacd83fb4c71b9607ac6e8ae9e29, user_id=8c7a3dd8712c4db49caf77a4f69846e9, role_id=6c54f239944d46e3b027ccce97eb8b49)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:07.338888 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 897/1809] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 12 18:26:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:26:07.340053 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b5caf7-6764-49f2-82d2-f1bdb5c8050d admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:07.345253 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d671d393-80ef-4079-b3d5-3d20c667fd4b admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:07.345597 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-b9b5caf7-6764-49f2-82d2-f1bdb5c8050d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:07.363277 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 913/1810] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:26:07 2021] PUT /identity/v3/projects/aa48eacd83fb4c71b9607ac6e8ae9e29/users/8c7a3dd8712c4db49caf77a4f69846e9/roles/6c54f239944d46e3b027ccce97eb8b49 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:26:07.365719 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92a2a4d-e304-4faa-88d5-2f6ae2ade99a None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:07.365975 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92a2a4d-e304-4faa-88d5-2f6ae2ade99a None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:07.366252 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92a2a4d-e304-4faa-88d5-2f6ae2ade99a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:07.412099 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-d92a2a4d-e304-4faa-88d5-2f6ae2ade99a None None] MFA Rules not processed for user `ac994e4a2c844955a529507749e636cf`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:07.412788 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-d92a2a4d-e304-4faa-88d5-2f6ae2ade99a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:07.430765 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b5caf7-6764-49f2-82d2-f1bdb5c8050d admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:07.491218 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb70d327-edd3-4c2e-a4e3-458d70e9fa59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:07.491886 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb70d327-edd3-4c2e-a4e3-458d70e9fa59 service neutron] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:07.492172 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb70d327-edd3-4c2e-a4e3-458d70e9fa59 service neutron] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:07.492481 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb70d327-edd3-4c2e-a4e3-458d70e9fa59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:07.509120 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 914/1811] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:07 2021] POST /identity/v3/auth/tokens => generated 3474 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:26:07.515499 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92a2a4d-e304-4faa-88d5-2f6ae2ade99a None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:07.517362 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-d92a2a4d-e304-4faa-88d5-2f6ae2ade99a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:07.577864 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb70d327-edd3-4c2e-a4e3-458d70e9fa59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:07.580201 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb70d327-edd3-4c2e-a4e3-458d70e9fa59 service neutron] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:07.595297 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 898/1812] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:26:07 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:26:07.596603 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb70d327-edd3-4c2e-a4e3-458d70e9fa59 service neutron] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:07.611827 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb70d327-edd3-4c2e-a4e3-458d70e9fa59 service neutron] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:07.614849 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc369f9f-dfde-407c-af1f-a1d774c6bf92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:07.616214 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc369f9f-dfde-407c-af1f-a1d774c6bf92 admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:07.616536 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc369f9f-dfde-407c-af1f-a1d774c6bf92 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:07.617504 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc369f9f-dfde-407c-af1f-a1d774c6bf92 admin admin] PATH_INFO: `/v3/projects` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:07.620436 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc369f9f-dfde-407c-af1f-a1d774c6bf92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:07.620629 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92a2a4d-e304-4faa-88d5-2f6ae2ade99a None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:07.622558 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc369f9f-dfde-407c-af1f-a1d774c6bf92 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:07.630742 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88265c1-dd64-4571-92f9-6b9b31bf7cbe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3417097a280b499086b36df9a2548239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:07.631847 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88265c1-dd64-4571-92f9-6b9b31bf7cbe service nova] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:07.632128 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88265c1-dd64-4571-92f9-6b9b31bf7cbe service nova] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:07.632415 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88265c1-dd64-4571-92f9-6b9b31bf7cbe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:07.643723 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88265c1-dd64-4571-92f9-6b9b31bf7cbe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:07.650054 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88265c1-dd64-4571-92f9-6b9b31bf7cbe service nova] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:07.657603 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 915/1813] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:26:07 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:26:07.658852 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1748f43b-3187-47b7-84c5-5c92659e6ef3 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:07.659172 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1748f43b-3187-47b7-84c5-5c92659e6ef3 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:07.659414 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1748f43b-3187-47b7-84c5-5c92659e6ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:07.698707 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-1748f43b-3187-47b7-84c5-5c92659e6ef3 None None] MFA Rules not processed for user `8c7a3dd8712c4db49caf77a4f69846e9`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:07.701767 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-1748f43b-3187-47b7-84c5-5c92659e6ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:07.724001 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 899/1814] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:26:07 2021] POST /identity/v3/projects => generated 375 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:26:07.724001 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc369f9f-dfde-407c-af1f-a1d774c6bf92 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:07.731145 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-dc369f9f-dfde-407c-af1f-a1d774c6bf92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:07.846607 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc369f9f-dfde-407c-af1f-a1d774c6bf92 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:07.852272 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb3a95b-b197-4d6d-beec-b3ead432d447 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6966ce0774f4437a9b688494e9d0574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:07.852972 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb3a95b-b197-4d6d-beec-b3ead432d447 service cinder] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:07.853256 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb3a95b-b197-4d6d-beec-b3ead432d447 service cinder] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:07.853586 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb3a95b-b197-4d6d-beec-b3ead432d447 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:07.861003 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 916/1815] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:07 2021] POST /identity/v3/auth/tokens => generated 3486 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:26:07.862498 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1748f43b-3187-47b7-84c5-5c92659e6ef3 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:07.950552 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb3a95b-b197-4d6d-beec-b3ead432d447 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:07.952005 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb3a95b-b197-4d6d-beec-b3ead432d447 service cinder] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:07.963305 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 900/1816] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:26:07 2021] GET /identity/v3/auth/tokens => generated 3474 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:26:07.966965 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1748f43b-3187-47b7-84c5-5c92659e6ef3 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:07.976672 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d3e2b6-f704-4f3f-9927-1267c08aea9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:07.978439 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d3e2b6-f704-4f3f-9927-1267c08aea9b admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:07.978871 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d3e2b6-f704-4f3f-9927-1267c08aea9b admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:07.979291 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d3e2b6-f704-4f3f-9927-1267c08aea9b admin admin] PATH_INFO: `/v3/users` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:07.980443 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d3e2b6-f704-4f3f-9927-1267c08aea9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:07.984650 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d3e2b6-f704-4f3f-9927-1267c08aea9b admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:08.000900 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb3a95b-b197-4d6d-beec-b3ead432d447 service cinder] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:08.013240 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb3a95b-b197-4d6d-beec-b3ead432d447 service cinder] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:08.017958 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99be04d1-59a7-4289-83c7-e070057fadeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:08.018841 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be04d1-59a7-4289-83c7-e070057fadeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:08.019292 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be04d1-59a7-4289-83c7-e070057fadeb admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:08.019407 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be04d1-59a7-4289-83c7-e070057fadeb admin admin] PATH_INFO: `/v3/users/c8aa6cc9d5134296b16285e99aeda37c` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:08.021231 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99be04d1-59a7-4289-83c7-e070057fadeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8aa6cc9d5134296b16285e99aeda37c)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:08.023224 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99be04d1-59a7-4289-83c7-e070057fadeb admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:08.125369 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 917/1817] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:26:07 2021] POST /identity/v3/users => generated 288 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:26:08.126722 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d3e2b6-f704-4f3f-9927-1267c08aea9b admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:08.148883 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d3e2b6-f704-4f3f-9927-1267c08aea9b admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:08.156324 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d786c1d-34d7-41c9-b8ff-b5654a6fd701 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6966ce0774f4437a9b688494e9d0574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:08.157506 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d786c1d-34d7-41c9-b8ff-b5654a6fd701 service cinder] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:08.157980 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d786c1d-34d7-41c9-b8ff-b5654a6fd701 service cinder] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:08.159177 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d786c1d-34d7-41c9-b8ff-b5654a6fd701 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:08.170227 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d786c1d-34d7-41c9-b8ff-b5654a6fd701 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:08.172022 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d786c1d-34d7-41c9-b8ff-b5654a6fd701 service cinder] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:08.184999 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 918/1818] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:26:08 2021] GET /identity/v3/auth/tokens => generated 3486 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:26:08.186522 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d786c1d-34d7-41c9-b8ff-b5654a6fd701 service cinder] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:08.204756 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d786c1d-34d7-41c9-b8ff-b5654a6fd701 service cinder] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:08.212526 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23acab0-7586-496e-bd48-207f6b73472d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:08.213559 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23acab0-7586-496e-bd48-207f6b73472d admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:08.213559 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23acab0-7586-496e-bd48-207f6b73472d admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:08.213757 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23acab0-7586-496e-bd48-207f6b73472d admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:08.215005 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23acab0-7586-496e-bd48-207f6b73472d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:08.218245 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23acab0-7586-496e-bd48-207f6b73472d admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:08.230835 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 919/1819] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:26:08 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:26:08.234938 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23acab0-7586-496e-bd48-207f6b73472d admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:08.247092 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23acab0-7586-496e-bd48-207f6b73472d admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:08.253513 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf25ab1-9759-4e74-9cbd-cffa2403a803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:08.253816 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf25ab1-9759-4e74-9cbd-cffa2403a803 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:08.254163 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf25ab1-9759-4e74-9cbd-cffa2403a803 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:08.254945 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf25ab1-9759-4e74-9cbd-cffa2403a803 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:08.256009 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf25ab1-9759-4e74-9cbd-cffa2403a803 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:08.256502 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-99be04d1-59a7-4289-83c7-e070057fadeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8aa6cc9d5134296b16285e99aeda37c'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:08.257681 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf25ab1-9759-4e74-9cbd-cffa2403a803 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:08.272034 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-99be04d1-59a7-4289-83c7-e070057fadeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8aa6cc9d5134296b16285e99aeda37c'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:08.274303 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 920/1820] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:26:08 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 18:26:08.281046 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf25ab1-9759-4e74-9cbd-cffa2403a803 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:08.289576 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf25ab1-9759-4e74-9cbd-cffa2403a803 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:08.295767 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-99be04d1-59a7-4289-83c7-e070057fadeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8aa6cc9d5134296b16285e99aeda37c'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:08.297319 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0266a0-5d2c-488e-bad2-e460c8c763ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:08.297677 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0266a0-5d2c-488e-bad2-e460c8c763ff admin admin] REQUEST_METHOD: `PUT` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:08.298006 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0266a0-5d2c-488e-bad2-e460c8c763ff admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:08.298153 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0266a0-5d2c-488e-bad2-e460c8c763ff admin admin] PATH_INFO: `/v3/projects/227abc7af06b46c79c4682c7bd82e316/users/bb6d2b02e646406aaadb089f9243f98e/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:08.317687 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0266a0-5d2c-488e-bad2-e460c8c763ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=227abc7af06b46c79c4682c7bd82e316, user_id=bb6d2b02e646406aaadb089f9243f98e, role_id=33b8a5a8d1d643f2a98f598e6ab0a1cf)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:08.321976 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0266a0-5d2c-488e-bad2-e460c8c763ff admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:08.389591 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-99be04d1-59a7-4289-83c7-e070057fadeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8aa6cc9d5134296b16285e99aeda37c'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:08.390666 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-99be04d1-59a7-4289-83c7-e070057fadeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8aa6cc9d5134296b16285e99aeda37c'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:08.403531 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 901/1821] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:26:07 2021] DELETE /identity/v3/users/c8aa6cc9d5134296b16285e99aeda37c => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:26:08.407930 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e7a988-6cf4-4e12-9be5-3c650ee60b74 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:08.408729 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e7a988-6cf4-4e12-9be5-3c650ee60b74 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:08.409220 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e7a988-6cf4-4e12-9be5-3c650ee60b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:08.430833 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-a4e7a988-6cf4-4e12-9be5-3c650ee60b74 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:08.432647 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 921/1822] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:26:08 2021] PUT /identity/v3/projects/227abc7af06b46c79c4682c7bd82e316/users/bb6d2b02e646406aaadb089f9243f98e/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:26:08.433304 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-a4e7a988-6cf4-4e12-9be5-3c650ee60b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:08.452191 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aff1fb-1769-4f47-a721-24205b10aa21 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:08.456144 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aff1fb-1769-4f47-a721-24205b10aa21 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:08.456144 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aff1fb-1769-4f47-a721-24205b10aa21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:08.508808 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 902/1823] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:26:08.509791 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e7a988-6cf4-4e12-9be5-3c650ee60b74 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:08.511235 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-a4e7a988-6cf4-4e12-9be5-3c650ee60b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:08.528912 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-a5aff1fb-1769-4f47-a721-24205b10aa21 None None] MFA Rules not processed for user `bb6d2b02e646406aaadb089f9243f98e`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:08.531702 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-a5aff1fb-1769-4f47-a721-24205b10aa21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:08.635832 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e7a988-6cf4-4e12-9be5-3c650ee60b74 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:08.642775 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c255e685-4178-4b83-8e87-c4bc9386ce6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6966ce0774f4437a9b688494e9d0574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:08.644221 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c255e685-4178-4b83-8e87-c4bc9386ce6c service cinder] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:08.645144 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c255e685-4178-4b83-8e87-c4bc9386ce6c service cinder] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:08.645610 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c255e685-4178-4b83-8e87-c4bc9386ce6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:08.648666 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-c255e685-4178-4b83-8e87-c4bc9386ce6c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:08.753558 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 922/1824] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:08 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:26:08.754784 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aff1fb-1769-4f47-a721-24205b10aa21 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:08.756795 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-a5aff1fb-1769-4f47-a721-24205b10aa21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:08.787279 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c255e685-4178-4b83-8e87-c4bc9386ce6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:08.790333 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c255e685-4178-4b83-8e87-c4bc9386ce6c service cinder] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:08.822426 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 903/1825] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:26:08 2021] GET /identity/v3/auth/tokens => generated 3421 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:26:08.823882 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c255e685-4178-4b83-8e87-c4bc9386ce6c service cinder] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:08.833132 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-c255e685-4178-4b83-8e87-c4bc9386ce6c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:08.837825 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aff1fb-1769-4f47-a721-24205b10aa21 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:08.842916 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1fee6e-3cb8-448a-901a-4f3bfca5e162 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:08.843910 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1fee6e-3cb8-448a-901a-4f3bfca5e162 service neutron] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:08.844728 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1fee6e-3cb8-448a-901a-4f3bfca5e162 service neutron] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:08.845196 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1fee6e-3cb8-448a-901a-4f3bfca5e162 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:08.858100 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1fee6e-3cb8-448a-901a-4f3bfca5e162 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:08.860022 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1fee6e-3cb8-448a-901a-4f3bfca5e162 service neutron] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:08.875216 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 923/1826] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:26:08 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:26:08.877003 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1fee6e-3cb8-448a-901a-4f3bfca5e162 service neutron] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:08.879693 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c255e685-4178-4b83-8e87-c4bc9386ce6c service cinder] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:08.880187 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-7c1fee6e-3cb8-448a-901a-4f3bfca5e162 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:08.904190 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b71c3-f6de-4a5b-a1a6-65cc88c2385a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:08.906280 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b71c3-f6de-4a5b-a1a6-65cc88c2385a admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:08.906810 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b71c3-f6de-4a5b-a1a6-65cc88c2385a admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:08.907240 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b71c3-f6de-4a5b-a1a6-65cc88c2385a admin admin] PATH_INFO: `/v3/projects/5998337139764507aedd94669cdb1243` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:08.912036 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327b71c3-f6de-4a5b-a1a6-65cc88c2385a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5998337139764507aedd94669cdb1243)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:08.919960 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327b71c3-f6de-4a5b-a1a6-65cc88c2385a admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:08.974876 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1fee6e-3cb8-448a-901a-4f3bfca5e162 service neutron] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:08.989158 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34057f0-ab68-448d-ba8d-bbeeb2fc81c7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a3d3e5a5cfc4ac3afcece4e55f23552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:08.989888 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34057f0-ab68-448d-ba8d-bbeeb2fc81c7 service glance] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:08.990195 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34057f0-ab68-448d-ba8d-bbeeb2fc81c7 service glance] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:08.990602 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34057f0-ab68-448d-ba8d-bbeeb2fc81c7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:09.012845 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34057f0-ab68-448d-ba8d-bbeeb2fc81c7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:09.016307 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34057f0-ab68-448d-ba8d-bbeeb2fc81c7 service glance] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:09.061621 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 924/1827] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:26:08 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:26:09.142186 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-327b71c3-f6de-4a5b-a1a6-65cc88c2385a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5998337139764507aedd94669cdb1243', 'request_id': 'req-327b71c3-f6de-4a5b-a1a6-65cc88c2385a'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:09.246657 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-327b71c3-f6de-4a5b-a1a6-65cc88c2385a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5998337139764507aedd94669cdb1243', 'request_id': 'req-327b71c3-f6de-4a5b-a1a6-65cc88c2385a'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:09.263636 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-327b71c3-f6de-4a5b-a1a6-65cc88c2385a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5998337139764507aedd94669cdb1243', 'request_id': 'req-327b71c3-f6de-4a5b-a1a6-65cc88c2385a'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:09.286571 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-327b71c3-f6de-4a5b-a1a6-65cc88c2385a admin admin] The token cache is being invalidate because project 5998337139764507aedd94669cdb1243 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:26:09.287210 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-327b71c3-f6de-4a5b-a1a6-65cc88c2385a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:09.288704 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-327b71c3-f6de-4a5b-a1a6-65cc88c2385a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:09.293396 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 904/1828] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:26:08 2021] DELETE /identity/v3/projects/5998337139764507aedd94669cdb1243 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:26:09.302528 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34057f0-ab68-448d-ba8d-bbeeb2fc81c7 service glance] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:09.323421 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34057f0-ab68-448d-ba8d-bbeeb2fc81c7 service glance] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:09.467063 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9883932c-d1b4-4fd9-a472-d14573398005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:09.469028 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883932c-d1b4-4fd9-a472-d14573398005 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:09.470866 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883932c-d1b4-4fd9-a472-d14573398005 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:09.471344 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883932c-d1b4-4fd9-a472-d14573398005 admin admin] PATH_INFO: `/v3/users/919ec0a172924ed283fd04a624ed8a98` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:09.474984 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9883932c-d1b4-4fd9-a472-d14573398005 admin admin] RBAC: Authorizing `identity:delete_user(user_id=919ec0a172924ed283fd04a624ed8a98)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:09.477210 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9883932c-d1b4-4fd9-a472-d14573398005 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:09.729795 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-9883932c-d1b4-4fd9-a472-d14573398005 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '919ec0a172924ed283fd04a624ed8a98'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:09.730607 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-9883932c-d1b4-4fd9-a472-d14573398005 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '919ec0a172924ed283fd04a624ed8a98'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:09.752591 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-9883932c-d1b4-4fd9-a472-d14573398005 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '919ec0a172924ed283fd04a624ed8a98'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:09.753592 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-9883932c-d1b4-4fd9-a472-d14573398005 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '919ec0a172924ed283fd04a624ed8a98'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:09.761538 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-9883932c-d1b4-4fd9-a472-d14573398005 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '919ec0a172924ed283fd04a624ed8a98'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:09.869376 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 925/1829] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:26:09 2021] DELETE /identity/v3/users/919ec0a172924ed283fd04a624ed8a98 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 18:26:10.026172 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b71c3-f6de-4a5b-a1a6-65cc88c2385a admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:10.027782 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-327b71c3-f6de-4a5b-a1a6-65cc88c2385a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:10.060084 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b71c3-f6de-4a5b-a1a6-65cc88c2385a admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:10.143419 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fb2733-bf39-4dff-a8bb-db3d780c7297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:10.146696 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb2733-bf39-4dff-a8bb-db3d780c7297 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:10.146696 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb2733-bf39-4dff-a8bb-db3d780c7297 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:10.146696 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb2733-bf39-4dff-a8bb-db3d780c7297 admin admin] PATH_INFO: `/v3/projects/b13572a973654203a8ce0e52642d2e69` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:10.151656 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fb2733-bf39-4dff-a8bb-db3d780c7297 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b13572a973654203a8ce0e52642d2e69)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:10.154055 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fb2733-bf39-4dff-a8bb-db3d780c7297 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:10.311090 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9883932c-d1b4-4fd9-a472-d14573398005 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:10.313344 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-9883932c-d1b4-4fd9-a472-d14573398005 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:10.336858 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-12fb2733-bf39-4dff-a8bb-db3d780c7297 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b13572a973654203a8ce0e52642d2e69', 'request_id': 'req-12fb2733-bf39-4dff-a8bb-db3d780c7297'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:10.356673 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9883932c-d1b4-4fd9-a472-d14573398005 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:10.440243 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-12fb2733-bf39-4dff-a8bb-db3d780c7297 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b13572a973654203a8ce0e52642d2e69', 'request_id': 'req-12fb2733-bf39-4dff-a8bb-db3d780c7297'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:10.449648 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-12fb2733-bf39-4dff-a8bb-db3d780c7297 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b13572a973654203a8ce0e52642d2e69', 'request_id': 'req-12fb2733-bf39-4dff-a8bb-db3d780c7297'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:10.469679 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc58b621-8721-44c8-a1eb-f91762e0e266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:10.471349 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc58b621-8721-44c8-a1eb-f91762e0e266 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:10.471349 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc58b621-8721-44c8-a1eb-f91762e0e266 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:10.471734 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc58b621-8721-44c8-a1eb-f91762e0e266 admin admin] PATH_INFO: `/v3/users/d0770576fe3047b4af7ec7b9f4640594` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:10.473852 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-12fb2733-bf39-4dff-a8bb-db3d780c7297 admin admin] The token cache is being invalidate because project b13572a973654203a8ce0e52642d2e69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:26:10.474211 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-12fb2733-bf39-4dff-a8bb-db3d780c7297 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:10.475099 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-12fb2733-bf39-4dff-a8bb-db3d780c7297 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:10.475948 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc58b621-8721-44c8-a1eb-f91762e0e266 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0770576fe3047b4af7ec7b9f4640594)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:10.479300 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc58b621-8721-44c8-a1eb-f91762e0e266 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:10.480979 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 905/1830] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:26:10 2021] DELETE /identity/v3/projects/b13572a973654203a8ce0e52642d2e69 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:26:10.487038 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fb2733-bf39-4dff-a8bb-db3d780c7297 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:10.489873 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-12fb2733-bf39-4dff-a8bb-db3d780c7297 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:10.518347 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fb2733-bf39-4dff-a8bb-db3d780c7297 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:10.526374 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c275d1e-eede-49a3-bd17-0e42d3adad75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:10.527433 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c275d1e-eede-49a3-bd17-0e42d3adad75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:10.527714 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c275d1e-eede-49a3-bd17-0e42d3adad75 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:10.528303 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c275d1e-eede-49a3-bd17-0e42d3adad75 admin admin] PATH_INFO: `/v3/users/ac994e4a2c844955a529507749e636cf` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:10.529667 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c275d1e-eede-49a3-bd17-0e42d3adad75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac994e4a2c844955a529507749e636cf)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:10.531724 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c275d1e-eede-49a3-bd17-0e42d3adad75 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:10.701313 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-bc58b621-8721-44c8-a1eb-f91762e0e266 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0770576fe3047b4af7ec7b9f4640594'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:10.702024 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-bc58b621-8721-44c8-a1eb-f91762e0e266 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0770576fe3047b4af7ec7b9f4640594'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:10.713510 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-bc58b621-8721-44c8-a1eb-f91762e0e266 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0770576fe3047b4af7ec7b9f4640594'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:10.714183 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-bc58b621-8721-44c8-a1eb-f91762e0e266 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0770576fe3047b4af7ec7b9f4640594'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:10.721542 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-bc58b621-8721-44c8-a1eb-f91762e0e266 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0770576fe3047b4af7ec7b9f4640594'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:10.768655 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-2c275d1e-eede-49a3-bd17-0e42d3adad75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac994e4a2c844955a529507749e636cf'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:10.776842 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-2c275d1e-eede-49a3-bd17-0e42d3adad75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac994e4a2c844955a529507749e636cf'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:10.777921 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 926/1831] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:26:10 2021] DELETE /identity/v3/users/d0770576fe3047b4af7ec7b9f4640594 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:26:10.778914 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc58b621-8721-44c8-a1eb-f91762e0e266 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:10.780803 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-bc58b621-8721-44c8-a1eb-f91762e0e266 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:10.794761 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-2c275d1e-eede-49a3-bd17-0e42d3adad75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac994e4a2c844955a529507749e636cf'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:10.866491 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc58b621-8721-44c8-a1eb-f91762e0e266 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:10.873119 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e175dc24-cf96-41c1-a3e8-d0b3557a572d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:10.874214 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e175dc24-cf96-41c1-a3e8-d0b3557a572d admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:10.874594 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e175dc24-cf96-41c1-a3e8-d0b3557a572d admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:10.874935 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e175dc24-cf96-41c1-a3e8-d0b3557a572d admin admin] PATH_INFO: `/v3/projects/d3efb4920b3a4608bcd477cd80ca6010` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:10.876270 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e175dc24-cf96-41c1-a3e8-d0b3557a572d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3efb4920b3a4608bcd477cd80ca6010)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:10.878251 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e175dc24-cf96-41c1-a3e8-d0b3557a572d admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:10.886218 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-2c275d1e-eede-49a3-bd17-0e42d3adad75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac994e4a2c844955a529507749e636cf'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:10.892385 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-2c275d1e-eede-49a3-bd17-0e42d3adad75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac994e4a2c844955a529507749e636cf'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:10.894269 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 906/1832] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:26:10 2021] DELETE /identity/v3/users/ac994e4a2c844955a529507749e636cf => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 18:26:10.898702 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d159cc4-0927-46c2-8ec2-e2580c3b1215 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:10.898988 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d159cc4-0927-46c2-8ec2-e2580c3b1215 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:10.899274 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d159cc4-0927-46c2-8ec2-e2580c3b1215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:10.918816 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-8d159cc4-0927-46c2-8ec2-e2580c3b1215 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:10.920119 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-8d159cc4-0927-46c2-8ec2-e2580c3b1215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:11.033373 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 907/1833] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:26:11.055936 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d159cc4-0927-46c2-8ec2-e2580c3b1215 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:11.058401 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-8d159cc4-0927-46c2-8ec2-e2580c3b1215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:11.110166 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-e175dc24-cf96-41c1-a3e8-d0b3557a572d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3efb4920b3a4608bcd477cd80ca6010', 'request_id': 'req-e175dc24-cf96-41c1-a3e8-d0b3557a572d'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:11.124923 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-e175dc24-cf96-41c1-a3e8-d0b3557a572d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3efb4920b3a4608bcd477cd80ca6010', 'request_id': 'req-e175dc24-cf96-41c1-a3e8-d0b3557a572d'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:11.137257 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-e175dc24-cf96-41c1-a3e8-d0b3557a572d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3efb4920b3a4608bcd477cd80ca6010', 'request_id': 'req-e175dc24-cf96-41c1-a3e8-d0b3557a572d'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:11.162926 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d159cc4-0927-46c2-8ec2-e2580c3b1215 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:11.262221 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-e175dc24-cf96-41c1-a3e8-d0b3557a572d admin admin] The token cache is being invalidate because project d3efb4920b3a4608bcd477cd80ca6010 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74005) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:26:11.262801 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-e175dc24-cf96-41c1-a3e8-d0b3557a572d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:11.264178 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-e175dc24-cf96-41c1-a3e8-d0b3557a572d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:11.266488 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dee190f-06a7-4fdf-901b-62437009498a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:11.267632 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dee190f-06a7-4fdf-901b-62437009498a service neutron] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:11.268128 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dee190f-06a7-4fdf-901b-62437009498a service neutron] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:11.268283 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 927/1834] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:26:10 2021] DELETE /identity/v3/projects/d3efb4920b3a4608bcd477cd80ca6010 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:26:11.268982 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dee190f-06a7-4fdf-901b-62437009498a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:11.285016 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf5679-611d-4a15-9248-44895c546371 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:11.286173 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf5679-611d-4a15-9248-44895c546371 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:11.287328 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-3dee190f-06a7-4fdf-901b-62437009498a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:11.287839 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf5679-611d-4a15-9248-44895c546371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:11.327723 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-c5bf5679-611d-4a15-9248-44895c546371 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:11.333317 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-c5bf5679-611d-4a15-9248-44895c546371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:11.461632 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dee190f-06a7-4fdf-901b-62437009498a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:11.463361 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dee190f-06a7-4fdf-901b-62437009498a service neutron] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:11.478395 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 908/1835] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:26:11 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 18:26:11.501504 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 928/1836] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:26:11.503393 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c1d091-b3a0-4d29-9e75-7a895e307e0b None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:11.503830 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c1d091-b3a0-4d29-9e75-7a895e307e0b None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:11.504880 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c1d091-b3a0-4d29-9e75-7a895e307e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:11.530741 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-08c1d091-b3a0-4d29-9e75-7a895e307e0b None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:11.532444 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-08c1d091-b3a0-4d29-9e75-7a895e307e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:11.544451 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 909/1837] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:26:11.546636 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bf5679-611d-4a15-9248-44895c546371 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:11.558941 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bf5679-611d-4a15-9248-44895c546371 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:11.564600 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b924f3c3-087b-40a5-a9c6-265e6a297c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:11.565742 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b924f3c3-087b-40a5-a9c6-265e6a297c69 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:11.566176 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b924f3c3-087b-40a5-a9c6-265e6a297c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:11.567164 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b924f3c3-087b-40a5-a9c6-265e6a297c69 admin admin] PATH_INFO: `/v3/domains` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:11.568318 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b924f3c3-087b-40a5-a9c6-265e6a297c69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:26:11.568874 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b924f3c3-087b-40a5-a9c6-265e6a297c69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:11.571096 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b924f3c3-087b-40a5-a9c6-265e6a297c69 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:11.587605 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 929/1838] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 12 18:26:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:26:11.591895 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c1d091-b3a0-4d29-9e75-7a895e307e0b None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:11.609561 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c1d091-b3a0-4d29-9e75-7a895e307e0b None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:11.615598 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91c6d4c-d336-441f-af0e-8fc26d57b241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:11.616609 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c6d4c-d336-441f-af0e-8fc26d57b241 admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:11.616897 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c6d4c-d336-441f-af0e-8fc26d57b241 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:11.617357 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c6d4c-d336-441f-af0e-8fc26d57b241 admin admin] PATH_INFO: `/v3/projects` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:11.617908 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91c6d4c-d336-441f-af0e-8fc26d57b241 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:11.620316 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91c6d4c-d336-441f-af0e-8fc26d57b241 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:11.692953 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b924f3c3-087b-40a5-a9c6-265e6a297c69 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:11.694865 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-b924f3c3-087b-40a5-a9c6-265e6a297c69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:11.705320 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 910/1839] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:26:11 2021] POST /identity/v3/projects => generated 409 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:26:11.710310 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91c6d4c-d336-441f-af0e-8fc26d57b241 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:11.714150 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b924f3c3-087b-40a5-a9c6-265e6a297c69 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:11.780439 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91c6d4c-d336-441f-af0e-8fc26d57b241 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:11.796002 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc5a27e-8389-4a95-b9c4-75d89dfda4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:11.796002 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc5a27e-8389-4a95-b9c4-75d89dfda4bd admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:11.796642 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc2bf66-4173-444e-af57-6b8d1ff1f3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:11.797100 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc5a27e-8389-4a95-b9c4-75d89dfda4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:11.797309 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2bf66-4173-444e-af57-6b8d1ff1f3c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:11.797386 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc5a27e-8389-4a95-b9c4-75d89dfda4bd admin admin] PATH_INFO: `/v3/users` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:11.797454 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2bf66-4173-444e-af57-6b8d1ff1f3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:11.797454 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2bf66-4173-444e-af57-6b8d1ff1f3c0 admin admin] PATH_INFO: `/v3/projects/6a3d4b9d9d99452b881398292b5e3482` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:11.797591 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc5a27e-8389-4a95-b9c4-75d89dfda4bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:11.797666 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc2bf66-4173-444e-af57-6b8d1ff1f3c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a3d4b9d9d99452b881398292b5e3482)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:11.797739 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc5a27e-8389-4a95-b9c4-75d89dfda4bd admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:11.797811 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc2bf66-4173-444e-af57-6b8d1ff1f3c0 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:11.919674 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 911/1840] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:26:11 2021] POST /identity/v3/users => generated 305 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 18:26:11.920765 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc5a27e-8389-4a95-b9c4-75d89dfda4bd admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:11.932750 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc5a27e-8389-4a95-b9c4-75d89dfda4bd admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:11.968173 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-1bc2bf66-4173-444e-af57-6b8d1ff1f3c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a3d4b9d9d99452b881398292b5e3482', 'request_id': 'req-1bc2bf66-4173-444e-af57-6b8d1ff1f3c0'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:11.983792 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-1bc2bf66-4173-444e-af57-6b8d1ff1f3c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a3d4b9d9d99452b881398292b5e3482', 'request_id': 'req-1bc2bf66-4173-444e-af57-6b8d1ff1f3c0'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:11.984131 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-1bc2bf66-4173-444e-af57-6b8d1ff1f3c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a3d4b9d9d99452b881398292b5e3482', 'request_id': 'req-1bc2bf66-4173-444e-af57-6b8d1ff1f3c0'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:12.021922 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374edd2f-60ef-4fcd-b321-7f4b3a587cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:12.023216 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374edd2f-60ef-4fcd-b321-7f4b3a587cec admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:12.023548 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374edd2f-60ef-4fcd-b321-7f4b3a587cec admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:12.023828 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374edd2f-60ef-4fcd-b321-7f4b3a587cec admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:12.025135 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374edd2f-60ef-4fcd-b321-7f4b3a587cec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:12.026715 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374edd2f-60ef-4fcd-b321-7f4b3a587cec admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:12.039874 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 912/1841] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:26:11 2021] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:26:12.046473 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3708530-34bb-4c97-b29f-d1a925a181ac None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:12.060841 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3708530-34bb-4c97-b29f-d1a925a181ac None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:12.060841 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3708530-34bb-4c97-b29f-d1a925a181ac None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:12.060841 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 913/1842] 10.222.0.18 () {54 vars in 921 bytes} [Tue Oct 12 18:26:12 2021] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:26:12.060841 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3708530-34bb-4c97-b29f-d1a925a181ac None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:12.097738 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3708530-34bb-4c97-b29f-d1a925a181ac None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:12.110100 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f87c5f-c2f3-4947-a73c-625e8980e4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:12.110100 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f87c5f-c2f3-4947-a73c-625e8980e4d8 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:12.110100 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f87c5f-c2f3-4947-a73c-625e8980e4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:12.110100 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f87c5f-c2f3-4947-a73c-625e8980e4d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:12.110478 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-1bc2bf66-4173-444e-af57-6b8d1ff1f3c0 admin admin] The token cache is being invalidate because project 6a3d4b9d9d99452b881398292b5e3482 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74005) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:26:12.110478 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-1bc2bf66-4173-444e-af57-6b8d1ff1f3c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:12.110648 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f87c5f-c2f3-4947-a73c-625e8980e4d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:12.110733 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-1bc2bf66-4173-444e-af57-6b8d1ff1f3c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:12.111114 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f87c5f-c2f3-4947-a73c-625e8980e4d8 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:12.112138 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 930/1843] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:26:11 2021] DELETE /identity/v3/projects/6a3d4b9d9d99452b881398292b5e3482 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 18:26:12.118267 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e4a17-2eba-4d66-9ea4-a87c6a56ab41 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:12.118484 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e4a17-2eba-4d66-9ea4-a87c6a56ab41 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:12.119126 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e4a17-2eba-4d66-9ea4-a87c6a56ab41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:12.138801 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 914/1844] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:26:12 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:26:12.142428 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-600e4a17-2eba-4d66-9ea4-a87c6a56ab41 None None] MFA Rules not processed for user `3417097a280b499086b36df9a2548239`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:12.145069 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17061051-0eae-4f57-acf5-4d3276a247a1 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:12.145374 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17061051-0eae-4f57-acf5-4d3276a247a1 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:12.145653 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17061051-0eae-4f57-acf5-4d3276a247a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:12.146945 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-600e4a17-2eba-4d66-9ea4-a87c6a56ab41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:12.176956 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-17061051-0eae-4f57-acf5-4d3276a247a1 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:12.178431 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-17061051-0eae-4f57-acf5-4d3276a247a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:12.201936 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 915/1845] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:26:12.202858 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17061051-0eae-4f57-acf5-4d3276a247a1 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:12.204616 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-17061051-0eae-4f57-acf5-4d3276a247a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:12.222360 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17061051-0eae-4f57-acf5-4d3276a247a1 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:12.234290 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eebe87-6aef-40ab-af48-1ea88f975ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:12.235216 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eebe87-6aef-40ab-af48-1ea88f975ec3 admin admin] REQUEST_METHOD: `PUT` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:12.235502 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eebe87-6aef-40ab-af48-1ea88f975ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:12.235792 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eebe87-6aef-40ab-af48-1ea88f975ec3 admin admin] PATH_INFO: `/v3/projects/78a14e8d4de14d3ea9dbe39886bea82f/users/da4594414a5b4479b105543e7be8d7f5/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:12.255103 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eebe87-6aef-40ab-af48-1ea88f975ec3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78a14e8d4de14d3ea9dbe39886bea82f, user_id=da4594414a5b4479b105543e7be8d7f5, role_id=33b8a5a8d1d643f2a98f598e6ab0a1cf)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:12.258549 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eebe87-6aef-40ab-af48-1ea88f975ec3 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:12.269783 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 931/1846] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Oct 12 18:26:12 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:26:12.271202 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b764e4aa-942f-472f-a960-80a08441f911 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:12.271496 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b764e4aa-942f-472f-a960-80a08441f911 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:12.271770 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b764e4aa-942f-472f-a960-80a08441f911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:12.294501 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-b764e4aa-942f-472f-a960-80a08441f911 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:12.295781 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-b764e4aa-942f-472f-a960-80a08441f911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:12.310450 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 932/1847] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:26:12.310450 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b764e4aa-942f-472f-a960-80a08441f911 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:12.310450 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-b764e4aa-942f-472f-a960-80a08441f911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:12.325589 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 916/1848] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:26:12 2021] PUT /identity/v3/projects/78a14e8d4de14d3ea9dbe39886bea82f/users/da4594414a5b4479b105543e7be8d7f5/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:26:12.327142 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eebe87-6aef-40ab-af48-1ea88f975ec3 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:12.329715 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-22eebe87-6aef-40ab-af48-1ea88f975ec3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:12.346609 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b764e4aa-942f-472f-a960-80a08441f911 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:12.445712 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eebe87-6aef-40ab-af48-1ea88f975ec3 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:12.452749 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a294efd-64b9-4f7d-a9e5-f24c80e0f6f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3417097a280b499086b36df9a2548239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:12.453355 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a294efd-64b9-4f7d-a9e5-f24c80e0f6f3 service nova] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:12.453634 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a294efd-64b9-4f7d-a9e5-f24c80e0f6f3 service nova] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:12.453902 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a294efd-64b9-4f7d-a9e5-f24c80e0f6f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:12.459589 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ddc92e-0d99-41d3-a6a2-a53f8b2a36b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:12.464242 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a294efd-64b9-4f7d-a9e5-f24c80e0f6f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:12.465856 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a294efd-64b9-4f7d-a9e5-f24c80e0f6f3 service nova] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:12.466133 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ddc92e-0d99-41d3-a6a2-a53f8b2a36b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:12.466425 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ddc92e-0d99-41d3-a6a2-a53f8b2a36b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:12.466705 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ddc92e-0d99-41d3-a6a2-a53f8b2a36b7 admin admin] PATH_INFO: `/v3/projects/374e4241c3e24a6a83ee72c64c1f8799` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:12.468006 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ddc92e-0d99-41d3-a6a2-a53f8b2a36b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=374e4241c3e24a6a83ee72c64c1f8799)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:12.470055 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ddc92e-0d99-41d3-a6a2-a53f8b2a36b7 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:12.478199 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 917/1849] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:26:12 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:26:12.479036 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a294efd-64b9-4f7d-a9e5-f24c80e0f6f3 service nova] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:12.489117 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a294efd-64b9-4f7d-a9e5-f24c80e0f6f3 service nova] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:12.504827 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16313e9-3c0e-45f6-9e23-eccc6c023080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:12.505571 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16313e9-3c0e-45f6-9e23-eccc6c023080 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:12.505854 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16313e9-3c0e-45f6-9e23-eccc6c023080 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:12.506122 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16313e9-3c0e-45f6-9e23-eccc6c023080 admin admin] PATH_INFO: `/v3/domains` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:12.507124 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16313e9-3c0e-45f6-9e23-eccc6c023080 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:26:12.507429 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16313e9-3c0e-45f6-9e23-eccc6c023080 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:12.509293 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16313e9-3c0e-45f6-9e23-eccc6c023080 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:12.528213 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 918/1850] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 12 18:26:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:26:12.529831 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e763f-a120-423d-a681-5c1b691679e3 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:12.530129 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e763f-a120-423d-a681-5c1b691679e3 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:12.530727 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e763f-a120-423d-a681-5c1b691679e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:12.601815 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-54ddc92e-0d99-41d3-a6a2-a53f8b2a36b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '374e4241c3e24a6a83ee72c64c1f8799', 'request_id': 'req-54ddc92e-0d99-41d3-a6a2-a53f8b2a36b7'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:12.603471 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-380e763f-a120-423d-a681-5c1b691679e3 None None] MFA Rules not processed for user `da4594414a5b4479b105543e7be8d7f5`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:12.606073 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-380e763f-a120-423d-a681-5c1b691679e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:12.615081 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-54ddc92e-0d99-41d3-a6a2-a53f8b2a36b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '374e4241c3e24a6a83ee72c64c1f8799', 'request_id': 'req-54ddc92e-0d99-41d3-a6a2-a53f8b2a36b7'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:12.624117 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-54ddc92e-0d99-41d3-a6a2-a53f8b2a36b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '374e4241c3e24a6a83ee72c64c1f8799', 'request_id': 'req-54ddc92e-0d99-41d3-a6a2-a53f8b2a36b7'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:12.708452 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-54ddc92e-0d99-41d3-a6a2-a53f8b2a36b7 admin admin] The token cache is being invalidate because project 374e4241c3e24a6a83ee72c64c1f8799 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74005) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:26:12.708898 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-54ddc92e-0d99-41d3-a6a2-a53f8b2a36b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:12.710772 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-54ddc92e-0d99-41d3-a6a2-a53f8b2a36b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:12.712571 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 933/1851] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:26:12 2021] DELETE /identity/v3/projects/374e4241c3e24a6a83ee72c64c1f8799 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:26:12.715002 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ddc92e-0d99-41d3-a6a2-a53f8b2a36b7 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:12.732709 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-54ddc92e-0d99-41d3-a6a2-a53f8b2a36b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:12.764160 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 919/1852] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:12 2021] POST /identity/v3/auth/tokens => generated 3429 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:26:12.765659 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380e763f-a120-423d-a681-5c1b691679e3 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:12.841611 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ddc92e-0d99-41d3-a6a2-a53f8b2a36b7 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:12.847037 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302cb174-85cb-412f-88b6-f5222e267ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:12.848309 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302cb174-85cb-412f-88b6-f5222e267ca7 admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:12.848975 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302cb174-85cb-412f-88b6-f5222e267ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:12.849619 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302cb174-85cb-412f-88b6-f5222e267ca7 admin admin] PATH_INFO: `/v3/projects` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:12.850541 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302cb174-85cb-412f-88b6-f5222e267ca7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:12.853485 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302cb174-85cb-412f-88b6-f5222e267ca7 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:12.875519 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380e763f-a120-423d-a681-5c1b691679e3 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:12.882601 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48fd7b4-b9a8-438f-b4e2-efe4249220bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:12.884455 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48fd7b4-b9a8-438f-b4e2-efe4249220bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:12.884455 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48fd7b4-b9a8-438f-b4e2-efe4249220bb admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:12.884774 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48fd7b4-b9a8-438f-b4e2-efe4249220bb admin admin] PATH_INFO: `/v3/users/3cf3a2256b0e481691c7f224cf603140` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:12.888505 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48fd7b4-b9a8-438f-b4e2-efe4249220bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cf3a2256b0e481691c7f224cf603140)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:12.892433 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48fd7b4-b9a8-438f-b4e2-efe4249220bb admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:13.053804 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 934/1853] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:26:12 2021] POST /identity/v3/projects => generated 385 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:26:13.053804 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302cb174-85cb-412f-88b6-f5222e267ca7 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:13.053804 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-302cb174-85cb-412f-88b6-f5222e267ca7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:13.114330 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302cb174-85cb-412f-88b6-f5222e267ca7 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:13.119027 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf513a82-ac00-4248-8de8-ed5403b745bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:13.119686 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf513a82-ac00-4248-8de8-ed5403b745bf admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:13.119966 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf513a82-ac00-4248-8de8-ed5403b745bf admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:13.120331 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf513a82-ac00-4248-8de8-ed5403b745bf admin admin] PATH_INFO: `/v3/projects` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:13.121189 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf513a82-ac00-4248-8de8-ed5403b745bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:13.123162 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf513a82-ac00-4248-8de8-ed5403b745bf admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:13.185694 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-a48fd7b4-b9a8-438f-b4e2-efe4249220bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cf3a2256b0e481691c7f224cf603140'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:13.192207 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-a48fd7b4-b9a8-438f-b4e2-efe4249220bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cf3a2256b0e481691c7f224cf603140'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:13.203375 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-a48fd7b4-b9a8-438f-b4e2-efe4249220bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cf3a2256b0e481691c7f224cf603140'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:13.242785 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 935/1854] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:26:13 2021] POST /identity/v3/projects => generated 409 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:26:13.243872 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf513a82-ac00-4248-8de8-ed5403b745bf admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:13.297284 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-a48fd7b4-b9a8-438f-b4e2-efe4249220bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cf3a2256b0e481691c7f224cf603140'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:13.297912 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-a48fd7b4-b9a8-438f-b4e2-efe4249220bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cf3a2256b0e481691c7f224cf603140'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:13.305303 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 920/1855] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:26:12 2021] DELETE /identity/v3/users/3cf3a2256b0e481691c7f224cf603140 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:26:13.310709 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48fd7b4-b9a8-438f-b4e2-efe4249220bb admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:13.310968 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf513a82-ac00-4248-8de8-ed5403b745bf admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:13.311063 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-a48fd7b4-b9a8-438f-b4e2-efe4249220bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:13.366235 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648ed337-ea44-4bb6-99cb-0f50664ffec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:13.366917 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ed337-ea44-4bb6-99cb-0f50664ffec3 admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:13.367201 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ed337-ea44-4bb6-99cb-0f50664ffec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:13.367479 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ed337-ea44-4bb6-99cb-0f50664ffec3 admin admin] PATH_INFO: `/v3/users` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:13.368195 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648ed337-ea44-4bb6-99cb-0f50664ffec3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:13.370182 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648ed337-ea44-4bb6-99cb-0f50664ffec3 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:13.385004 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48fd7b4-b9a8-438f-b4e2-efe4249220bb admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:13.389717 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3166fe3-c986-4027-8598-2fbdf241335d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:13.390391 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3166fe3-c986-4027-8598-2fbdf241335d admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:13.390673 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3166fe3-c986-4027-8598-2fbdf241335d admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:13.390946 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3166fe3-c986-4027-8598-2fbdf241335d admin admin] PATH_INFO: `/v3/users` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:13.391772 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3166fe3-c986-4027-8598-2fbdf241335d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:13.393718 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3166fe3-c986-4027-8598-2fbdf241335d admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:13.451381 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 936/1856] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:26:13 2021] POST /identity/v3/users => generated 293 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:26:13.455446 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648ed337-ea44-4bb6-99cb-0f50664ffec3 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:13.457600 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-648ed337-ea44-4bb6-99cb-0f50664ffec3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:13.469013 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648ed337-ea44-4bb6-99cb-0f50664ffec3 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:13.474361 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3183119a-4671-459d-b943-f5fd6822ca4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:13.475010 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183119a-4671-459d-b943-f5fd6822ca4a admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:13.475289 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183119a-4671-459d-b943-f5fd6822ca4a admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:13.475566 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183119a-4671-459d-b943-f5fd6822ca4a admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:13.476288 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3183119a-4671-459d-b943-f5fd6822ca4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:13.477912 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3183119a-4671-459d-b943-f5fd6822ca4a admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:13.487688 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 921/1857] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:26:13 2021] POST /identity/v3/users => generated 311 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:26:13.488714 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 937/1858] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:26:13 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 18:26:13.492114 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3166fe3-c986-4027-8598-2fbdf241335d admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:13.493553 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3183119a-4671-459d-b943-f5fd6822ca4a admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:13.510652 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3183119a-4671-459d-b943-f5fd6822ca4a admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:13.515036 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3166fe3-c986-4027-8598-2fbdf241335d admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:13.518949 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f73d3cb-6bee-4617-91e6-d81e52e46905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:13.520526 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f73d3cb-6bee-4617-91e6-d81e52e46905 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:13.520526 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f73d3cb-6bee-4617-91e6-d81e52e46905 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:13.520814 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f73d3cb-6bee-4617-91e6-d81e52e46905 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:13.521464 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f73d3cb-6bee-4617-91e6-d81e52e46905 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:13.523142 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f73d3cb-6bee-4617-91e6-d81e52e46905 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:13.524234 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f277189d-172a-4b9e-a593-d817aa542539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:13.525314 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f277189d-172a-4b9e-a593-d817aa542539 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:13.525721 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f277189d-172a-4b9e-a593-d817aa542539 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:13.526225 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f277189d-172a-4b9e-a593-d817aa542539 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:13.529124 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f277189d-172a-4b9e-a593-d817aa542539 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:13.529124 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f277189d-172a-4b9e-a593-d817aa542539 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:13.536940 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 922/1859] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:26:13 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 18:26:13.541334 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f73d3cb-6bee-4617-91e6-d81e52e46905 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:13.543282 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 938/1860] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:26:13 2021] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 18:26:13.547212 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f277189d-172a-4b9e-a593-d817aa542539 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:13.557067 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f277189d-172a-4b9e-a593-d817aa542539 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:13.562840 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae4592c-cc93-427e-b35a-4c58d243ec90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:13.564006 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae4592c-cc93-427e-b35a-4c58d243ec90 admin admin] REQUEST_METHOD: `PUT` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:13.564006 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae4592c-cc93-427e-b35a-4c58d243ec90 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:13.564344 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae4592c-cc93-427e-b35a-4c58d243ec90 admin admin] PATH_INFO: `/v3/projects/f0c98993fa0f4da3bb2984cb4f371d2e/users/52368b9b6bec41f0b71949ea1bb4a949/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:13.571300 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f73d3cb-6bee-4617-91e6-d81e52e46905 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:13.580551 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae4592c-cc93-427e-b35a-4c58d243ec90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0c98993fa0f4da3bb2984cb4f371d2e, user_id=52368b9b6bec41f0b71949ea1bb4a949, role_id=33b8a5a8d1d643f2a98f598e6ab0a1cf)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:13.585337 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695929f0-5d0e-483e-b208-10c0f367ca5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:13.585971 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695929f0-5d0e-483e-b208-10c0f367ca5b admin admin] REQUEST_METHOD: `PUT` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:13.586403 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695929f0-5d0e-483e-b208-10c0f367ca5b admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:13.586571 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae4592c-cc93-427e-b35a-4c58d243ec90 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:13.591096 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695929f0-5d0e-483e-b208-10c0f367ca5b admin admin] PATH_INFO: `/v3/projects/6c60d585614545668c14fd9dd7c3fc49/users/a23a859feaf249d9b1bca189dae240e8/roles/6c54f239944d46e3b027ccce97eb8b49` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:13.606070 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695929f0-5d0e-483e-b208-10c0f367ca5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c60d585614545668c14fd9dd7c3fc49, user_id=a23a859feaf249d9b1bca189dae240e8, role_id=6c54f239944d46e3b027ccce97eb8b49)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:13.609024 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695929f0-5d0e-483e-b208-10c0f367ca5b admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:13.664160 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 939/1861] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:26:13 2021] PUT /identity/v3/projects/f0c98993fa0f4da3bb2984cb4f371d2e/users/52368b9b6bec41f0b71949ea1bb4a949/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:26:13.675294 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4763f4b-2bdf-49d1-b4ad-d5b71f35ead9 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:13.675641 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4763f4b-2bdf-49d1-b4ad-d5b71f35ead9 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:13.675954 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4763f4b-2bdf-49d1-b4ad-d5b71f35ead9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:13.704325 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 923/1862] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:26:13 2021] PUT /identity/v3/projects/6c60d585614545668c14fd9dd7c3fc49/users/a23a859feaf249d9b1bca189dae240e8/roles/6c54f239944d46e3b027ccce97eb8b49 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:26:13.710130 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-e4763f4b-2bdf-49d1-b4ad-d5b71f35ead9 None None] MFA Rules not processed for user `52368b9b6bec41f0b71949ea1bb4a949`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:13.710528 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695929f0-5d0e-483e-b208-10c0f367ca5b admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:13.711363 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-e4763f4b-2bdf-49d1-b4ad-d5b71f35ead9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:13.808813 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 940/1863] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:13 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:26:13.811045 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695929f0-5d0e-483e-b208-10c0f367ca5b admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:13.813386 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4763f4b-2bdf-49d1-b4ad-d5b71f35ead9 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:13.817509 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1325416e-1aec-4de1-a6e7-7ce814ecdf15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:13.818463 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1325416e-1aec-4de1-a6e7-7ce814ecdf15 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:13.818833 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1325416e-1aec-4de1-a6e7-7ce814ecdf15 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:13.819178 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1325416e-1aec-4de1-a6e7-7ce814ecdf15 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:13.820021 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1325416e-1aec-4de1-a6e7-7ce814ecdf15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:13.821728 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1325416e-1aec-4de1-a6e7-7ce814ecdf15 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:13.832646 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 924/1864] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:26:13 2021] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 18:26:13.835383 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4763f4b-2bdf-49d1-b4ad-d5b71f35ead9 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:13.837200 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1325416e-1aec-4de1-a6e7-7ce814ecdf15 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:13.846052 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73396859-7b53-4f58-b214-0bacc184ca44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:13.847354 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73396859-7b53-4f58-b214-0bacc184ca44 admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:13.848275 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73396859-7b53-4f58-b214-0bacc184ca44 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:13.848649 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73396859-7b53-4f58-b214-0bacc184ca44 admin admin] PATH_INFO: `/v3/projects` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:13.848839 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1325416e-1aec-4de1-a6e7-7ce814ecdf15 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:13.849748 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73396859-7b53-4f58-b214-0bacc184ca44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:13.852483 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73396859-7b53-4f58-b214-0bacc184ca44 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:13.858618 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59574fc7-44d5-4eb3-9440-b39ba593ed9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:13.859877 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59574fc7-44d5-4eb3-9440-b39ba593ed9f admin admin] REQUEST_METHOD: `PUT` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:13.860357 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59574fc7-44d5-4eb3-9440-b39ba593ed9f admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:13.860853 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59574fc7-44d5-4eb3-9440-b39ba593ed9f admin admin] PATH_INFO: `/v3/projects/6c60d585614545668c14fd9dd7c3fc49/users/a23a859feaf249d9b1bca189dae240e8/roles/6c54f239944d46e3b027ccce97eb8b49` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:13.867989 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59574fc7-44d5-4eb3-9440-b39ba593ed9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c60d585614545668c14fd9dd7c3fc49, user_id=a23a859feaf249d9b1bca189dae240e8, role_id=6c54f239944d46e3b027ccce97eb8b49)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:13.878587 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59574fc7-44d5-4eb3-9440-b39ba593ed9f admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:13.892450 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 925/1865] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:26:13 2021] PUT /identity/v3/projects/6c60d585614545668c14fd9dd7c3fc49/users/a23a859feaf249d9b1bca189dae240e8/roles/6c54f239944d46e3b027ccce97eb8b49 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:26:13.892450 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59574fc7-44d5-4eb3-9440-b39ba593ed9f admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:13.902849 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-59574fc7-44d5-4eb3-9440-b39ba593ed9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:13.983611 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 941/1866] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:26:13 2021] POST /identity/v3/projects => generated 387 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 18:26:13.983611 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db12142-18e6-41bb-afde-fb4087287677 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:13.983611 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db12142-18e6-41bb-afde-fb4087287677 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:13.983611 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db12142-18e6-41bb-afde-fb4087287677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:14.000641 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59574fc7-44d5-4eb3-9440-b39ba593ed9f admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:14.018115 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-6db12142-18e6-41bb-afde-fb4087287677 None None] MFA Rules not processed for user `a23a859feaf249d9b1bca189dae240e8`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:14.019338 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-6db12142-18e6-41bb-afde-fb4087287677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:14.084217 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19797395-ff0f-446a-90b9-c496da4ac3eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:14.085218 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19797395-ff0f-446a-90b9-c496da4ac3eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:14.085574 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19797395-ff0f-446a-90b9-c496da4ac3eb admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:14.085926 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19797395-ff0f-446a-90b9-c496da4ac3eb admin admin] PATH_INFO: `/v3/projects/f019c4f9699c4f5389efeee040069e22` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:14.087273 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19797395-ff0f-446a-90b9-c496da4ac3eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f019c4f9699c4f5389efeee040069e22)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:14.089686 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19797395-ff0f-446a-90b9-c496da4ac3eb admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:14.124603 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 942/1867] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:13 2021] POST /identity/v3/auth/tokens => generated 3496 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:26:14.125648 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db12142-18e6-41bb-afde-fb4087287677 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:14.136733 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db12142-18e6-41bb-afde-fb4087287677 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:14.141312 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380005c1-f1e6-4565-afa7-b3df9f9c1287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:14.141957 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380005c1-f1e6-4565-afa7-b3df9f9c1287 admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:14.142236 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380005c1-f1e6-4565-afa7-b3df9f9c1287 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:14.142510 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380005c1-f1e6-4565-afa7-b3df9f9c1287 admin admin] PATH_INFO: `/v3/users` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:14.143229 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380005c1-f1e6-4565-afa7-b3df9f9c1287 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:14.145190 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380005c1-f1e6-4565-afa7-b3df9f9c1287 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:14.194101 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-19797395-ff0f-446a-90b9-c496da4ac3eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f019c4f9699c4f5389efeee040069e22', 'request_id': 'req-19797395-ff0f-446a-90b9-c496da4ac3eb'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:14.285656 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-19797395-ff0f-446a-90b9-c496da4ac3eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f019c4f9699c4f5389efeee040069e22', 'request_id': 'req-19797395-ff0f-446a-90b9-c496da4ac3eb'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:14.293014 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 943/1868] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:26:14 2021] POST /identity/v3/users => generated 294 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:26:14.293014 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380005c1-f1e6-4565-afa7-b3df9f9c1287 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:14.303532 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-19797395-ff0f-446a-90b9-c496da4ac3eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f019c4f9699c4f5389efeee040069e22', 'request_id': 'req-19797395-ff0f-446a-90b9-c496da4ac3eb'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:14.303623 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-380005c1-f1e6-4565-afa7-b3df9f9c1287 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:14.304651 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-19797395-ff0f-446a-90b9-c496da4ac3eb admin admin] The token cache is being invalidate because project f019c4f9699c4f5389efeee040069e22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:26:14.304938 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-19797395-ff0f-446a-90b9-c496da4ac3eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:14.305609 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-19797395-ff0f-446a-90b9-c496da4ac3eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:14.307205 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 926/1869] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:26:13 2021] DELETE /identity/v3/projects/f019c4f9699c4f5389efeee040069e22 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:26:14.308021 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19797395-ff0f-446a-90b9-c496da4ac3eb admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:14.309245 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-19797395-ff0f-446a-90b9-c496da4ac3eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:14.351507 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380005c1-f1e6-4565-afa7-b3df9f9c1287 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:14.372524 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19797395-ff0f-446a-90b9-c496da4ac3eb admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:14.377306 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a030f51-87e2-4ed6-83fe-91759b3c22cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:14.377972 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a030f51-87e2-4ed6-83fe-91759b3c22cb admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:14.382147 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a030f51-87e2-4ed6-83fe-91759b3c22cb admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:14.382147 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a030f51-87e2-4ed6-83fe-91759b3c22cb admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:14.382147 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a030f51-87e2-4ed6-83fe-91759b3c22cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:14.382147 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a030f51-87e2-4ed6-83fe-91759b3c22cb admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:14.391268 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 927/1870] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:26:14 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:26:14.392562 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf81ee-2365-404d-8ee5-ac33d9f98a73 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:14.392846 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf81ee-2365-404d-8ee5-ac33d9f98a73 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:14.393119 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf81ee-2365-404d-8ee5-ac33d9f98a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:14.401324 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881be0b3-ebe7-4cdb-9a02-303babb0ce76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6966ce0774f4437a9b688494e9d0574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:14.401979 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881be0b3-ebe7-4cdb-9a02-303babb0ce76 service cinder] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:14.402263 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881be0b3-ebe7-4cdb-9a02-303babb0ce76 service cinder] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:14.402539 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881be0b3-ebe7-4cdb-9a02-303babb0ce76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:14.404427 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-881be0b3-ebe7-4cdb-9a02-303babb0ce76 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:14.411151 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-20cf81ee-2365-404d-8ee5-ac33d9f98a73 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:14.412318 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-20cf81ee-2365-404d-8ee5-ac33d9f98a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:14.420161 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 928/1871] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:26:14.420978 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cf81ee-2365-404d-8ee5-ac33d9f98a73 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:14.431223 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cf81ee-2365-404d-8ee5-ac33d9f98a73 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:14.435774 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e251f0d2-4ab0-4058-9e6e-0aadcdec4900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:14.436452 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e251f0d2-4ab0-4058-9e6e-0aadcdec4900 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:14.436738 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e251f0d2-4ab0-4058-9e6e-0aadcdec4900 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:14.437009 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e251f0d2-4ab0-4058-9e6e-0aadcdec4900 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:14.437767 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e251f0d2-4ab0-4058-9e6e-0aadcdec4900 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:14.439351 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e251f0d2-4ab0-4058-9e6e-0aadcdec4900 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:14.450311 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 929/1872] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:26:14 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:26:14.451458 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce75db-d28f-4501-84fb-95e0aba3c884 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:14.451688 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce75db-d28f-4501-84fb-95e0aba3c884 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:14.451962 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce75db-d28f-4501-84fb-95e0aba3c884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:14.467201 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881be0b3-ebe7-4cdb-9a02-303babb0ce76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:14.468714 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881be0b3-ebe7-4cdb-9a02-303babb0ce76 service cinder] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:14.476551 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-16ce75db-d28f-4501-84fb-95e0aba3c884 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:14.476551 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-16ce75db-d28f-4501-84fb-95e0aba3c884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:14.479029 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 944/1873] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:26:14 2021] GET /identity/v3/auth/tokens => generated 3496 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:26:14.479678 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 930/1874] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:26:14.479803 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881be0b3-ebe7-4cdb-9a02-303babb0ce76 service cinder] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:14.484059 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ce75db-d28f-4501-84fb-95e0aba3c884 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:14.489782 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881be0b3-ebe7-4cdb-9a02-303babb0ce76 service cinder] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:14.493727 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ce75db-d28f-4501-84fb-95e0aba3c884 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:14.494937 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd43419-c0ed-4801-b04d-89bd45b3e8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:14.495977 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd43419-c0ed-4801-b04d-89bd45b3e8d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:14.496277 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd43419-c0ed-4801-b04d-89bd45b3e8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:14.496696 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd43419-c0ed-4801-b04d-89bd45b3e8d3 admin admin] PATH_INFO: `/v3/projects/fd72c5b05c304c6a86b0ea79cd0bd467/users/3e922257a5464ffc8cac6034afa01353/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:14.499160 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1111c6f9-5108-4693-96be-bf4dbde0eaf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:14.499936 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111c6f9-5108-4693-96be-bf4dbde0eaf3 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:14.500293 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111c6f9-5108-4693-96be-bf4dbde0eaf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:14.500661 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111c6f9-5108-4693-96be-bf4dbde0eaf3 admin admin] PATH_INFO: `/v3/domains` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:14.501579 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1111c6f9-5108-4693-96be-bf4dbde0eaf3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:26:14.501853 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1111c6f9-5108-4693-96be-bf4dbde0eaf3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:14.503576 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1111c6f9-5108-4693-96be-bf4dbde0eaf3 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:14.514415 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd43419-c0ed-4801-b04d-89bd45b3e8d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd72c5b05c304c6a86b0ea79cd0bd467, user_id=3e922257a5464ffc8cac6034afa01353, role_id=33b8a5a8d1d643f2a98f598e6ab0a1cf)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:14.517170 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd43419-c0ed-4801-b04d-89bd45b3e8d3 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:14.522509 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 931/1875] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 12 18:26:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:26:14.529335 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1111c6f9-5108-4693-96be-bf4dbde0eaf3 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:14.539876 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1111c6f9-5108-4693-96be-bf4dbde0eaf3 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:14.544063 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e056c45-0e82-41f0-a6af-8c83747a8391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:14.544753 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e056c45-0e82-41f0-a6af-8c83747a8391 admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:14.545038 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e056c45-0e82-41f0-a6af-8c83747a8391 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:14.545318 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e056c45-0e82-41f0-a6af-8c83747a8391 admin admin] PATH_INFO: `/v3/projects` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:14.546019 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e056c45-0e82-41f0-a6af-8c83747a8391 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:14.547909 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e056c45-0e82-41f0-a6af-8c83747a8391 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:14.594375 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 945/1876] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:26:14 2021] PUT /identity/v3/projects/fd72c5b05c304c6a86b0ea79cd0bd467/users/3e922257a5464ffc8cac6034afa01353/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:26:14.604161 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f92bfe7-9dd3-4365-a9e7-ad12a8688dcc None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:14.604490 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f92bfe7-9dd3-4365-a9e7-ad12a8688dcc None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:14.604767 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f92bfe7-9dd3-4365-a9e7-ad12a8688dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:14.634667 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-4f92bfe7-9dd3-4365-a9e7-ad12a8688dcc None None] MFA Rules not processed for user `3e922257a5464ffc8cac6034afa01353`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:14.636250 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-4f92bfe7-9dd3-4365-a9e7-ad12a8688dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:14.658929 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 932/1877] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:26:14 2021] POST /identity/v3/projects => generated 379 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:26:14.663100 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e056c45-0e82-41f0-a6af-8c83747a8391 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:14.708348 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 946/1878] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:14 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:26:14.712710 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f92bfe7-9dd3-4365-a9e7-ad12a8688dcc None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:14.737583 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e056c45-0e82-41f0-a6af-8c83747a8391 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:14.743653 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c13c13a-ddc7-4897-87bd-8eb6cd9e1e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:14.744276 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c13c13a-ddc7-4897-87bd-8eb6cd9e1e8a admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:14.744596 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c13c13a-ddc7-4897-87bd-8eb6cd9e1e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:14.744962 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c13c13a-ddc7-4897-87bd-8eb6cd9e1e8a admin admin] PATH_INFO: `/v3/users` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:14.745629 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c13c13a-ddc7-4897-87bd-8eb6cd9e1e8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:14.747841 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c13c13a-ddc7-4897-87bd-8eb6cd9e1e8a admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:14.779088 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f92bfe7-9dd3-4365-a9e7-ad12a8688dcc None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:14.783967 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d1faf1-a63e-46f5-a7a0-e2aab8c6f30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:14.784694 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1faf1-a63e-46f5-a7a0-e2aab8c6f30f admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:14.784997 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1faf1-a63e-46f5-a7a0-e2aab8c6f30f admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:14.785396 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1faf1-a63e-46f5-a7a0-e2aab8c6f30f admin admin] PATH_INFO: `/v3/projects` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:14.786116 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d1faf1-a63e-46f5-a7a0-e2aab8c6f30f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:14.788064 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d1faf1-a63e-46f5-a7a0-e2aab8c6f30f admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:14.878715 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 933/1879] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:26:14 2021] POST /identity/v3/users => generated 290 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 18:26:14.880291 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c13c13a-ddc7-4897-87bd-8eb6cd9e1e8a admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:14.890196 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c13c13a-ddc7-4897-87bd-8eb6cd9e1e8a admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:14.895111 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c1f01-551b-4b53-8148-c96d76a2d5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:14.895764 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c1f01-551b-4b53-8148-c96d76a2d5b3 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:14.896123 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c1f01-551b-4b53-8148-c96d76a2d5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:14.896421 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c1f01-551b-4b53-8148-c96d76a2d5b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:14.903420 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82c1f01-551b-4b53-8148-c96d76a2d5b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:14.903420 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82c1f01-551b-4b53-8148-c96d76a2d5b3 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:14.913603 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 934/1880] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:26:14 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:26:14.919748 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c1f01-551b-4b53-8148-c96d76a2d5b3 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:14.930698 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c1f01-551b-4b53-8148-c96d76a2d5b3 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:14.935693 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09b97c5-11f3-4790-99e3-1ab1a8bf0ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:14.936360 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b97c5-11f3-4790-99e3-1ab1a8bf0ec2 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:14.936676 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b97c5-11f3-4790-99e3-1ab1a8bf0ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:14.936949 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b97c5-11f3-4790-99e3-1ab1a8bf0ec2 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:14.937716 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09b97c5-11f3-4790-99e3-1ab1a8bf0ec2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:14.939319 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09b97c5-11f3-4790-99e3-1ab1a8bf0ec2 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:14.950151 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 935/1881] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:26:14 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:26:14.954300 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09b97c5-11f3-4790-99e3-1ab1a8bf0ec2 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:14.964261 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09b97c5-11f3-4790-99e3-1ab1a8bf0ec2 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:14.975263 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abd6641-f157-4539-b3b6-d58885c46d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:14.976370 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd6641-f157-4539-b3b6-d58885c46d31 admin admin] REQUEST_METHOD: `PUT` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:14.976777 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd6641-f157-4539-b3b6-d58885c46d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:14.977130 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd6641-f157-4539-b3b6-d58885c46d31 admin admin] PATH_INFO: `/v3/projects/ac7e2992e105495ca05998b26ee9158f/users/f607d31e878349cba1f551255b11161b/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:14.987538 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 947/1882] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:26:14 2021] POST /identity/v3/projects => generated 385 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 18:26:14.992552 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d1faf1-a63e-46f5-a7a0-e2aab8c6f30f admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:15.012356 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abd6641-f157-4539-b3b6-d58885c46d31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac7e2992e105495ca05998b26ee9158f, user_id=f607d31e878349cba1f551255b11161b, role_id=33b8a5a8d1d643f2a98f598e6ab0a1cf)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:15.016107 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abd6641-f157-4539-b3b6-d58885c46d31 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:15.076459 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d1faf1-a63e-46f5-a7a0-e2aab8c6f30f admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:15.081566 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deab348-6fe0-4fac-a964-9a5df69f95ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:15.082758 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deab348-6fe0-4fac-a964-9a5df69f95ad admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:15.083091 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deab348-6fe0-4fac-a964-9a5df69f95ad admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:15.083300 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deab348-6fe0-4fac-a964-9a5df69f95ad admin admin] PATH_INFO: `/v3/users` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:15.084004 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deab348-6fe0-4fac-a964-9a5df69f95ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:15.085973 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deab348-6fe0-4fac-a964-9a5df69f95ad admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:15.144979 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 936/1883] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:26:14 2021] PUT /identity/v3/projects/ac7e2992e105495ca05998b26ee9158f/users/f607d31e878349cba1f551255b11161b/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 18:26:15.144979 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abd6641-f157-4539-b3b6-d58885c46d31 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:15.147155 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-8abd6641-f157-4539-b3b6-d58885c46d31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:15.183150 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 948/1884] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:26:14 2021] POST /identity/v3/users => generated 299 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 18:26:15.185079 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca742165-54d5-4375-a0da-9d6b9e97728f None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:15.200521 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca742165-54d5-4375-a0da-9d6b9e97728f None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:15.200916 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca742165-54d5-4375-a0da-9d6b9e97728f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:15.216532 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abd6641-f157-4539-b3b6-d58885c46d31 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:15.221003 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2ca17a-aa82-4d21-b100-31817242ae66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6966ce0774f4437a9b688494e9d0574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:15.221752 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2ca17a-aa82-4d21-b100-31817242ae66 service cinder] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:15.222111 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2ca17a-aa82-4d21-b100-31817242ae66 service cinder] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:15.222618 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2ca17a-aa82-4d21-b100-31817242ae66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:15.224880 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-ae2ca17a-aa82-4d21-b100-31817242ae66 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:15.237241 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-ca742165-54d5-4375-a0da-9d6b9e97728f None None] MFA Rules not processed for user `f607d31e878349cba1f551255b11161b`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:15.238849 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-ca742165-54d5-4375-a0da-9d6b9e97728f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:15.319397 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2ca17a-aa82-4d21-b100-31817242ae66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:15.327189 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2ca17a-aa82-4d21-b100-31817242ae66 service cinder] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:15.350124 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 937/1885] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:26:15 2021] GET /identity/v3/auth/tokens => generated 3429 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:26:15.351605 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 949/1886] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:15 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:26:15.351943 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2ca17a-aa82-4d21-b100-31817242ae66 service cinder] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:15.352649 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca742165-54d5-4375-a0da-9d6b9e97728f None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:15.429062 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2ca17a-aa82-4d21-b100-31817242ae66 service cinder] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:15.436509 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631490bb-497f-4125-b32e-6d0335d6b7ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:15.437209 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631490bb-497f-4125-b32e-6d0335d6b7ef admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:15.437590 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631490bb-497f-4125-b32e-6d0335d6b7ef admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:15.437880 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631490bb-497f-4125-b32e-6d0335d6b7ef admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:15.439375 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631490bb-497f-4125-b32e-6d0335d6b7ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:15.442009 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631490bb-497f-4125-b32e-6d0335d6b7ef admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:15.460764 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 938/1887] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:26:15 2021] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:26:15.461960 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631490bb-497f-4125-b32e-6d0335d6b7ef admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:15.469824 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca742165-54d5-4375-a0da-9d6b9e97728f None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:15.476287 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631490bb-497f-4125-b32e-6d0335d6b7ef admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:15.477261 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df82c133-b145-470f-8de5-9a96b254e00e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:15.479655 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82c133-b145-470f-8de5-9a96b254e00e admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:15.479950 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82c133-b145-470f-8de5-9a96b254e00e admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:15.480229 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82c133-b145-470f-8de5-9a96b254e00e admin admin] PATH_INFO: `/v3/projects` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:15.480982 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df82c133-b145-470f-8de5-9a96b254e00e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:15.481826 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9211363-f80a-4be6-9eb6-e9661fd5d512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:15.482894 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9211363-f80a-4be6-9eb6-e9661fd5d512 admin admin] REQUEST_METHOD: `PUT` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:15.483513 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9211363-f80a-4be6-9eb6-e9661fd5d512 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:15.484006 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9211363-f80a-4be6-9eb6-e9661fd5d512 admin admin] PATH_INFO: `/v3/projects/940954e715a14badb4b58c0662062403/users/99aa590a737f4f6bb7bc991e24cadf7d/roles/6c54f239944d46e3b027ccce97eb8b49` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:15.491334 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df82c133-b145-470f-8de5-9a96b254e00e admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:15.517395 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9211363-f80a-4be6-9eb6-e9661fd5d512 admin admin] RBAC: Authorizing `identity:create_grant(project_id=940954e715a14badb4b58c0662062403, user_id=99aa590a737f4f6bb7bc991e24cadf7d, role_id=6c54f239944d46e3b027ccce97eb8b49)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:15.522671 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9211363-f80a-4be6-9eb6-e9661fd5d512 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:15.613772 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 939/1888] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:26:15 2021] PUT /identity/v3/projects/940954e715a14badb4b58c0662062403/users/99aa590a737f4f6bb7bc991e24cadf7d/roles/6c54f239944d46e3b027ccce97eb8b49 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:26:15.619652 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 950/1889] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:26:15 2021] POST /identity/v3/projects => generated 379 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:26:15.620777 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9211363-f80a-4be6-9eb6-e9661fd5d512 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:15.620883 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df82c133-b145-470f-8de5-9a96b254e00e admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:15.694069 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9211363-f80a-4be6-9eb6-e9661fd5d512 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:15.699217 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7016c5f-4a7f-4f81-85f4-96c0d336aeb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:15.699784 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df82c133-b145-470f-8de5-9a96b254e00e admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:15.700036 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7016c5f-4a7f-4f81-85f4-96c0d336aeb7 admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:15.700367 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7016c5f-4a7f-4f81-85f4-96c0d336aeb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:15.700670 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7016c5f-4a7f-4f81-85f4-96c0d336aeb7 admin admin] PATH_INFO: `/v3/users` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:15.701406 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7016c5f-4a7f-4f81-85f4-96c0d336aeb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:15.703329 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7016c5f-4a7f-4f81-85f4-96c0d336aeb7 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:15.707859 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2570f63-4b77-486b-914e-7b840ecb2c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:15.708591 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2570f63-4b77-486b-914e-7b840ecb2c18 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:15.708971 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2570f63-4b77-486b-914e-7b840ecb2c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:15.709255 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2570f63-4b77-486b-914e-7b840ecb2c18 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:15.710146 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2570f63-4b77-486b-914e-7b840ecb2c18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:15.711800 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2570f63-4b77-486b-914e-7b840ecb2c18 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:15.734115 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 951/1890] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:26:15 2021] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:26:15.735309 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2570f63-4b77-486b-914e-7b840ecb2c18 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:15.741392 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-d2570f63-4b77-486b-914e-7b840ecb2c18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:15.759100 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2570f63-4b77-486b-914e-7b840ecb2c18 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:15.767686 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759fe684-4f61-411a-b053-f6552ce60e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:15.773257 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759fe684-4f61-411a-b053-f6552ce60e1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:15.773257 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759fe684-4f61-411a-b053-f6552ce60e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:15.773257 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759fe684-4f61-411a-b053-f6552ce60e1e admin admin] PATH_INFO: `/v3/users/71a6da7ace3849bd81b48f17083e1baf` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:15.773257 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759fe684-4f61-411a-b053-f6552ce60e1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=71a6da7ace3849bd81b48f17083e1baf)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:15.778014 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759fe684-4f61-411a-b053-f6552ce60e1e admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:15.851687 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 940/1891] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:26:15 2021] POST /identity/v3/users => generated 296 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:26:15.851687 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7016c5f-4a7f-4f81-85f4-96c0d336aeb7 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:15.866227 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7016c5f-4a7f-4f81-85f4-96c0d336aeb7 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:15.870954 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c65c996-cd7d-43ba-bbdf-6fc9eca5e67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:15.871827 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c65c996-cd7d-43ba-bbdf-6fc9eca5e67c admin admin] REQUEST_METHOD: `PUT` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:15.872119 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c65c996-cd7d-43ba-bbdf-6fc9eca5e67c admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:15.872475 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c65c996-cd7d-43ba-bbdf-6fc9eca5e67c admin admin] PATH_INFO: `/v3/projects/940954e715a14badb4b58c0662062403/users/99aa590a737f4f6bb7bc991e24cadf7d/roles/6c54f239944d46e3b027ccce97eb8b49` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:15.874428 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c65c996-cd7d-43ba-bbdf-6fc9eca5e67c admin admin] RBAC: Authorizing `identity:create_grant(project_id=940954e715a14badb4b58c0662062403, user_id=99aa590a737f4f6bb7bc991e24cadf7d, role_id=6c54f239944d46e3b027ccce97eb8b49)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:15.877226 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c65c996-cd7d-43ba-bbdf-6fc9eca5e67c admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:15.888455 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 941/1892] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:26:15 2021] PUT /identity/v3/projects/940954e715a14badb4b58c0662062403/users/99aa590a737f4f6bb7bc991e24cadf7d/roles/6c54f239944d46e3b027ccce97eb8b49 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:26:15.889342 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c65c996-cd7d-43ba-bbdf-6fc9eca5e67c admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:15.953178 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c65c996-cd7d-43ba-bbdf-6fc9eca5e67c admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:15.957942 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baeb109-49f2-46fe-9946-4f4dde12fe6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:15.958637 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baeb109-49f2-46fe-9946-4f4dde12fe6d admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:15.958915 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baeb109-49f2-46fe-9946-4f4dde12fe6d admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:15.959188 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baeb109-49f2-46fe-9946-4f4dde12fe6d admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:15.959923 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baeb109-49f2-46fe-9946-4f4dde12fe6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:15.961548 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baeb109-49f2-46fe-9946-4f4dde12fe6d admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:15.971855 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 942/1893] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:26:15 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:26:15.973674 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04ab63-189e-44dd-89d8-6a3e8aa63824 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:15.974095 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04ab63-189e-44dd-89d8-6a3e8aa63824 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:15.974299 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04ab63-189e-44dd-89d8-6a3e8aa63824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:16.002686 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-7f04ab63-189e-44dd-89d8-6a3e8aa63824 None None] MFA Rules not processed for user `99aa590a737f4f6bb7bc991e24cadf7d`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:16.003920 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-7f04ab63-189e-44dd-89d8-6a3e8aa63824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:16.091175 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 943/1894] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:15 2021] POST /identity/v3/auth/tokens => generated 3472 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:26:16.092391 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f04ab63-189e-44dd-89d8-6a3e8aa63824 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:16.104571 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f04ab63-189e-44dd-89d8-6a3e8aa63824 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:16.110617 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eea4e5-8989-4a90-b664-24eff3dc526c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:16.112260 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eea4e5-8989-4a90-b664-24eff3dc526c admin admin] REQUEST_METHOD: `PUT` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:16.112858 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eea4e5-8989-4a90-b664-24eff3dc526c admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:16.113189 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eea4e5-8989-4a90-b664-24eff3dc526c admin admin] PATH_INFO: `/v3/projects/42ed76b596c74bdd97903460dd14bce4/users/b92ef5135f4747f68fed961b5d9cf447/roles/6c54f239944d46e3b027ccce97eb8b49` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:16.141056 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eea4e5-8989-4a90-b664-24eff3dc526c admin admin] RBAC: Authorizing `identity:create_grant(project_id=42ed76b596c74bdd97903460dd14bce4, user_id=b92ef5135f4747f68fed961b5d9cf447, role_id=6c54f239944d46e3b027ccce97eb8b49)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:16.144508 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eea4e5-8989-4a90-b664-24eff3dc526c admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:16.147671 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-759fe684-4f61-411a-b053-f6552ce60e1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71a6da7ace3849bd81b48f17083e1baf'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:16.149044 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-759fe684-4f61-411a-b053-f6552ce60e1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71a6da7ace3849bd81b48f17083e1baf'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:16.187838 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-759fe684-4f61-411a-b053-f6552ce60e1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71a6da7ace3849bd81b48f17083e1baf'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:16.191001 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-759fe684-4f61-411a-b053-f6552ce60e1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71a6da7ace3849bd81b48f17083e1baf'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:16.208892 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-759fe684-4f61-411a-b053-f6552ce60e1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71a6da7ace3849bd81b48f17083e1baf'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:16.260076 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 944/1895] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:26:16 2021] PUT /identity/v3/projects/42ed76b596c74bdd97903460dd14bce4/users/b92ef5135f4747f68fed961b5d9cf447/roles/6c54f239944d46e3b027ccce97eb8b49 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:26:16.268794 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eea4e5-8989-4a90-b664-24eff3dc526c admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:16.270847 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-d5eea4e5-8989-4a90-b664-24eff3dc526c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:16.291008 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 952/1896] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:26:15 2021] DELETE /identity/v3/users/71a6da7ace3849bd81b48f17083e1baf => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:26:16.291696 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759fe684-4f61-411a-b053-f6552ce60e1e admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:16.294442 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-759fe684-4f61-411a-b053-f6552ce60e1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:16.377083 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eea4e5-8989-4a90-b664-24eff3dc526c admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:16.398688 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759fe684-4f61-411a-b053-f6552ce60e1e admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:16.403814 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6c0db8-5b3d-412a-bf5f-f80a97c06b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:16.404622 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c0db8-5b3d-412a-bf5f-f80a97c06b51 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:16.404905 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c0db8-5b3d-412a-bf5f-f80a97c06b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:16.405364 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c0db8-5b3d-412a-bf5f-f80a97c06b51 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:16.406265 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6c0db8-5b3d-412a-bf5f-f80a97c06b51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:16.408073 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6c0db8-5b3d-412a-bf5f-f80a97c06b51 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:16.425170 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 953/1897] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:26:16 2021] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:26:16.428110 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283df90c-122f-48b2-9a86-6caed5d6cd1d None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:16.428588 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283df90c-122f-48b2-9a86-6caed5d6cd1d None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:16.429003 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283df90c-122f-48b2-9a86-6caed5d6cd1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:16.449826 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91eaa49-5ebe-41c6-b33d-b4b422e6ea19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6966ce0774f4437a9b688494e9d0574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:16.449983 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91eaa49-5ebe-41c6-b33d-b4b422e6ea19 service cinder] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:16.450153 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91eaa49-5ebe-41c6-b33d-b4b422e6ea19 service cinder] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:16.452842 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91eaa49-5ebe-41c6-b33d-b4b422e6ea19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:16.454620 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-283df90c-122f-48b2-9a86-6caed5d6cd1d None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:16.455051 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-b91eaa49-5ebe-41c6-b33d-b4b422e6ea19 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:16.456310 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-283df90c-122f-48b2-9a86-6caed5d6cd1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:16.468291 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 954/1898] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:26:16.469312 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283df90c-122f-48b2-9a86-6caed5d6cd1d None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:16.480293 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283df90c-122f-48b2-9a86-6caed5d6cd1d None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:16.487684 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6e895b-4dc0-485f-bd65-6b81445c2157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:16.489512 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e895b-4dc0-485f-bd65-6b81445c2157 admin admin] REQUEST_METHOD: `PUT` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:16.489806 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e895b-4dc0-485f-bd65-6b81445c2157 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:16.490086 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e895b-4dc0-485f-bd65-6b81445c2157 admin admin] PATH_INFO: `/v3/projects/42ed76b596c74bdd97903460dd14bce4/users/b92ef5135f4747f68fed961b5d9cf447/roles/6c54f239944d46e3b027ccce97eb8b49` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:16.493532 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6e895b-4dc0-485f-bd65-6b81445c2157 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42ed76b596c74bdd97903460dd14bce4, user_id=b92ef5135f4747f68fed961b5d9cf447, role_id=6c54f239944d46e3b027ccce97eb8b49)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:16.497492 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6e895b-4dc0-485f-bd65-6b81445c2157 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:16.515759 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 955/1899] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:26:16 2021] PUT /identity/v3/projects/42ed76b596c74bdd97903460dd14bce4/users/b92ef5135f4747f68fed961b5d9cf447/roles/6c54f239944d46e3b027ccce97eb8b49 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:26:16.518832 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6e895b-4dc0-485f-bd65-6b81445c2157 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:16.518832 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-2d6e895b-4dc0-485f-bd65-6b81445c2157 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:16.552479 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91eaa49-5ebe-41c6-b33d-b4b422e6ea19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:16.554083 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91eaa49-5ebe-41c6-b33d-b4b422e6ea19 service cinder] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:16.564430 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 945/1900] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:26:16 2021] GET /identity/v3/auth/tokens => generated 3472 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:26:16.565849 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b27f8-0e02-4eca-ae60-86da957954ed None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:16.566127 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b27f8-0e02-4eca-ae60-86da957954ed None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:16.566495 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b27f8-0e02-4eca-ae60-86da957954ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:16.585265 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6e895b-4dc0-485f-bd65-6b81445c2157 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:16.589296 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f40f5d-53a7-4a1a-82c5-3f4d2016fd27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:16.589986 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f40f5d-53a7-4a1a-82c5-3f4d2016fd27 service neutron] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:16.590271 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f40f5d-53a7-4a1a-82c5-3f4d2016fd27 service neutron] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:16.592436 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f40f5d-53a7-4a1a-82c5-3f4d2016fd27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:16.597788 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-a68b27f8-0e02-4eca-ae60-86da957954ed None None] MFA Rules not processed for user `b92ef5135f4747f68fed961b5d9cf447`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:16.599309 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-a68b27f8-0e02-4eca-ae60-86da957954ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:16.666838 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f40f5d-53a7-4a1a-82c5-3f4d2016fd27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:16.668368 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f40f5d-53a7-4a1a-82c5-3f4d2016fd27 service neutron] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:16.679690 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 956/1901] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:26:16 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:26:16.693245 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 946/1902] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:16 2021] POST /identity/v3/auth/tokens => generated 3466 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:26:17.011551 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f40f5d-53a7-4a1a-82c5-3f4d2016fd27 service neutron] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:17.079309 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f40f5d-53a7-4a1a-82c5-3f4d2016fd27 service neutron] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:17.084044 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beae6d5-f5c1-405d-91f3-1ca30a51d141 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6966ce0774f4437a9b688494e9d0574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:17.084668 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beae6d5-f5c1-405d-91f3-1ca30a51d141 service cinder] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:17.084904 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beae6d5-f5c1-405d-91f3-1ca30a51d141 service cinder] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:17.085348 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beae6d5-f5c1-405d-91f3-1ca30a51d141 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:17.102302 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beae6d5-f5c1-405d-91f3-1ca30a51d141 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:17.104013 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beae6d5-f5c1-405d-91f3-1ca30a51d141 service cinder] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:17.114927 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 957/1903] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:26:17 2021] GET /identity/v3/auth/tokens => generated 3466 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:26:17.310730 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68b27f8-0e02-4eca-ae60-86da957954ed None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:17.312185 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-a68b27f8-0e02-4eca-ae60-86da957954ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:17.336349 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68b27f8-0e02-4eca-ae60-86da957954ed None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:17.355880 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91878335-83ea-4a14-88f6-894a5dffd46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:17.358678 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91878335-83ea-4a14-88f6-894a5dffd46a admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:17.359188 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91878335-83ea-4a14-88f6-894a5dffd46a admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:17.359676 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91878335-83ea-4a14-88f6-894a5dffd46a admin admin] PATH_INFO: `/v3/projects/5d12f55194ec48fb8d925e486472604e` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:17.362158 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91878335-83ea-4a14-88f6-894a5dffd46a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d12f55194ec48fb8d925e486472604e)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:17.365684 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91878335-83ea-4a14-88f6-894a5dffd46a admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:17.517218 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-91878335-83ea-4a14-88f6-894a5dffd46a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d12f55194ec48fb8d925e486472604e', 'request_id': 'req-91878335-83ea-4a14-88f6-894a5dffd46a'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:17.681364 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-91878335-83ea-4a14-88f6-894a5dffd46a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d12f55194ec48fb8d925e486472604e', 'request_id': 'req-91878335-83ea-4a14-88f6-894a5dffd46a'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:17.690853 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-91878335-83ea-4a14-88f6-894a5dffd46a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d12f55194ec48fb8d925e486472604e', 'request_id': 'req-91878335-83ea-4a14-88f6-894a5dffd46a'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:17.706074 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-91878335-83ea-4a14-88f6-894a5dffd46a admin admin] The token cache is being invalidate because project 5d12f55194ec48fb8d925e486472604e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:26:17.706365 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-91878335-83ea-4a14-88f6-894a5dffd46a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:17.707933 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-91878335-83ea-4a14-88f6-894a5dffd46a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:17.709775 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 947/1904] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:26:17 2021] DELETE /identity/v3/projects/5d12f55194ec48fb8d925e486472604e => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:26:17.716319 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beae6d5-f5c1-405d-91f3-1ca30a51d141 service cinder] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:17.730085 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beae6d5-f5c1-405d-91f3-1ca30a51d141 service cinder] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:17.798221 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354c6984-df96-48ef-aff5-d1e65ac728b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:17.799027 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c6984-df96-48ef-aff5-d1e65ac728b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:17.799309 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c6984-df96-48ef-aff5-d1e65ac728b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:17.799589 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c6984-df96-48ef-aff5-d1e65ac728b0 admin admin] PATH_INFO: `/v3/users/8c7a3dd8712c4db49caf77a4f69846e9` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:17.800854 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354c6984-df96-48ef-aff5-d1e65ac728b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c7a3dd8712c4db49caf77a4f69846e9)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:17.802811 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354c6984-df96-48ef-aff5-d1e65ac728b0 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:18.103177 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-354c6984-df96-48ef-aff5-d1e65ac728b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c7a3dd8712c4db49caf77a4f69846e9'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:18.104308 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-354c6984-df96-48ef-aff5-d1e65ac728b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c7a3dd8712c4db49caf77a4f69846e9'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:18.121999 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-354c6984-df96-48ef-aff5-d1e65ac728b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c7a3dd8712c4db49caf77a4f69846e9'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:18.126714 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-354c6984-df96-48ef-aff5-d1e65ac728b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c7a3dd8712c4db49caf77a4f69846e9'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:18.130419 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-354c6984-df96-48ef-aff5-d1e65ac728b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c7a3dd8712c4db49caf77a4f69846e9'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:18.298105 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 958/1905] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:26:17 2021] DELETE /identity/v3/users/8c7a3dd8712c4db49caf77a4f69846e9 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:26:18.459933 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91878335-83ea-4a14-88f6-894a5dffd46a admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:18.461478 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-91878335-83ea-4a14-88f6-894a5dffd46a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:18.482515 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91878335-83ea-4a14-88f6-894a5dffd46a admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:18.594369 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354c6984-df96-48ef-aff5-d1e65ac728b0 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:18.598102 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-354c6984-df96-48ef-aff5-d1e65ac728b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:18.628930 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0c7323-b545-452a-af74-35ba67cbb9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:18.629722 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c7323-b545-452a-af74-35ba67cbb9d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:18.629824 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c7323-b545-452a-af74-35ba67cbb9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:18.630096 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c7323-b545-452a-af74-35ba67cbb9d0 admin admin] PATH_INFO: `/v3/users/f607d31e878349cba1f551255b11161b` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:18.640922 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0c7323-b545-452a-af74-35ba67cbb9d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f607d31e878349cba1f551255b11161b)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:18.643030 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0c7323-b545-452a-af74-35ba67cbb9d0 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:18.731650 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354c6984-df96-48ef-aff5-d1e65ac728b0 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:18.740530 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fed4ccc-4849-4001-b1bf-35e91bea640e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6966ce0774f4437a9b688494e9d0574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:18.742619 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed4ccc-4849-4001-b1bf-35e91bea640e service cinder] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:18.742910 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed4ccc-4849-4001-b1bf-35e91bea640e service cinder] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:18.743178 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed4ccc-4849-4001-b1bf-35e91bea640e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:18.745715 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-4fed4ccc-4849-4001-b1bf-35e91bea640e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:18.828540 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fed4ccc-4849-4001-b1bf-35e91bea640e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:18.829839 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fed4ccc-4849-4001-b1bf-35e91bea640e service cinder] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:18.843048 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 959/1906] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:26:18 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 18:26:19.034769 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fed4ccc-4849-4001-b1bf-35e91bea640e service cinder] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:19.036257 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-4fed4ccc-4849-4001-b1bf-35e91bea640e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:19.049752 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fed4ccc-4849-4001-b1bf-35e91bea640e service cinder] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:19.054918 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eeefbb-2184-436c-916d-56452e56d4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:19.055538 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eeefbb-2184-436c-916d-56452e56d4dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:19.055979 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eeefbb-2184-436c-916d-56452e56d4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:19.056261 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eeefbb-2184-436c-916d-56452e56d4dc admin admin] PATH_INFO: `/v3/projects/aa48eacd83fb4c71b9607ac6e8ae9e29` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:19.057763 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eeefbb-2184-436c-916d-56452e56d4dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa48eacd83fb4c71b9607ac6e8ae9e29)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:19.059670 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eeefbb-2184-436c-916d-56452e56d4dc admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:19.102217 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-ca0c7323-b545-452a-af74-35ba67cbb9d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f607d31e878349cba1f551255b11161b'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:19.110390 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-ca0c7323-b545-452a-af74-35ba67cbb9d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f607d31e878349cba1f551255b11161b'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:19.122773 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-ca0c7323-b545-452a-af74-35ba67cbb9d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f607d31e878349cba1f551255b11161b'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:19.195317 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-45eeefbb-2184-436c-916d-56452e56d4dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa48eacd83fb4c71b9607ac6e8ae9e29', 'request_id': 'req-45eeefbb-2184-436c-916d-56452e56d4dc'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:19.201598 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-45eeefbb-2184-436c-916d-56452e56d4dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa48eacd83fb4c71b9607ac6e8ae9e29', 'request_id': 'req-45eeefbb-2184-436c-916d-56452e56d4dc'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:19.207784 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-45eeefbb-2184-436c-916d-56452e56d4dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa48eacd83fb4c71b9607ac6e8ae9e29', 'request_id': 'req-45eeefbb-2184-436c-916d-56452e56d4dc'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:19.228660 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-ca0c7323-b545-452a-af74-35ba67cbb9d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f607d31e878349cba1f551255b11161b'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:19.229338 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-ca0c7323-b545-452a-af74-35ba67cbb9d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f607d31e878349cba1f551255b11161b'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:19.235586 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 948/1907] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:26:18 2021] DELETE /identity/v3/users/f607d31e878349cba1f551255b11161b => generated 0 bytes in 776 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:26:19.239992 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0610968-a73e-4efb-9638-139db5320681 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:19.240389 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0610968-a73e-4efb-9638-139db5320681 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:19.240759 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0610968-a73e-4efb-9638-139db5320681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:19.260608 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-b0610968-a73e-4efb-9638-139db5320681 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:19.261972 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-b0610968-a73e-4efb-9638-139db5320681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:19.302735 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-45eeefbb-2184-436c-916d-56452e56d4dc admin admin] The token cache is being invalidate because project aa48eacd83fb4c71b9607ac6e8ae9e29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74005) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:26:19.303425 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-45eeefbb-2184-436c-916d-56452e56d4dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:19.304061 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-45eeefbb-2184-436c-916d-56452e56d4dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:19.305682 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 960/1908] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:26:19 2021] DELETE /identity/v3/projects/aa48eacd83fb4c71b9607ac6e8ae9e29 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:26:19.311882 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fdeb5a-b5d0-4ae4-a726-ea4456bf2c92 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:19.312231 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fdeb5a-b5d0-4ae4-a726-ea4456bf2c92 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:19.312541 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fdeb5a-b5d0-4ae4-a726-ea4456bf2c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:19.326899 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 949/1909] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:26:19.335711 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0610968-a73e-4efb-9638-139db5320681 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:19.337595 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-b0610968-a73e-4efb-9638-139db5320681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:19.343163 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-b8fdeb5a-b5d0-4ae4-a726-ea4456bf2c92 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:19.344960 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-b8fdeb5a-b5d0-4ae4-a726-ea4456bf2c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:19.368310 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 961/1910] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:26:19.370427 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17170076-a2c9-4f0e-ad8a-0a08671d1d7e None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:19.371226 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17170076-a2c9-4f0e-ad8a-0a08671d1d7e None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:19.371226 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17170076-a2c9-4f0e-ad8a-0a08671d1d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:19.391847 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-17170076-a2c9-4f0e-ad8a-0a08671d1d7e None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:19.398249 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-17170076-a2c9-4f0e-ad8a-0a08671d1d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:19.403421 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 962/1911] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:26:19.413159 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17170076-a2c9-4f0e-ad8a-0a08671d1d7e None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:19.413413 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0610968-a73e-4efb-9638-139db5320681 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:19.418371 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7618cb5-34a8-44d6-8ea3-2519d8fac536 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:19.418607 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17170076-a2c9-4f0e-ad8a-0a08671d1d7e None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:19.419045 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7618cb5-34a8-44d6-8ea3-2519d8fac536 service neutron] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:19.419495 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7618cb5-34a8-44d6-8ea3-2519d8fac536 service neutron] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:19.419987 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7618cb5-34a8-44d6-8ea3-2519d8fac536 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:19.424458 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1aed7d-3cf0-4eda-9cfe-abf6e8b3073f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:19.425401 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1aed7d-3cf0-4eda-9cfe-abf6e8b3073f admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:19.426320 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1aed7d-3cf0-4eda-9cfe-abf6e8b3073f admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:19.426685 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1aed7d-3cf0-4eda-9cfe-abf6e8b3073f admin admin] PATH_INFO: `/v3/domains` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:19.427494 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1aed7d-3cf0-4eda-9cfe-abf6e8b3073f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:26:19.427891 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1aed7d-3cf0-4eda-9cfe-abf6e8b3073f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:19.429677 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1aed7d-3cf0-4eda-9cfe-abf6e8b3073f admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:19.439094 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7618cb5-34a8-44d6-8ea3-2519d8fac536 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:19.444475 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7618cb5-34a8-44d6-8ea3-2519d8fac536 service neutron] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:19.448380 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 963/1912] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 12 18:26:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:26:19.449039 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1aed7d-3cf0-4eda-9cfe-abf6e8b3073f admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:19.460175 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 950/1913] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:26:19 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:26:19.462723 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1aed7d-3cf0-4eda-9cfe-abf6e8b3073f admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:19.468221 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e4bda-9770-4813-ad62-de19bcf8dc7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:19.469265 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e4bda-9770-4813-ad62-de19bcf8dc7a admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:19.469625 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e4bda-9770-4813-ad62-de19bcf8dc7a admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:19.469932 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e4bda-9770-4813-ad62-de19bcf8dc7a admin admin] PATH_INFO: `/v3/projects` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:19.470744 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559e4bda-9770-4813-ad62-de19bcf8dc7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:19.473331 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559e4bda-9770-4813-ad62-de19bcf8dc7a admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:19.626060 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 964/1914] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:26:19 2021] POST /identity/v3/projects => generated 381 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:26:19.630797 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7618cb5-34a8-44d6-8ea3-2519d8fac536 service neutron] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:19.651984 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7618cb5-34a8-44d6-8ea3-2519d8fac536 service neutron] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:19.744004 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a945dfa4-27ba-4235-a413-b497819fc740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:19.745033 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a945dfa4-27ba-4235-a413-b497819fc740 admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:19.745804 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a945dfa4-27ba-4235-a413-b497819fc740 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:19.746237 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a945dfa4-27ba-4235-a413-b497819fc740 admin admin] PATH_INFO: `/v3/users` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:19.748064 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a945dfa4-27ba-4235-a413-b497819fc740 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:19.750818 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a945dfa4-27ba-4235-a413-b497819fc740 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:20.565859 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 951/1915] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:26:19 2021] POST /identity/v3/users => generated 291 bytes in 936 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:26:20.570757 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e4bda-9770-4813-ad62-de19bcf8dc7a admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:20.580794 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e4bda-9770-4813-ad62-de19bcf8dc7a admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:20.586784 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fbd502-9d79-4355-8d97-1a7cc1462b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:20.587508 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fbd502-9d79-4355-8d97-1a7cc1462b7b admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:20.587790 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fbd502-9d79-4355-8d97-1a7cc1462b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:20.588062 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fbd502-9d79-4355-8d97-1a7cc1462b7b admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:20.588836 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fbd502-9d79-4355-8d97-1a7cc1462b7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:20.590422 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fbd502-9d79-4355-8d97-1a7cc1462b7b admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:20.600382 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 965/1916] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:26:20 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:26:20.606979 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a945dfa4-27ba-4235-a413-b497819fc740 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:20.617084 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a945dfa4-27ba-4235-a413-b497819fc740 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:20.621803 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ac94c-b2fe-4c2a-8573-b1a6596a91b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:20.622464 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ac94c-b2fe-4c2a-8573-b1a6596a91b6 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:20.622748 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ac94c-b2fe-4c2a-8573-b1a6596a91b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:20.623020 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ac94c-b2fe-4c2a-8573-b1a6596a91b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:20.623756 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764ac94c-b2fe-4c2a-8573-b1a6596a91b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:20.625415 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764ac94c-b2fe-4c2a-8573-b1a6596a91b6 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:20.635901 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 952/1917] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:26:20 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:26:20.640149 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fbd502-9d79-4355-8d97-1a7cc1462b7b admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:20.653254 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fbd502-9d79-4355-8d97-1a7cc1462b7b admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:20.657077 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ac94c-b2fe-4c2a-8573-b1a6596a91b6 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:20.659120 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-764ac94c-b2fe-4c2a-8573-b1a6596a91b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:20.667081 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783c5ddb-229b-43d6-baa9-ffdd4528a6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:20.668025 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c5ddb-229b-43d6-baa9-ffdd4528a6d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:20.668328 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c5ddb-229b-43d6-baa9-ffdd4528a6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:20.668611 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c5ddb-229b-43d6-baa9-ffdd4528a6d4 admin admin] PATH_INFO: `/v3/projects/f9de313f48fc49648225741214ecc6a0/users/77cb71197c2f4fed8970418c1a78710d/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:20.684787 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783c5ddb-229b-43d6-baa9-ffdd4528a6d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9de313f48fc49648225741214ecc6a0, user_id=77cb71197c2f4fed8970418c1a78710d, role_id=33b8a5a8d1d643f2a98f598e6ab0a1cf)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:20.685299 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ac94c-b2fe-4c2a-8573-b1a6596a91b6 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:20.687719 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783c5ddb-229b-43d6-baa9-ffdd4528a6d4 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:20.693203 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c236990-32cc-47ea-ac1f-62c3342f8ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:20.694128 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c236990-32cc-47ea-ac1f-62c3342f8ddc admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:20.694476 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c236990-32cc-47ea-ac1f-62c3342f8ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:20.694815 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c236990-32cc-47ea-ac1f-62c3342f8ddc admin admin] PATH_INFO: `/v3/projects/ac7e2992e105495ca05998b26ee9158f` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:20.696623 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c236990-32cc-47ea-ac1f-62c3342f8ddc admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac7e2992e105495ca05998b26ee9158f)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:20.698785 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c236990-32cc-47ea-ac1f-62c3342f8ddc admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:20.766261 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 966/1918] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:26:20 2021] PUT /identity/v3/projects/f9de313f48fc49648225741214ecc6a0/users/77cb71197c2f4fed8970418c1a78710d/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:26:20.776990 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed9b75d-4e08-413e-9dc6-eec4bb73b7b8 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:20.777276 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed9b75d-4e08-413e-9dc6-eec4bb73b7b8 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:20.777708 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed9b75d-4e08-413e-9dc6-eec4bb73b7b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:20.787843 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-3c236990-32cc-47ea-ac1f-62c3342f8ddc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac7e2992e105495ca05998b26ee9158f', 'request_id': 'req-3c236990-32cc-47ea-ac1f-62c3342f8ddc'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:20.803506 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-bed9b75d-4e08-413e-9dc6-eec4bb73b7b8 None None] MFA Rules not processed for user `77cb71197c2f4fed8970418c1a78710d`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:20.805909 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-bed9b75d-4e08-413e-9dc6-eec4bb73b7b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:20.850850 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-3c236990-32cc-47ea-ac1f-62c3342f8ddc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac7e2992e105495ca05998b26ee9158f', 'request_id': 'req-3c236990-32cc-47ea-ac1f-62c3342f8ddc'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:20.858436 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-3c236990-32cc-47ea-ac1f-62c3342f8ddc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac7e2992e105495ca05998b26ee9158f', 'request_id': 'req-3c236990-32cc-47ea-ac1f-62c3342f8ddc'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:20.872871 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-3c236990-32cc-47ea-ac1f-62c3342f8ddc admin admin] The token cache is being invalidate because project ac7e2992e105495ca05998b26ee9158f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:26:20.873154 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-3c236990-32cc-47ea-ac1f-62c3342f8ddc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:20.873828 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-3c236990-32cc-47ea-ac1f-62c3342f8ddc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:20.875508 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 953/1919] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:26:20 2021] DELETE /identity/v3/projects/ac7e2992e105495ca05998b26ee9158f => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 18:26:20.876168 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 967/1920] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:20 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:26:20.881574 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c236990-32cc-47ea-ac1f-62c3342f8ddc admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:20.883906 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-3c236990-32cc-47ea-ac1f-62c3342f8ddc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:20.885610 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed9b75d-4e08-413e-9dc6-eec4bb73b7b8 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:20.951255 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c236990-32cc-47ea-ac1f-62c3342f8ddc admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:20.954175 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed9b75d-4e08-413e-9dc6-eec4bb73b7b8 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:20.956306 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f3c788-69ef-4735-9990-2b6d8932478e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:20.957323 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f3c788-69ef-4735-9990-2b6d8932478e admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:20.957605 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f3c788-69ef-4735-9990-2b6d8932478e admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:20.957953 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f3c788-69ef-4735-9990-2b6d8932478e admin admin] PATH_INFO: `/v3/users/b92ef5135f4747f68fed961b5d9cf447` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:20.959114 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45ad572-8864-41e2-b5b8-973dbaed0098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:20.959314 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f3c788-69ef-4735-9990-2b6d8932478e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b92ef5135f4747f68fed961b5d9cf447)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:20.959766 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ad572-8864-41e2-b5b8-973dbaed0098 admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:20.960046 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ad572-8864-41e2-b5b8-973dbaed0098 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:20.960318 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ad572-8864-41e2-b5b8-973dbaed0098 admin admin] PATH_INFO: `/v3/projects` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:20.961047 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45ad572-8864-41e2-b5b8-973dbaed0098 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:20.961252 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f3c788-69ef-4735-9990-2b6d8932478e admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:20.963107 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45ad572-8864-41e2-b5b8-973dbaed0098 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:21.083393 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 968/1921] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:26:20 2021] POST /identity/v3/projects => generated 381 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 18:26:21.084510 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45ad572-8864-41e2-b5b8-973dbaed0098 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:21.086190 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-f45ad572-8864-41e2-b5b8-973dbaed0098 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:21.164808 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45ad572-8864-41e2-b5b8-973dbaed0098 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:21.171014 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1661e2-3f04-423e-bb9e-257f5f634cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:21.171879 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1661e2-3f04-423e-bb9e-257f5f634cb3 admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:21.174122 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1661e2-3f04-423e-bb9e-257f5f634cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:21.174122 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1661e2-3f04-423e-bb9e-257f5f634cb3 admin admin] PATH_INFO: `/v3/users` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:21.174122 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1661e2-3f04-423e-bb9e-257f5f634cb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:21.177420 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1661e2-3f04-423e-bb9e-257f5f634cb3 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:21.182490 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-92f3c788-69ef-4735-9990-2b6d8932478e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b92ef5135f4747f68fed961b5d9cf447'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:21.193963 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-92f3c788-69ef-4735-9990-2b6d8932478e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b92ef5135f4747f68fed961b5d9cf447'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:21.206094 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-92f3c788-69ef-4735-9990-2b6d8932478e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b92ef5135f4747f68fed961b5d9cf447'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:21.286358 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-92f3c788-69ef-4735-9990-2b6d8932478e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b92ef5135f4747f68fed961b5d9cf447'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:21.290136 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-92f3c788-69ef-4735-9990-2b6d8932478e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b92ef5135f4747f68fed961b5d9cf447'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:21.290302 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 969/1922] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:26:21 2021] POST /identity/v3/users => generated 297 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:26:21.291480 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1661e2-3f04-423e-bb9e-257f5f634cb3 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:21.294271 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 954/1923] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:26:20 2021] DELETE /identity/v3/users/b92ef5135f4747f68fed961b5d9cf447 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 18:26:21.298087 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-aa1661e2-3f04-423e-bb9e-257f5f634cb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:21.327327 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1661e2-3f04-423e-bb9e-257f5f634cb3 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:21.415564 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ea2a48-5453-445d-b95e-ece2af1034aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:21.420201 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea2a48-5453-445d-b95e-ece2af1034aa admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:21.423001 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea2a48-5453-445d-b95e-ece2af1034aa admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:21.424795 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea2a48-5453-445d-b95e-ece2af1034aa admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:21.426332 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ea2a48-5453-445d-b95e-ece2af1034aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:21.428216 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ea2a48-5453-445d-b95e-ece2af1034aa admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:21.438403 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 970/1924] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:26:21 2021] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:26:21.443252 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f3c788-69ef-4735-9990-2b6d8932478e admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:21.453299 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f3c788-69ef-4735-9990-2b6d8932478e admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:21.458713 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e3a291-a611-4b2e-93f3-1a7a439d2d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:21.459674 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e3a291-a611-4b2e-93f3-1a7a439d2d82 admin admin] REQUEST_METHOD: `PUT` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:21.460025 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e3a291-a611-4b2e-93f3-1a7a439d2d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:21.460376 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e3a291-a611-4b2e-93f3-1a7a439d2d82 admin admin] PATH_INFO: `/v3/projects/4821e78fce404efe920fb8cd803b8e98/users/38d232e053e347e183f4548b67617baf/roles/6c54f239944d46e3b027ccce97eb8b49` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:21.475113 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e3a291-a611-4b2e-93f3-1a7a439d2d82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4821e78fce404efe920fb8cd803b8e98, user_id=38d232e053e347e183f4548b67617baf, role_id=6c54f239944d46e3b027ccce97eb8b49)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:21.477927 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e3a291-a611-4b2e-93f3-1a7a439d2d82 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:21.549659 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 955/1925] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:26:21 2021] PUT /identity/v3/projects/4821e78fce404efe920fb8cd803b8e98/users/38d232e053e347e183f4548b67617baf/roles/6c54f239944d46e3b027ccce97eb8b49 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 18:26:21.553880 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ea2a48-5453-445d-b95e-ece2af1034aa admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:21.567280 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ea2a48-5453-445d-b95e-ece2af1034aa admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:21.645428 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6a1d92-1e36-4ef1-8a0a-0d4c6ca1e75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:21.646298 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a1d92-1e36-4ef1-8a0a-0d4c6ca1e75e admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:21.646703 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a1d92-1e36-4ef1-8a0a-0d4c6ca1e75e admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:21.647081 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a1d92-1e36-4ef1-8a0a-0d4c6ca1e75e admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:21.648098 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6a1d92-1e36-4ef1-8a0a-0d4c6ca1e75e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:21.650135 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6a1d92-1e36-4ef1-8a0a-0d4c6ca1e75e admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:21.663866 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 971/1926] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:26:21 2021] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:26:21.665006 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e3a291-a611-4b2e-93f3-1a7a439d2d82 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:21.675139 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e3a291-a611-4b2e-93f3-1a7a439d2d82 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:21.680311 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b34bf58-0d9e-4058-948e-b198b6f01f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:21.681285 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b34bf58-0d9e-4058-948e-b198b6f01f1e admin admin] REQUEST_METHOD: `PUT` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:21.681632 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b34bf58-0d9e-4058-948e-b198b6f01f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:21.681971 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b34bf58-0d9e-4058-948e-b198b6f01f1e admin admin] PATH_INFO: `/v3/projects/4821e78fce404efe920fb8cd803b8e98/users/38d232e053e347e183f4548b67617baf/roles/6c54f239944d46e3b027ccce97eb8b49` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:21.683994 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b34bf58-0d9e-4058-948e-b198b6f01f1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4821e78fce404efe920fb8cd803b8e98, user_id=38d232e053e347e183f4548b67617baf, role_id=6c54f239944d46e3b027ccce97eb8b49)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:21.686725 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b34bf58-0d9e-4058-948e-b198b6f01f1e admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:21.697708 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 956/1927] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:26:21 2021] PUT /identity/v3/projects/4821e78fce404efe920fb8cd803b8e98/users/38d232e053e347e183f4548b67617baf/roles/6c54f239944d46e3b027ccce97eb8b49 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:26:21.709367 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ddf8b-6f43-488d-a4a5-563d37f63bc6 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:21.709655 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ddf8b-6f43-488d-a4a5-563d37f63bc6 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:21.709928 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ddf8b-6f43-488d-a4a5-563d37f63bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:21.736718 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-7e1ddf8b-6f43-488d-a4a5-563d37f63bc6 None None] MFA Rules not processed for user `38d232e053e347e183f4548b67617baf`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:21.738450 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-7e1ddf8b-6f43-488d-a4a5-563d37f63bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:21.769272 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b34bf58-0d9e-4058-948e-b198b6f01f1e admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:21.771070 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-2b34bf58-0d9e-4058-948e-b198b6f01f1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:21.836710 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b34bf58-0d9e-4058-948e-b198b6f01f1e admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:21.841664 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aaf386-f045-4be7-8eb3-a140121609c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:21.842601 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aaf386-f045-4be7-8eb3-a140121609c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:21.842886 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aaf386-f045-4be7-8eb3-a140121609c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:21.843162 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aaf386-f045-4be7-8eb3-a140121609c5 admin admin] PATH_INFO: `/v3/projects/42ed76b596c74bdd97903460dd14bce4` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:21.843826 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 972/1928] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:21 2021] POST /identity/v3/auth/tokens => generated 3468 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:26:21.845182 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aaf386-f045-4be7-8eb3-a140121609c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42ed76b596c74bdd97903460dd14bce4)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:21.847697 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aaf386-f045-4be7-8eb3-a140121609c5 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:21.853596 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1ddf8b-6f43-488d-a4a5-563d37f63bc6 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:21.855756 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-7e1ddf8b-6f43-488d-a4a5-563d37f63bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:21.914340 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1ddf8b-6f43-488d-a4a5-563d37f63bc6 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:21.918164 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6411304a-8b26-4cd9-8b6d-5c664ae289a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6966ce0774f4437a9b688494e9d0574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:21.919045 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6411304a-8b26-4cd9-8b6d-5c664ae289a0 service cinder] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:21.919255 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6411304a-8b26-4cd9-8b6d-5c664ae289a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:21.919529 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6411304a-8b26-4cd9-8b6d-5c664ae289a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:21.929322 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6411304a-8b26-4cd9-8b6d-5c664ae289a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:21.930767 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6411304a-8b26-4cd9-8b6d-5c664ae289a0 service cinder] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:21.952229 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 973/1929] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:26:21 2021] GET /identity/v3/auth/tokens => generated 3468 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 18:26:21.955167 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-01aaf386-f045-4be7-8eb3-a140121609c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42ed76b596c74bdd97903460dd14bce4', 'request_id': 'req-01aaf386-f045-4be7-8eb3-a140121609c5'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:22.038904 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6411304a-8b26-4cd9-8b6d-5c664ae289a0 service cinder] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:22.047555 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6411304a-8b26-4cd9-8b6d-5c664ae289a0 service cinder] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:22.079273 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-01aaf386-f045-4be7-8eb3-a140121609c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42ed76b596c74bdd97903460dd14bce4', 'request_id': 'req-01aaf386-f045-4be7-8eb3-a140121609c5'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:22.086963 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-01aaf386-f045-4be7-8eb3-a140121609c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42ed76b596c74bdd97903460dd14bce4', 'request_id': 'req-01aaf386-f045-4be7-8eb3-a140121609c5'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:22.103485 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-01aaf386-f045-4be7-8eb3-a140121609c5 admin admin] The token cache is being invalidate because project 42ed76b596c74bdd97903460dd14bce4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:26:22.103775 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-01aaf386-f045-4be7-8eb3-a140121609c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:22.104487 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-01aaf386-f045-4be7-8eb3-a140121609c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:22.106047 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 957/1930] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:26:21 2021] DELETE /identity/v3/projects/42ed76b596c74bdd97903460dd14bce4 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 18:26:22.111075 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abd5ab8-77e6-4cdc-aaff-85f6e8a1a2bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6966ce0774f4437a9b688494e9d0574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:22.111660 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f75d97-7337-4790-ba6e-d78d13e8e305 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:22.111774 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd5ab8-77e6-4cdc-aaff-85f6e8a1a2bb service cinder] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:22.111950 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f75d97-7337-4790-ba6e-d78d13e8e305 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:22.112052 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd5ab8-77e6-4cdc-aaff-85f6e8a1a2bb service cinder] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:22.112225 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f75d97-7337-4790-ba6e-d78d13e8e305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:22.112320 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd5ab8-77e6-4cdc-aaff-85f6e8a1a2bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:22.114081 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-3abd5ab8-77e6-4cdc-aaff-85f6e8a1a2bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:22.130932 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-c0f75d97-7337-4790-ba6e-d78d13e8e305 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:22.132360 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-c0f75d97-7337-4790-ba6e-d78d13e8e305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:22.173058 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abd5ab8-77e6-4cdc-aaff-85f6e8a1a2bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:22.174493 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abd5ab8-77e6-4cdc-aaff-85f6e8a1a2bb service cinder] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:22.183307 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 974/1931] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:26:22 2021] GET /identity/v3/auth/tokens => generated 3401 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:26:22.193458 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 958/1932] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:26:22.201232 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f0f8b-fce8-42e5-992c-bd0409e5c92d None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:22.201656 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f0f8b-fce8-42e5-992c-bd0409e5c92d None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:22.202031 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f0f8b-fce8-42e5-992c-bd0409e5c92d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:22.220904 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-e33f0f8b-fce8-42e5-992c-bd0409e5c92d None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:22.222126 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-e33f0f8b-fce8-42e5-992c-bd0409e5c92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:22.230322 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 975/1933] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:26:22.234725 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f75d97-7337-4790-ba6e-d78d13e8e305 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:22.245536 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f75d97-7337-4790-ba6e-d78d13e8e305 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:22.250553 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aecf64-e49b-48cd-bf02-032c6aa6bb45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:22.251220 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aecf64-e49b-48cd-bf02-032c6aa6bb45 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:22.251497 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aecf64-e49b-48cd-bf02-032c6aa6bb45 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:22.251763 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aecf64-e49b-48cd-bf02-032c6aa6bb45 admin admin] PATH_INFO: `/v3/domains` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:22.252533 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aecf64-e49b-48cd-bf02-032c6aa6bb45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:26:22.252836 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aecf64-e49b-48cd-bf02-032c6aa6bb45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:22.255038 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aecf64-e49b-48cd-bf02-032c6aa6bb45 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:22.268468 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 959/1934] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 12 18:26:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:26:22.273829 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33f0f8b-fce8-42e5-992c-bd0409e5c92d None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:22.284214 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33f0f8b-fce8-42e5-992c-bd0409e5c92d None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:22.289642 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee770e-ac62-4811-a561-f44b1ba0a316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:22.290367 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee770e-ac62-4811-a561-f44b1ba0a316 admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:22.290659 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee770e-ac62-4811-a561-f44b1ba0a316 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:22.290939 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee770e-ac62-4811-a561-f44b1ba0a316 admin admin] PATH_INFO: `/v3/projects` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:22.291687 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fee770e-ac62-4811-a561-f44b1ba0a316 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:22.293765 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fee770e-ac62-4811-a561-f44b1ba0a316 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:22.381423 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 976/1935] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:26:22 2021] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:26:22.382422 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aecf64-e49b-48cd-bf02-032c6aa6bb45 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:22.392103 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aecf64-e49b-48cd-bf02-032c6aa6bb45 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:22.450595 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d90f5bb-d5c9-411b-935c-dc8ad7e9d339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:22.451262 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90f5bb-d5c9-411b-935c-dc8ad7e9d339 admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:22.451542 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90f5bb-d5c9-411b-935c-dc8ad7e9d339 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:22.451813 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90f5bb-d5c9-411b-935c-dc8ad7e9d339 admin admin] PATH_INFO: `/v3/users` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:22.452639 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d90f5bb-d5c9-411b-935c-dc8ad7e9d339 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:22.454536 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d90f5bb-d5c9-411b-935c-dc8ad7e9d339 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:22.554778 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 960/1936] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:26:22 2021] POST /identity/v3/users => generated 292 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 18:26:22.558883 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee770e-ac62-4811-a561-f44b1ba0a316 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:22.569515 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee770e-ac62-4811-a561-f44b1ba0a316 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:22.574202 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f5cdbb-c872-42a4-87d0-764f66644494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:22.574857 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f5cdbb-c872-42a4-87d0-764f66644494 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:22.575146 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f5cdbb-c872-42a4-87d0-764f66644494 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:22.575586 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f5cdbb-c872-42a4-87d0-764f66644494 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:22.576236 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f5cdbb-c872-42a4-87d0-764f66644494 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:22.577924 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f5cdbb-c872-42a4-87d0-764f66644494 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:22.590421 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 977/1937] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:26:22 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:26:22.594165 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d90f5bb-d5c9-411b-935c-dc8ad7e9d339 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:22.604525 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d90f5bb-d5c9-411b-935c-dc8ad7e9d339 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:22.611384 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8381de-1040-4759-babb-b6c9b0983d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:22.611384 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8381de-1040-4759-babb-b6c9b0983d5c admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:22.611384 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8381de-1040-4759-babb-b6c9b0983d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:22.611384 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8381de-1040-4759-babb-b6c9b0983d5c admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:22.612059 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8381de-1040-4759-babb-b6c9b0983d5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:22.614106 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8381de-1040-4759-babb-b6c9b0983d5c admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:22.628485 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 961/1938] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:26:22 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 18:26:22.630126 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f5cdbb-c872-42a4-87d0-764f66644494 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:22.640091 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f5cdbb-c872-42a4-87d0-764f66644494 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:22.644912 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fe4b3a-db34-4ba4-ada6-6aaea460cd8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:22.645797 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe4b3a-db34-4ba4-ada6-6aaea460cd8a admin admin] REQUEST_METHOD: `PUT` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:22.646350 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe4b3a-db34-4ba4-ada6-6aaea460cd8a admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:22.646350 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe4b3a-db34-4ba4-ada6-6aaea460cd8a admin admin] PATH_INFO: `/v3/projects/6177c6c0547a4240a263fb176470ac8e/users/1b37ee4c34c1497d8a59fe9f30b9603e/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:22.661259 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fe4b3a-db34-4ba4-ada6-6aaea460cd8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6177c6c0547a4240a263fb176470ac8e, user_id=1b37ee4c34c1497d8a59fe9f30b9603e, role_id=33b8a5a8d1d643f2a98f598e6ab0a1cf)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:22.663869 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fe4b3a-db34-4ba4-ada6-6aaea460cd8a admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:22.777404 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 978/1939] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:26:22 2021] PUT /identity/v3/projects/6177c6c0547a4240a263fb176470ac8e/users/1b37ee4c34c1497d8a59fe9f30b9603e/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:26:22.789173 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a8af16-0290-4877-a728-a2d3358ec210 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:22.792436 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a8af16-0290-4877-a728-a2d3358ec210 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:22.792436 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a8af16-0290-4877-a728-a2d3358ec210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:22.826801 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-85a8af16-0290-4877-a728-a2d3358ec210 None None] MFA Rules not processed for user `1b37ee4c34c1497d8a59fe9f30b9603e`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:22.828081 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-85a8af16-0290-4877-a728-a2d3358ec210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:22.891089 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 962/1940] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:22 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:26:22.896116 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fe4b3a-db34-4ba4-ada6-6aaea460cd8a admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:22.962508 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fe4b3a-db34-4ba4-ada6-6aaea460cd8a admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:22.967351 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c971e5-f7f4-4a4a-abe1-ce2e3ec75e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:22.968010 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c971e5-f7f4-4a4a-abe1-ce2e3ec75e3e admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:22.968293 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c971e5-f7f4-4a4a-abe1-ce2e3ec75e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:22.968609 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c971e5-f7f4-4a4a-abe1-ce2e3ec75e3e admin admin] PATH_INFO: `/v3/projects` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:22.969324 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c971e5-f7f4-4a4a-abe1-ce2e3ec75e3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:22.971258 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c971e5-f7f4-4a4a-abe1-ce2e3ec75e3e admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:23.054852 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 979/1941] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:26:22 2021] POST /identity/v3/projects => generated 383 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 18:26:23.060021 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a8af16-0290-4877-a728-a2d3358ec210 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:23.071860 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a8af16-0290-4877-a728-a2d3358ec210 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:23.134069 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f338c996-83e4-4e2d-aaa8-a63006cf3bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:23.135075 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f338c996-83e4-4e2d-aaa8-a63006cf3bad admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:23.135209 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f338c996-83e4-4e2d-aaa8-a63006cf3bad admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:23.135395 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f338c996-83e4-4e2d-aaa8-a63006cf3bad admin admin] PATH_INFO: `/v3/users` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:23.136109 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f338c996-83e4-4e2d-aaa8-a63006cf3bad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:23.138109 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f338c996-83e4-4e2d-aaa8-a63006cf3bad admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:23.228920 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 963/1942] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:26:23 2021] POST /identity/v3/users => generated 298 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:26:23.232868 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c971e5-f7f4-4a4a-abe1-ce2e3ec75e3e admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:23.242909 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c971e5-f7f4-4a4a-abe1-ce2e3ec75e3e admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:23.247724 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbb0696-f3d7-47c4-b1e6-285b07fb7305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:23.248379 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb0696-f3d7-47c4-b1e6-285b07fb7305 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:23.248711 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb0696-f3d7-47c4-b1e6-285b07fb7305 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:23.248968 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb0696-f3d7-47c4-b1e6-285b07fb7305 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:23.249736 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbb0696-f3d7-47c4-b1e6-285b07fb7305 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:23.251339 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbb0696-f3d7-47c4-b1e6-285b07fb7305 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:23.261540 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 980/1943] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:26:23 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 18:26:23.265701 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f338c996-83e4-4e2d-aaa8-a63006cf3bad admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:23.276143 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f338c996-83e4-4e2d-aaa8-a63006cf3bad admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:23.280835 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a58670-6467-4c3b-a7fd-87613b536995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:23.281712 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a58670-6467-4c3b-a7fd-87613b536995 admin admin] REQUEST_METHOD: `PUT` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:23.281993 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a58670-6467-4c3b-a7fd-87613b536995 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:23.282269 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a58670-6467-4c3b-a7fd-87613b536995 admin admin] PATH_INFO: `/v3/projects/c69d2bcc43664563bfc2d8c7aac596d3/users/1bff682fbe574a68b2e47e497bc73581/roles/6c54f239944d46e3b027ccce97eb8b49` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:23.296853 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a58670-6467-4c3b-a7fd-87613b536995 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c69d2bcc43664563bfc2d8c7aac596d3, user_id=1bff682fbe574a68b2e47e497bc73581, role_id=6c54f239944d46e3b027ccce97eb8b49)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:23.299604 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a58670-6467-4c3b-a7fd-87613b536995 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:23.388539 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 964/1944] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:26:23 2021] PUT /identity/v3/projects/c69d2bcc43664563bfc2d8c7aac596d3/users/1bff682fbe574a68b2e47e497bc73581/roles/6c54f239944d46e3b027ccce97eb8b49 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 18:26:23.392532 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbb0696-f3d7-47c4-b1e6-285b07fb7305 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:23.402997 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbb0696-f3d7-47c4-b1e6-285b07fb7305 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:23.455761 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c43ed-914e-4f89-b3cb-a66b99a0b443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:23.456442 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c43ed-914e-4f89-b3cb-a66b99a0b443 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:23.457384 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c43ed-914e-4f89-b3cb-a66b99a0b443 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:23.457667 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c43ed-914e-4f89-b3cb-a66b99a0b443 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:23.458395 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273c43ed-914e-4f89-b3cb-a66b99a0b443 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:23.459992 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273c43ed-914e-4f89-b3cb-a66b99a0b443 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:23.470239 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 981/1945] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:26:23 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:26:23.474460 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a58670-6467-4c3b-a7fd-87613b536995 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:23.484466 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a58670-6467-4c3b-a7fd-87613b536995 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:23.489052 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ca12cc-9b7a-46ef-93cc-8caef23d6b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:23.489927 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca12cc-9b7a-46ef-93cc-8caef23d6b7d admin admin] REQUEST_METHOD: `PUT` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:23.490201 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca12cc-9b7a-46ef-93cc-8caef23d6b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:23.490468 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca12cc-9b7a-46ef-93cc-8caef23d6b7d admin admin] PATH_INFO: `/v3/projects/c69d2bcc43664563bfc2d8c7aac596d3/users/1bff682fbe574a68b2e47e497bc73581/roles/6c54f239944d46e3b027ccce97eb8b49` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:23.492467 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ca12cc-9b7a-46ef-93cc-8caef23d6b7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c69d2bcc43664563bfc2d8c7aac596d3, user_id=1bff682fbe574a68b2e47e497bc73581, role_id=6c54f239944d46e3b027ccce97eb8b49)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:23.495120 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ca12cc-9b7a-46ef-93cc-8caef23d6b7d admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:23.505570 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 965/1946] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:26:23 2021] PUT /identity/v3/projects/c69d2bcc43664563bfc2d8c7aac596d3/users/1bff682fbe574a68b2e47e497bc73581/roles/6c54f239944d46e3b027ccce97eb8b49 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 18:26:23.515651 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11e0cf-9882-47ae-b83a-e05b683a125b None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:23.515943 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11e0cf-9882-47ae-b83a-e05b683a125b None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:23.516254 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11e0cf-9882-47ae-b83a-e05b683a125b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:23.542648 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-7d11e0cf-9882-47ae-b83a-e05b683a125b None None] MFA Rules not processed for user `1bff682fbe574a68b2e47e497bc73581`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:23.543851 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-7d11e0cf-9882-47ae-b83a-e05b683a125b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:23.609191 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 982/1947] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:23 2021] POST /identity/v3/auth/tokens => generated 3470 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:26:23.619740 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ca12cc-9b7a-46ef-93cc-8caef23d6b7d admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:23.621451 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-42ca12cc-9b7a-46ef-93cc-8caef23d6b7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:23.682640 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ca12cc-9b7a-46ef-93cc-8caef23d6b7d admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:23.686227 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994a076c-b193-4f12-8661-4a275694dc0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6966ce0774f4437a9b688494e9d0574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:23.686869 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a076c-b193-4f12-8661-4a275694dc0d service cinder] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:23.687151 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a076c-b193-4f12-8661-4a275694dc0d service cinder] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:23.687425 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a076c-b193-4f12-8661-4a275694dc0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:23.696971 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994a076c-b193-4f12-8661-4a275694dc0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:23.698394 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994a076c-b193-4f12-8661-4a275694dc0d service cinder] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:23.708383 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 966/1948] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:26:23 2021] GET /identity/v3/auth/tokens => generated 3470 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:26:23.884580 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d11e0cf-9882-47ae-b83a-e05b683a125b None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:23.894276 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d11e0cf-9882-47ae-b83a-e05b683a125b None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:23.898033 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a168af-97f6-4aae-8a31-b8fc272a3565 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6966ce0774f4437a9b688494e9d0574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:23.898671 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a168af-97f6-4aae-8a31-b8fc272a3565 service cinder] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:23.898951 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a168af-97f6-4aae-8a31-b8fc272a3565 service cinder] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:23.899227 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a168af-97f6-4aae-8a31-b8fc272a3565 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:23.961136 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a168af-97f6-4aae-8a31-b8fc272a3565 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:23.962582 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a168af-97f6-4aae-8a31-b8fc272a3565 service cinder] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:23.971112 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 983/1949] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:26:23 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:26:24.444526 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994a076c-b193-4f12-8661-4a275694dc0d service cinder] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:24.507224 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994a076c-b193-4f12-8661-4a275694dc0d service cinder] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:24.512193 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e160d47-bc5d-4800-8a6c-5cf9b59aebfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:24.513312 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e160d47-bc5d-4800-8a6c-5cf9b59aebfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:24.513592 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e160d47-bc5d-4800-8a6c-5cf9b59aebfe admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:24.513920 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e160d47-bc5d-4800-8a6c-5cf9b59aebfe admin admin] PATH_INFO: `/v3/users/1b37ee4c34c1497d8a59fe9f30b9603e` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:24.515090 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e160d47-bc5d-4800-8a6c-5cf9b59aebfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b37ee4c34c1497d8a59fe9f30b9603e)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:24.522088 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e160d47-bc5d-4800-8a6c-5cf9b59aebfe admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:24.699146 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-8e160d47-bc5d-4800-8a6c-5cf9b59aebfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b37ee4c34c1497d8a59fe9f30b9603e'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:24.707424 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-8e160d47-bc5d-4800-8a6c-5cf9b59aebfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b37ee4c34c1497d8a59fe9f30b9603e'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:24.720682 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-8e160d47-bc5d-4800-8a6c-5cf9b59aebfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b37ee4c34c1497d8a59fe9f30b9603e'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:24.776269 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-8e160d47-bc5d-4800-8a6c-5cf9b59aebfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b37ee4c34c1497d8a59fe9f30b9603e'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:24.776908 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-8e160d47-bc5d-4800-8a6c-5cf9b59aebfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b37ee4c34c1497d8a59fe9f30b9603e'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:24.783299 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 967/1950] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:26:24 2021] DELETE /identity/v3/users/1b37ee4c34c1497d8a59fe9f30b9603e => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:26:24.787927 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f5730-5541-45d8-a358-a0b15b0cfb54 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:24.788213 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f5730-5541-45d8-a358-a0b15b0cfb54 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:24.788518 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f5730-5541-45d8-a358-a0b15b0cfb54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:24.806263 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-167f5730-5541-45d8-a358-a0b15b0cfb54 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:24.808631 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-167f5730-5541-45d8-a358-a0b15b0cfb54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:24.872818 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 984/1951] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:26:24.885075 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e160d47-bc5d-4800-8a6c-5cf9b59aebfe admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:24.886060 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-8e160d47-bc5d-4800-8a6c-5cf9b59aebfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:24.956898 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e160d47-bc5d-4800-8a6c-5cf9b59aebfe admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:24.961376 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871bf6f1-21cb-475f-a9bf-608f6e8e6a47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:24.962213 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871bf6f1-21cb-475f-a9bf-608f6e8e6a47 service neutron] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:24.962526 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871bf6f1-21cb-475f-a9bf-608f6e8e6a47 service neutron] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:24.962896 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871bf6f1-21cb-475f-a9bf-608f6e8e6a47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:24.981882 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871bf6f1-21cb-475f-a9bf-608f6e8e6a47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:24.981882 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871bf6f1-21cb-475f-a9bf-608f6e8e6a47 service neutron] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:24.989174 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 968/1952] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:26:24 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:26:25.568981 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167f5730-5541-45d8-a358-a0b15b0cfb54 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:25.571155 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-167f5730-5541-45d8-a358-a0b15b0cfb54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:25.590242 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167f5730-5541-45d8-a358-a0b15b0cfb54 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:25.602772 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2534e818-b06f-4abb-92ef-1665598323cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:25.603974 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2534e818-b06f-4abb-92ef-1665598323cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:25.604442 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2534e818-b06f-4abb-92ef-1665598323cc admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:25.604874 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2534e818-b06f-4abb-92ef-1665598323cc admin admin] PATH_INFO: `/v3/projects/6177c6c0547a4240a263fb176470ac8e` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:25.607159 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2534e818-b06f-4abb-92ef-1665598323cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=6177c6c0547a4240a263fb176470ac8e)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:25.609309 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2534e818-b06f-4abb-92ef-1665598323cc admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:25.726162 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-2534e818-b06f-4abb-92ef-1665598323cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6177c6c0547a4240a263fb176470ac8e', 'request_id': 'req-2534e818-b06f-4abb-92ef-1665598323cc'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:25.732611 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-2534e818-b06f-4abb-92ef-1665598323cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6177c6c0547a4240a263fb176470ac8e', 'request_id': 'req-2534e818-b06f-4abb-92ef-1665598323cc'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:25.738590 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-2534e818-b06f-4abb-92ef-1665598323cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6177c6c0547a4240a263fb176470ac8e', 'request_id': 'req-2534e818-b06f-4abb-92ef-1665598323cc'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:25.897183 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-2534e818-b06f-4abb-92ef-1665598323cc admin admin] The token cache is being invalidate because project 6177c6c0547a4240a263fb176470ac8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74005) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:26:25.897593 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-2534e818-b06f-4abb-92ef-1665598323cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:25.898232 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-2534e818-b06f-4abb-92ef-1665598323cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:25.899802 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 985/1953] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:26:25 2021] DELETE /identity/v3/projects/6177c6c0547a4240a263fb176470ac8e => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:26:25.905565 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871bf6f1-21cb-475f-a9bf-608f6e8e6a47 service neutron] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:25.916820 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871bf6f1-21cb-475f-a9bf-608f6e8e6a47 service neutron] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:25.982971 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30bbc22-cbc0-4b65-8b1e-50ed50c1cb98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:25.983935 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30bbc22-cbc0-4b65-8b1e-50ed50c1cb98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:25.984293 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30bbc22-cbc0-4b65-8b1e-50ed50c1cb98 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:25.984591 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30bbc22-cbc0-4b65-8b1e-50ed50c1cb98 admin admin] PATH_INFO: `/v3/users/1bff682fbe574a68b2e47e497bc73581` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:25.986202 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30bbc22-cbc0-4b65-8b1e-50ed50c1cb98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bff682fbe574a68b2e47e497bc73581)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:25.988540 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30bbc22-cbc0-4b65-8b1e-50ed50c1cb98 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:26.364051 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-c30bbc22-cbc0-4b65-8b1e-50ed50c1cb98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bff682fbe574a68b2e47e497bc73581'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:26.371244 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-c30bbc22-cbc0-4b65-8b1e-50ed50c1cb98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bff682fbe574a68b2e47e497bc73581'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:26.384993 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-c30bbc22-cbc0-4b65-8b1e-50ed50c1cb98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bff682fbe574a68b2e47e497bc73581'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:26.451580 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-c30bbc22-cbc0-4b65-8b1e-50ed50c1cb98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bff682fbe574a68b2e47e497bc73581'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:26.452305 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-c30bbc22-cbc0-4b65-8b1e-50ed50c1cb98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bff682fbe574a68b2e47e497bc73581'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:26.458595 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 969/1954] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:26:25 2021] DELETE /identity/v3/users/1bff682fbe574a68b2e47e497bc73581 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:26:27.018772 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2534e818-b06f-4abb-92ef-1665598323cc admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:27.020968 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-2534e818-b06f-4abb-92ef-1665598323cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:27.044834 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2534e818-b06f-4abb-92ef-1665598323cc admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:27.107367 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d10ea88-9e0d-4ca1-a5a2-a356a2292b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:27.108331 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10ea88-9e0d-4ca1-a5a2-a356a2292b45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:27.108657 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10ea88-9e0d-4ca1-a5a2-a356a2292b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:27.108962 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10ea88-9e0d-4ca1-a5a2-a356a2292b45 admin admin] PATH_INFO: `/v3/projects/c69d2bcc43664563bfc2d8c7aac596d3` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:27.110443 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d10ea88-9e0d-4ca1-a5a2-a356a2292b45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c69d2bcc43664563bfc2d8c7aac596d3)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:27.112453 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d10ea88-9e0d-4ca1-a5a2-a356a2292b45 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:27.247294 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-2d10ea88-9e0d-4ca1-a5a2-a356a2292b45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c69d2bcc43664563bfc2d8c7aac596d3', 'request_id': 'req-2d10ea88-9e0d-4ca1-a5a2-a356a2292b45'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:27.255922 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-2d10ea88-9e0d-4ca1-a5a2-a356a2292b45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c69d2bcc43664563bfc2d8c7aac596d3', 'request_id': 'req-2d10ea88-9e0d-4ca1-a5a2-a356a2292b45'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:27.263763 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-2d10ea88-9e0d-4ca1-a5a2-a356a2292b45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c69d2bcc43664563bfc2d8c7aac596d3', 'request_id': 'req-2d10ea88-9e0d-4ca1-a5a2-a356a2292b45'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:27.337059 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-2d10ea88-9e0d-4ca1-a5a2-a356a2292b45 admin admin] The token cache is being invalidate because project c69d2bcc43664563bfc2d8c7aac596d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74005) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:26:27.350300 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-2d10ea88-9e0d-4ca1-a5a2-a356a2292b45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:27.350300 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-2d10ea88-9e0d-4ca1-a5a2-a356a2292b45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:27.350300 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 986/1955] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:26:27 2021] DELETE /identity/v3/projects/c69d2bcc43664563bfc2d8c7aac596d3 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:26:27.350547 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c0009-3d0f-4512-a630-c55ff422ed48 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:27.350547 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c0009-3d0f-4512-a630-c55ff422ed48 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:27.350547 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c0009-3d0f-4512-a630-c55ff422ed48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:27.372454 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-780c0009-3d0f-4512-a630-c55ff422ed48 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:27.373959 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-780c0009-3d0f-4512-a630-c55ff422ed48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:27.436795 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 970/1956] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:26:27.445695 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815bab6-5125-42b8-a16c-ba3b4e593ce7 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:27.445986 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815bab6-5125-42b8-a16c-ba3b4e593ce7 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:27.446433 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815bab6-5125-42b8-a16c-ba3b4e593ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:27.468290 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-4815bab6-5125-42b8-a16c-ba3b4e593ce7 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:27.469954 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-4815bab6-5125-42b8-a16c-ba3b4e593ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:27.478923 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 987/1957] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:26:27.500829 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780c0009-3d0f-4512-a630-c55ff422ed48 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:27.500829 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780c0009-3d0f-4512-a630-c55ff422ed48 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:27.500829 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a647d3-92fd-464a-a941-f1efe81ca2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:27.500829 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a647d3-92fd-464a-a941-f1efe81ca2c8 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:27.501454 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a647d3-92fd-464a-a941-f1efe81ca2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:27.501454 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a647d3-92fd-464a-a941-f1efe81ca2c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:27.501852 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a647d3-92fd-464a-a941-f1efe81ca2c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:26:27.502165 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a647d3-92fd-464a-a941-f1efe81ca2c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:27.504322 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a647d3-92fd-464a-a941-f1efe81ca2c8 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:27.516201 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 971/1958] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 12 18:26:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:26:27.521173 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4815bab6-5125-42b8-a16c-ba3b4e593ce7 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:27.530736 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4815bab6-5125-42b8-a16c-ba3b4e593ce7 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:27.535572 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8d06a4-04b1-48aa-bbbd-f9ee1631189e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:27.536230 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d06a4-04b1-48aa-bbbd-f9ee1631189e admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:27.536552 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d06a4-04b1-48aa-bbbd-f9ee1631189e admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:27.536826 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d06a4-04b1-48aa-bbbd-f9ee1631189e admin admin] PATH_INFO: `/v3/projects` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:27.541238 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8d06a4-04b1-48aa-bbbd-f9ee1631189e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:27.541238 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8d06a4-04b1-48aa-bbbd-f9ee1631189e admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:27.626122 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 988/1959] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:26:27 2021] POST /identity/v3/projects => generated 373 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:26:27.631190 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a647d3-92fd-464a-a941-f1efe81ca2c8 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:27.649621 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a647d3-92fd-464a-a941-f1efe81ca2c8 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:27.721197 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d828aab5-94bb-4cc9-a256-d015e6912812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:27.721897 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d828aab5-94bb-4cc9-a256-d015e6912812 admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:27.722215 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d828aab5-94bb-4cc9-a256-d015e6912812 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:27.722500 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d828aab5-94bb-4cc9-a256-d015e6912812 admin admin] PATH_INFO: `/v3/users` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:27.723206 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d828aab5-94bb-4cc9-a256-d015e6912812 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:27.725376 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d828aab5-94bb-4cc9-a256-d015e6912812 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:27.866774 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 972/1960] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:26:27 2021] POST /identity/v3/users => generated 287 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:26:27.868130 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8d06a4-04b1-48aa-bbbd-f9ee1631189e admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:27.879221 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8d06a4-04b1-48aa-bbbd-f9ee1631189e admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:27.884321 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722b2a69-a604-4a58-a2ba-3f6e6e94693e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:27.885100 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b2a69-a604-4a58-a2ba-3f6e6e94693e admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:27.885459 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b2a69-a604-4a58-a2ba-3f6e6e94693e admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:27.885810 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b2a69-a604-4a58-a2ba-3f6e6e94693e admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:27.886559 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722b2a69-a604-4a58-a2ba-3f6e6e94693e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:27.889801 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722b2a69-a604-4a58-a2ba-3f6e6e94693e admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:27.901048 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 989/1961] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:26:27 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:26:27.905229 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d828aab5-94bb-4cc9-a256-d015e6912812 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:27.915489 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d828aab5-94bb-4cc9-a256-d015e6912812 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:27.923884 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47e9f0d-3d2c-426c-9281-541dd2447c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:27.924803 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e9f0d-3d2c-426c-9281-541dd2447c69 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:27.925755 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e9f0d-3d2c-426c-9281-541dd2447c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:27.926079 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e9f0d-3d2c-426c-9281-541dd2447c69 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:27.927097 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47e9f0d-3d2c-426c-9281-541dd2447c69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:27.928767 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47e9f0d-3d2c-426c-9281-541dd2447c69 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:27.941349 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 973/1962] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:26:27 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 18:26:27.946440 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722b2a69-a604-4a58-a2ba-3f6e6e94693e admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:27.960890 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722b2a69-a604-4a58-a2ba-3f6e6e94693e admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:27.966313 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398d3d5a-ba34-413e-ba48-21b220458ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:27.966956 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d3d5a-ba34-413e-ba48-21b220458ae9 admin admin] REQUEST_METHOD: `PUT` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:27.967238 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d3d5a-ba34-413e-ba48-21b220458ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:27.967509 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d3d5a-ba34-413e-ba48-21b220458ae9 admin admin] PATH_INFO: `/v3/projects/f9dfa89f4b7744b883157d14b5082a48/users/7a62719002974a9d8e2c095ca46e1ec4/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:27.985004 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398d3d5a-ba34-413e-ba48-21b220458ae9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9dfa89f4b7744b883157d14b5082a48, user_id=7a62719002974a9d8e2c095ca46e1ec4, role_id=33b8a5a8d1d643f2a98f598e6ab0a1cf)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:27.988605 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398d3d5a-ba34-413e-ba48-21b220458ae9 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:28.171533 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 990/1963] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:26:27 2021] PUT /identity/v3/projects/f9dfa89f4b7744b883157d14b5082a48/users/7a62719002974a9d8e2c095ca46e1ec4/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:26:28.183384 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27129dc4-30a7-4f07-84ef-ddd8f9398828 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:28.183673 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27129dc4-30a7-4f07-84ef-ddd8f9398828 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:28.184045 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27129dc4-30a7-4f07-84ef-ddd8f9398828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:28.213323 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-27129dc4-30a7-4f07-84ef-ddd8f9398828 None None] MFA Rules not processed for user `7a62719002974a9d8e2c095ca46e1ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:28.214552 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-27129dc4-30a7-4f07-84ef-ddd8f9398828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:28.279878 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 974/1964] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:28 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:26:28.290944 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398d3d5a-ba34-413e-ba48-21b220458ae9 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:28.292874 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-398d3d5a-ba34-413e-ba48-21b220458ae9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:28.350492 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398d3d5a-ba34-413e-ba48-21b220458ae9 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:28.354328 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415d438a-92f1-4bde-816d-f62ea66de457 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6966ce0774f4437a9b688494e9d0574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:28.355287 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d438a-92f1-4bde-816d-f62ea66de457 service cinder] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:28.355287 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d438a-92f1-4bde-816d-f62ea66de457 service cinder] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:28.355576 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d438a-92f1-4bde-816d-f62ea66de457 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:28.364065 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415d438a-92f1-4bde-816d-f62ea66de457 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:28.365733 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415d438a-92f1-4bde-816d-f62ea66de457 service cinder] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:28.397699 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 991/1965] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:26:28 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:26:28.401458 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27129dc4-30a7-4f07-84ef-ddd8f9398828 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:28.476634 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27129dc4-30a7-4f07-84ef-ddd8f9398828 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:28.481594 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1d8f01-4fc4-4620-8bd5-f471d91a4583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:28.482466 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d8f01-4fc4-4620-8bd5-f471d91a4583 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:28.482754 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d8f01-4fc4-4620-8bd5-f471d91a4583 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:28.483027 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d8f01-4fc4-4620-8bd5-f471d91a4583 admin admin] PATH_INFO: `/v3/users/7a62719002974a9d8e2c095ca46e1ec4` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:28.484288 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1d8f01-4fc4-4620-8bd5-f471d91a4583 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a62719002974a9d8e2c095ca46e1ec4)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:28.486261 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1d8f01-4fc4-4620-8bd5-f471d91a4583 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:28.561350 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415d438a-92f1-4bde-816d-f62ea66de457 service cinder] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:28.562967 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-415d438a-92f1-4bde-816d-f62ea66de457 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:28.576500 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415d438a-92f1-4bde-816d-f62ea66de457 service cinder] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:28.581085 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d34946d-a928-4d62-8431-45393275ff5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:28.582502 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d34946d-a928-4d62-8431-45393275ff5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:28.582906 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d34946d-a928-4d62-8431-45393275ff5a admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:28.583185 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d34946d-a928-4d62-8431-45393275ff5a admin admin] PATH_INFO: `/v3/users/77cb71197c2f4fed8970418c1a78710d` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:28.584468 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d34946d-a928-4d62-8431-45393275ff5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=77cb71197c2f4fed8970418c1a78710d)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:28.586391 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d34946d-a928-4d62-8431-45393275ff5a admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:28.709694 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-2c1d8f01-4fc4-4620-8bd5-f471d91a4583 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a62719002974a9d8e2c095ca46e1ec4'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:28.716839 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-2c1d8f01-4fc4-4620-8bd5-f471d91a4583 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a62719002974a9d8e2c095ca46e1ec4'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:28.734774 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-2c1d8f01-4fc4-4620-8bd5-f471d91a4583 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a62719002974a9d8e2c095ca46e1ec4'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:28.845756 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-2c1d8f01-4fc4-4620-8bd5-f471d91a4583 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a62719002974a9d8e2c095ca46e1ec4'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:28.846398 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-2c1d8f01-4fc4-4620-8bd5-f471d91a4583 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a62719002974a9d8e2c095ca46e1ec4'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:28.853369 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 975/1966] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:26:28 2021] DELETE /identity/v3/users/7a62719002974a9d8e2c095ca46e1ec4 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:26:28.861886 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b1ca2-e6aa-4ba5-8326-5f24ef9e33de None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:28.862180 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b1ca2-e6aa-4ba5-8326-5f24ef9e33de None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:28.862461 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b1ca2-e6aa-4ba5-8326-5f24ef9e33de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:28.881261 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-bf1b1ca2-e6aa-4ba5-8326-5f24ef9e33de None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:28.882479 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-bf1b1ca2-e6aa-4ba5-8326-5f24ef9e33de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:28.961442 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-2d34946d-a928-4d62-8431-45393275ff5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77cb71197c2f4fed8970418c1a78710d'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:28.962154 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-2d34946d-a928-4d62-8431-45393275ff5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77cb71197c2f4fed8970418c1a78710d'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:28.965656 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 976/1967] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:26:28.976365 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1b1ca2-e6aa-4ba5-8326-5f24ef9e33de None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:28.978580 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-bf1b1ca2-e6aa-4ba5-8326-5f24ef9e33de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:28.982397 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-2d34946d-a928-4d62-8431-45393275ff5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77cb71197c2f4fed8970418c1a78710d'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:28.983453 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-2d34946d-a928-4d62-8431-45393275ff5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77cb71197c2f4fed8970418c1a78710d'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:29.037441 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-2d34946d-a928-4d62-8431-45393275ff5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77cb71197c2f4fed8970418c1a78710d'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:29.048942 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1b1ca2-e6aa-4ba5-8326-5f24ef9e33de None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:29.056113 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b6fbf6-dbf3-4d98-9a96-5d3e4983b99c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:29.057136 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b6fbf6-dbf3-4d98-9a96-5d3e4983b99c service neutron] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:29.057417 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b6fbf6-dbf3-4d98-9a96-5d3e4983b99c service neutron] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:29.058184 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b6fbf6-dbf3-4d98-9a96-5d3e4983b99c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:29.062076 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-84b6fbf6-dbf3-4d98-9a96-5d3e4983b99c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:29.091473 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b6fbf6-dbf3-4d98-9a96-5d3e4983b99c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:29.093105 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b6fbf6-dbf3-4d98-9a96-5d3e4983b99c service neutron] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:29.103565 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 977/1968] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:26:28 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:26:29.198805 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 992/1969] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:26:28 2021] DELETE /identity/v3/users/77cb71197c2f4fed8970418c1a78710d => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 18:26:29.200382 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c0bfb-bf1d-425b-8e6e-8e84697a3290 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:29.200782 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c0bfb-bf1d-425b-8e6e-8e84697a3290 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:29.200954 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c0bfb-bf1d-425b-8e6e-8e84697a3290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:29.222963 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-224c0bfb-bf1d-425b-8e6e-8e84697a3290 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:29.224300 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-224c0bfb-bf1d-425b-8e6e-8e84697a3290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:29.292571 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 978/1970] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:26:29.303852 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d34946d-a928-4d62-8431-45393275ff5a admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:29.305578 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-2d34946d-a928-4d62-8431-45393275ff5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:29.397082 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d34946d-a928-4d62-8431-45393275ff5a admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:29.401816 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d62d3e1-1590-4bf9-807d-4c4acebac677 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:29.402473 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d62d3e1-1590-4bf9-807d-4c4acebac677 service neutron] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:29.402756 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d62d3e1-1590-4bf9-807d-4c4acebac677 service neutron] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:29.403028 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d62d3e1-1590-4bf9-807d-4c4acebac677 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:29.413913 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d62d3e1-1590-4bf9-807d-4c4acebac677 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:29.415527 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d62d3e1-1590-4bf9-807d-4c4acebac677 service neutron] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:29.428353 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 993/1971] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:26:29 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:26:29.654586 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224c0bfb-bf1d-425b-8e6e-8e84697a3290 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:29.656054 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-224c0bfb-bf1d-425b-8e6e-8e84697a3290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:29.671965 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224c0bfb-bf1d-425b-8e6e-8e84697a3290 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:29.674660 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b2cf12-d51e-4ebd-9a42-03dc308f1881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:29.676368 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b2cf12-d51e-4ebd-9a42-03dc308f1881 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:29.676509 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b2cf12-d51e-4ebd-9a42-03dc308f1881 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:29.676782 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b2cf12-d51e-4ebd-9a42-03dc308f1881 admin admin] PATH_INFO: `/v3/projects/f9dfa89f4b7744b883157d14b5082a48` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:29.678682 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b2cf12-d51e-4ebd-9a42-03dc308f1881 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9dfa89f4b7744b883157d14b5082a48)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:29.684699 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b2cf12-d51e-4ebd-9a42-03dc308f1881 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:29.719539 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d62d3e1-1590-4bf9-807d-4c4acebac677 service neutron] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:29.727445 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-0d62d3e1-1590-4bf9-807d-4c4acebac677 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:29.746452 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d62d3e1-1590-4bf9-807d-4c4acebac677 service neutron] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:29.756468 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93059fe6-2a0a-40ff-bf68-ffc4f677cd4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:29.761581 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93059fe6-2a0a-40ff-bf68-ffc4f677cd4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:29.761581 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93059fe6-2a0a-40ff-bf68-ffc4f677cd4f admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:29.761581 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93059fe6-2a0a-40ff-bf68-ffc4f677cd4f admin admin] PATH_INFO: `/v3/users/da4594414a5b4479b105543e7be8d7f5` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:29.761581 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93059fe6-2a0a-40ff-bf68-ffc4f677cd4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=da4594414a5b4479b105543e7be8d7f5)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:29.761581 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93059fe6-2a0a-40ff-bf68-ffc4f677cd4f admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:29.830104 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-88b2cf12-d51e-4ebd-9a42-03dc308f1881 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9dfa89f4b7744b883157d14b5082a48', 'request_id': 'req-88b2cf12-d51e-4ebd-9a42-03dc308f1881'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:29.948679 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-88b2cf12-d51e-4ebd-9a42-03dc308f1881 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9dfa89f4b7744b883157d14b5082a48', 'request_id': 'req-88b2cf12-d51e-4ebd-9a42-03dc308f1881'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:29.955524 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-88b2cf12-d51e-4ebd-9a42-03dc308f1881 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9dfa89f4b7744b883157d14b5082a48', 'request_id': 'req-88b2cf12-d51e-4ebd-9a42-03dc308f1881'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:29.966252 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-88b2cf12-d51e-4ebd-9a42-03dc308f1881 admin admin] The token cache is being invalidate because project f9dfa89f4b7744b883157d14b5082a48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:26:29.966546 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-88b2cf12-d51e-4ebd-9a42-03dc308f1881 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:29.967434 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-88b2cf12-d51e-4ebd-9a42-03dc308f1881 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:29.968835 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 979/1972] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:26:29 2021] DELETE /identity/v3/projects/f9dfa89f4b7744b883157d14b5082a48 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:26:29.974579 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc87a33-1e7d-4864-b07e-26cad5b63f3b None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:29.974873 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc87a33-1e7d-4864-b07e-26cad5b63f3b None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:29.975220 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc87a33-1e7d-4864-b07e-26cad5b63f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:29.993763 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-9bc87a33-1e7d-4864-b07e-26cad5b63f3b None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:29.994912 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-9bc87a33-1e7d-4864-b07e-26cad5b63f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:30.055936 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 980/1973] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:26:30.063896 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d13a21c-af2a-4a2b-900b-5806793d9e4a None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:30.064190 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d13a21c-af2a-4a2b-900b-5806793d9e4a None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:30.064501 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d13a21c-af2a-4a2b-900b-5806793d9e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:30.105974 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-93059fe6-2a0a-40ff-bf68-ffc4f677cd4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da4594414a5b4479b105543e7be8d7f5'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:30.106713 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-93059fe6-2a0a-40ff-bf68-ffc4f677cd4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da4594414a5b4479b105543e7be8d7f5'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:30.143739 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-93059fe6-2a0a-40ff-bf68-ffc4f677cd4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da4594414a5b4479b105543e7be8d7f5'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:30.144659 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-93059fe6-2a0a-40ff-bf68-ffc4f677cd4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da4594414a5b4479b105543e7be8d7f5'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:30.162009 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-93059fe6-2a0a-40ff-bf68-ffc4f677cd4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da4594414a5b4479b105543e7be8d7f5'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:30.271519 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-5d13a21c-af2a-4a2b-900b-5806793d9e4a None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:30.272757 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-5d13a21c-af2a-4a2b-900b-5806793d9e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:30.282077 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 981/1974] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:26:30.282913 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d13a21c-af2a-4a2b-900b-5806793d9e4a None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:30.284418 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-5d13a21c-af2a-4a2b-900b-5806793d9e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:30.296708 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d13a21c-af2a-4a2b-900b-5806793d9e4a None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:30.302078 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a9b3fb-b1e3-46ba-bc02-e580727b8dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:30.302940 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9b3fb-b1e3-46ba-bc02-e580727b8dca admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:30.303159 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 994/1975] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:26:29 2021] DELETE /identity/v3/users/da4594414a5b4479b105543e7be8d7f5 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 18:26:30.303608 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9b3fb-b1e3-46ba-bc02-e580727b8dca admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:30.303608 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9b3fb-b1e3-46ba-bc02-e580727b8dca admin admin] PATH_INFO: `/v3/projects/f9de313f48fc49648225741214ecc6a0` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:30.304744 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93059fe6-2a0a-40ff-bf68-ffc4f677cd4f admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:30.306580 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a9b3fb-b1e3-46ba-bc02-e580727b8dca admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9de313f48fc49648225741214ecc6a0)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:30.308584 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a9b3fb-b1e3-46ba-bc02-e580727b8dca admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:30.364557 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93059fe6-2a0a-40ff-bf68-ffc4f677cd4f admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:30.369145 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef256f7-3ad9-40ed-8e33-ea910e7c9e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:30.369802 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef256f7-3ad9-40ed-8e33-ea910e7c9e20 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:30.370082 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef256f7-3ad9-40ed-8e33-ea910e7c9e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:30.370357 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef256f7-3ad9-40ed-8e33-ea910e7c9e20 admin admin] PATH_INFO: `/v3/domains` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:30.371083 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef256f7-3ad9-40ed-8e33-ea910e7c9e20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:26:30.371391 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef256f7-3ad9-40ed-8e33-ea910e7c9e20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:30.373080 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef256f7-3ad9-40ed-8e33-ea910e7c9e20 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:30.384785 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 995/1976] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 12 18:26:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:26:30.386482 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a0be5-6a92-417c-8e12-405a4416ebc8 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:30.386771 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a0be5-6a92-417c-8e12-405a4416ebc8 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:30.387146 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a0be5-6a92-417c-8e12-405a4416ebc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:30.405324 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-e20a0be5-6a92-417c-8e12-405a4416ebc8 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:30.406641 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-e20a0be5-6a92-417c-8e12-405a4416ebc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:30.415342 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 996/1977] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:26:30.416150 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20a0be5-6a92-417c-8e12-405a4416ebc8 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:30.426670 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20a0be5-6a92-417c-8e12-405a4416ebc8 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:30.431799 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-e8a9b3fb-b1e3-46ba-bc02-e580727b8dca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9de313f48fc49648225741214ecc6a0', 'request_id': 'req-e8a9b3fb-b1e3-46ba-bc02-e580727b8dca'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:30.482399 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72edf3e-d5ab-426d-89a6-07bff1862cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:30.483104 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72edf3e-d5ab-426d-89a6-07bff1862cc5 admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:30.483386 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72edf3e-d5ab-426d-89a6-07bff1862cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:30.483662 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72edf3e-d5ab-426d-89a6-07bff1862cc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:30.484368 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72edf3e-d5ab-426d-89a6-07bff1862cc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:30.486306 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72edf3e-d5ab-426d-89a6-07bff1862cc5 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:30.508285 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-e8a9b3fb-b1e3-46ba-bc02-e580727b8dca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9de313f48fc49648225741214ecc6a0', 'request_id': 'req-e8a9b3fb-b1e3-46ba-bc02-e580727b8dca'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:30.515477 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-e8a9b3fb-b1e3-46ba-bc02-e580727b8dca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9de313f48fc49648225741214ecc6a0', 'request_id': 'req-e8a9b3fb-b1e3-46ba-bc02-e580727b8dca'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:30.526925 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-e8a9b3fb-b1e3-46ba-bc02-e580727b8dca admin admin] The token cache is being invalidate because project f9de313f48fc49648225741214ecc6a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:26:30.527331 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-e8a9b3fb-b1e3-46ba-bc02-e580727b8dca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:30.528008 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-e8a9b3fb-b1e3-46ba-bc02-e580727b8dca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:30.529592 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 982/1978] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:26:30 2021] DELETE /identity/v3/projects/f9de313f48fc49648225741214ecc6a0 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:26:30.530426 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a9b3fb-b1e3-46ba-bc02-e580727b8dca admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:30.531926 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-e8a9b3fb-b1e3-46ba-bc02-e580727b8dca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:30.578775 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 997/1979] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:26:30 2021] POST /identity/v3/projects => generated 375 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:26:30.580000 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72edf3e-d5ab-426d-89a6-07bff1862cc5 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:30.582335 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-e72edf3e-d5ab-426d-89a6-07bff1862cc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:30.591110 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a9b3fb-b1e3-46ba-bc02-e580727b8dca admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:30.652070 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fadd5e-a15a-410b-a161-8c6f763dab58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:30.652697 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72edf3e-d5ab-426d-89a6-07bff1862cc5 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:30.652814 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fadd5e-a15a-410b-a161-8c6f763dab58 service neutron] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:30.653044 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fadd5e-a15a-410b-a161-8c6f763dab58 service neutron] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:30.653387 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fadd5e-a15a-410b-a161-8c6f763dab58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:30.655142 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-75fadd5e-a15a-410b-a161-8c6f763dab58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:30.657758 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7daacc5-b2b4-4458-9205-851a9a88bb14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:30.658625 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7daacc5-b2b4-4458-9205-851a9a88bb14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:30.658910 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7daacc5-b2b4-4458-9205-851a9a88bb14 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:30.659183 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7daacc5-b2b4-4458-9205-851a9a88bb14 admin admin] PATH_INFO: `/v3/users/38d232e053e347e183f4548b67617baf` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:30.660662 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7daacc5-b2b4-4458-9205-851a9a88bb14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38d232e053e347e183f4548b67617baf)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:30.663270 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7daacc5-b2b4-4458-9205-851a9a88bb14 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:30.668027 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fadd5e-a15a-410b-a161-8c6f763dab58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:30.669511 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fadd5e-a15a-410b-a161-8c6f763dab58 service neutron] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:30.679818 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 983/1980] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:26:30 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:26:30.680867 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fadd5e-a15a-410b-a161-8c6f763dab58 service neutron] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:30.682215 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-75fadd5e-a15a-410b-a161-8c6f763dab58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:30.694714 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fadd5e-a15a-410b-a161-8c6f763dab58 service neutron] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:30.699640 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b81222-fb5d-4101-8429-2426641599e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:30.700304 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b81222-fb5d-4101-8429-2426641599e0 admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:30.700680 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b81222-fb5d-4101-8429-2426641599e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:30.701075 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b81222-fb5d-4101-8429-2426641599e0 admin admin] PATH_INFO: `/v3/users` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:30.701879 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b81222-fb5d-4101-8429-2426641599e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:30.703859 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b81222-fb5d-4101-8429-2426641599e0 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:30.980936 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 984/1981] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:26:30 2021] POST /identity/v3/users => generated 288 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:26:30.982543 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b81222-fb5d-4101-8429-2426641599e0 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:30.987256 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-e7b81222-fb5d-4101-8429-2426641599e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:30.998666 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-c7daacc5-b2b4-4458-9205-851a9a88bb14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38d232e053e347e183f4548b67617baf'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:30.999345 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-c7daacc5-b2b4-4458-9205-851a9a88bb14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38d232e053e347e183f4548b67617baf'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:31.012508 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-c7daacc5-b2b4-4458-9205-851a9a88bb14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38d232e053e347e183f4548b67617baf'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:31.013536 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-c7daacc5-b2b4-4458-9205-851a9a88bb14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38d232e053e347e183f4548b67617baf'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:31.024369 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-c7daacc5-b2b4-4458-9205-851a9a88bb14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38d232e053e347e183f4548b67617baf'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:31.063420 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b81222-fb5d-4101-8429-2426641599e0 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:31.068370 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9fc650-9980-4d76-bf89-08f8d35eca27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6966ce0774f4437a9b688494e9d0574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:31.070719 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9fc650-9980-4d76-bf89-08f8d35eca27 service cinder] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:31.070719 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9fc650-9980-4d76-bf89-08f8d35eca27 service cinder] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:31.070719 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9fc650-9980-4d76-bf89-08f8d35eca27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:31.073475 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-4e9fc650-9980-4d76-bf89-08f8d35eca27 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:31.109333 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 998/1982] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:26:30 2021] DELETE /identity/v3/users/38d232e053e347e183f4548b67617baf => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:26:31.110151 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7daacc5-b2b4-4458-9205-851a9a88bb14 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:31.111500 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-c7daacc5-b2b4-4458-9205-851a9a88bb14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:31.139226 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9fc650-9980-4d76-bf89-08f8d35eca27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:31.140812 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9fc650-9980-4d76-bf89-08f8d35eca27 service cinder] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:31.153555 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 985/1983] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:26:30 2021] GET /identity/v3/auth/tokens => generated 3407 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:26:31.185180 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9fc650-9980-4d76-bf89-08f8d35eca27 service cinder] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:31.188270 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-4e9fc650-9980-4d76-bf89-08f8d35eca27 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:31.190640 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7daacc5-b2b4-4458-9205-851a9a88bb14 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:31.207300 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc7bda5-3074-4714-a7d6-9ba29790b6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:31.210741 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc7bda5-3074-4714-a7d6-9ba29790b6ca admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:31.210741 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc7bda5-3074-4714-a7d6-9ba29790b6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:31.210741 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc7bda5-3074-4714-a7d6-9ba29790b6ca admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:31.210741 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc7bda5-3074-4714-a7d6-9ba29790b6ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:31.211770 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc7bda5-3074-4714-a7d6-9ba29790b6ca admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:31.214684 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9fc650-9980-4d76-bf89-08f8d35eca27 service cinder] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:31.225863 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 999/1984] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:26:31 2021] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:26:31.229273 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa5b1c1-e443-4db4-a14f-8ea22db90672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:31.234638 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa5b1c1-e443-4db4-a14f-8ea22db90672 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:31.235024 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa5b1c1-e443-4db4-a14f-8ea22db90672 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:31.235423 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa5b1c1-e443-4db4-a14f-8ea22db90672 admin admin] PATH_INFO: `/v3/projects/78a14e8d4de14d3ea9dbe39886bea82f` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:31.239395 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa5b1c1-e443-4db4-a14f-8ea22db90672 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78a14e8d4de14d3ea9dbe39886bea82f)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:31.242270 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa5b1c1-e443-4db4-a14f-8ea22db90672 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:31.248258 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc7bda5-3074-4714-a7d6-9ba29790b6ca admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:31.271509 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc7bda5-3074-4714-a7d6-9ba29790b6ca admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:31.288883 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f02bc99-ad00-409c-b012-4b144a9cb06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:31.289816 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02bc99-ad00-409c-b012-4b144a9cb06c admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:31.290358 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02bc99-ad00-409c-b012-4b144a9cb06c admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:31.290986 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02bc99-ad00-409c-b012-4b144a9cb06c admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:31.292930 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f02bc99-ad00-409c-b012-4b144a9cb06c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:31.296080 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f02bc99-ad00-409c-b012-4b144a9cb06c admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:31.320260 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1000/1985] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:26:31 2021] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:26:31.321625 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f02bc99-ad00-409c-b012-4b144a9cb06c admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:31.341081 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f02bc99-ad00-409c-b012-4b144a9cb06c admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:31.359585 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-ffa5b1c1-e443-4db4-a14f-8ea22db90672 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78a14e8d4de14d3ea9dbe39886bea82f', 'request_id': 'req-ffa5b1c1-e443-4db4-a14f-8ea22db90672'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:31.400322 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c058092-3a8c-4606-8b5f-9b3d3b6e482a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:31.401259 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c058092-3a8c-4606-8b5f-9b3d3b6e482a admin admin] REQUEST_METHOD: `PUT` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:31.401542 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c058092-3a8c-4606-8b5f-9b3d3b6e482a admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:31.401819 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c058092-3a8c-4606-8b5f-9b3d3b6e482a admin admin] PATH_INFO: `/v3/projects/3ece9a3f33194dd5a1c30a5d10b602e1/users/d66a14c3aaa34c0ea5f0e06541f1a770/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:31.424238 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c058092-3a8c-4606-8b5f-9b3d3b6e482a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ece9a3f33194dd5a1c30a5d10b602e1, user_id=d66a14c3aaa34c0ea5f0e06541f1a770, role_id=33b8a5a8d1d643f2a98f598e6ab0a1cf)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:31.427604 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c058092-3a8c-4606-8b5f-9b3d3b6e482a admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:31.446091 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-ffa5b1c1-e443-4db4-a14f-8ea22db90672 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78a14e8d4de14d3ea9dbe39886bea82f', 'request_id': 'req-ffa5b1c1-e443-4db4-a14f-8ea22db90672'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:31.455272 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-ffa5b1c1-e443-4db4-a14f-8ea22db90672 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78a14e8d4de14d3ea9dbe39886bea82f', 'request_id': 'req-ffa5b1c1-e443-4db4-a14f-8ea22db90672'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:31.473108 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-ffa5b1c1-e443-4db4-a14f-8ea22db90672 admin admin] The token cache is being invalidate because project 78a14e8d4de14d3ea9dbe39886bea82f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:26:31.473403 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-ffa5b1c1-e443-4db4-a14f-8ea22db90672 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:31.474393 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-ffa5b1c1-e443-4db4-a14f-8ea22db90672 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:31.476271 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 986/1986] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:26:31 2021] DELETE /identity/v3/projects/78a14e8d4de14d3ea9dbe39886bea82f => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:26:31.480256 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa5b1c1-e443-4db4-a14f-8ea22db90672 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:31.481970 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-ffa5b1c1-e443-4db4-a14f-8ea22db90672 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:31.496005 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1001/1987] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:26:31 2021] PUT /identity/v3/projects/3ece9a3f33194dd5a1c30a5d10b602e1/users/d66a14c3aaa34c0ea5f0e06541f1a770/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:26:31.496987 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa5b1c1-e443-4db4-a14f-8ea22db90672 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:31.509625 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f30d0-d7a8-4e23-9c1d-7de42e15585b None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:31.509910 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f30d0-d7a8-4e23-9c1d-7de42e15585b None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:31.510181 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f30d0-d7a8-4e23-9c1d-7de42e15585b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:31.542661 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-658f30d0-d7a8-4e23-9c1d-7de42e15585b None None] MFA Rules not processed for user `d66a14c3aaa34c0ea5f0e06541f1a770`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:31.543253 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-658f30d0-d7a8-4e23-9c1d-7de42e15585b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:31.572791 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57478a9a-3a0a-4ec0-b008-cc7eb2cc2ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:31.573670 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57478a9a-3a0a-4ec0-b008-cc7eb2cc2ac1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:31.573948 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57478a9a-3a0a-4ec0-b008-cc7eb2cc2ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:31.574224 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57478a9a-3a0a-4ec0-b008-cc7eb2cc2ac1 admin admin] PATH_INFO: `/v3/users/a23a859feaf249d9b1bca189dae240e8` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:31.575428 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57478a9a-3a0a-4ec0-b008-cc7eb2cc2ac1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a23a859feaf249d9b1bca189dae240e8)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:31.577366 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57478a9a-3a0a-4ec0-b008-cc7eb2cc2ac1 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:31.612211 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1002/1988] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:31 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:26:31.615750 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658f30d0-d7a8-4e23-9c1d-7de42e15585b None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:31.615750 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-658f30d0-d7a8-4e23-9c1d-7de42e15585b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:31.630948 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658f30d0-d7a8-4e23-9c1d-7de42e15585b None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:31.636056 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d109da1b-1d89-4c2a-a7c1-aa0272361d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:31.636994 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d109da1b-1d89-4c2a-a7c1-aa0272361d82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:31.637279 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d109da1b-1d89-4c2a-a7c1-aa0272361d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:31.637556 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d109da1b-1d89-4c2a-a7c1-aa0272361d82 admin admin] PATH_INFO: `/v3/projects/4821e78fce404efe920fb8cd803b8e98` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:31.638777 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d109da1b-1d89-4c2a-a7c1-aa0272361d82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4821e78fce404efe920fb8cd803b8e98)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:31.640902 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d109da1b-1d89-4c2a-a7c1-aa0272361d82 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:31.767913 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-57478a9a-3a0a-4ec0-b008-cc7eb2cc2ac1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a23a859feaf249d9b1bca189dae240e8'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:31.775981 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-57478a9a-3a0a-4ec0-b008-cc7eb2cc2ac1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a23a859feaf249d9b1bca189dae240e8'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:31.788900 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-57478a9a-3a0a-4ec0-b008-cc7eb2cc2ac1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a23a859feaf249d9b1bca189dae240e8'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:31.789719 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-d109da1b-1d89-4c2a-a7c1-aa0272361d82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4821e78fce404efe920fb8cd803b8e98', 'request_id': 'req-d109da1b-1d89-4c2a-a7c1-aa0272361d82'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:31.796148 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-d109da1b-1d89-4c2a-a7c1-aa0272361d82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4821e78fce404efe920fb8cd803b8e98', 'request_id': 'req-d109da1b-1d89-4c2a-a7c1-aa0272361d82'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:31.801718 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-d109da1b-1d89-4c2a-a7c1-aa0272361d82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4821e78fce404efe920fb8cd803b8e98', 'request_id': 'req-d109da1b-1d89-4c2a-a7c1-aa0272361d82'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:31.891931 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-57478a9a-3a0a-4ec0-b008-cc7eb2cc2ac1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a23a859feaf249d9b1bca189dae240e8'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:31.892626 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-57478a9a-3a0a-4ec0-b008-cc7eb2cc2ac1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a23a859feaf249d9b1bca189dae240e8'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:31.899565 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 987/1989] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:26:31 2021] DELETE /identity/v3/users/a23a859feaf249d9b1bca189dae240e8 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 18:26:31.900667 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57478a9a-3a0a-4ec0-b008-cc7eb2cc2ac1 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:31.902102 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-57478a9a-3a0a-4ec0-b008-cc7eb2cc2ac1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:31.968095 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57478a9a-3a0a-4ec0-b008-cc7eb2cc2ac1 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:31.971786 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9a4046-e786-422d-95d9-3f3f863585e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6966ce0774f4437a9b688494e9d0574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:31.972497 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a4046-e786-422d-95d9-3f3f863585e5 service cinder] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:31.972801 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a4046-e786-422d-95d9-3f3f863585e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:31.973039 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a4046-e786-422d-95d9-3f3f863585e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:31.974935 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-1b9a4046-e786-422d-95d9-3f3f863585e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:31.988607 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-d109da1b-1d89-4c2a-a7c1-aa0272361d82 admin admin] The token cache is being invalidate because project 4821e78fce404efe920fb8cd803b8e98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74005) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:26:31.988921 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-d109da1b-1d89-4c2a-a7c1-aa0272361d82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:31.989643 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-d109da1b-1d89-4c2a-a7c1-aa0272361d82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:31.991666 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1003/1990] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:26:31 2021] DELETE /identity/v3/projects/4821e78fce404efe920fb8cd803b8e98 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:26:31.997257 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d7a3d5-b1ca-4bbb-b405-57e2ddb94992 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:31.997566 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d7a3d5-b1ca-4bbb-b405-57e2ddb94992 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:31.997913 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d7a3d5-b1ca-4bbb-b405-57e2ddb94992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:32.018293 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-74d7a3d5-b1ca-4bbb-b405-57e2ddb94992 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:32.022028 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-74d7a3d5-b1ca-4bbb-b405-57e2ddb94992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:32.055502 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9a4046-e786-422d-95d9-3f3f863585e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:32.055502 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9a4046-e786-422d-95d9-3f3f863585e5 service cinder] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:32.060017 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 988/1991] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:26:31 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:26:32.102039 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1004/1992] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:26:32.110082 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdce72c-c667-49f9-8c08-a70c8b00bf9d None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:32.110381 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdce72c-c667-49f9-8c08-a70c8b00bf9d None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:32.110655 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdce72c-c667-49f9-8c08-a70c8b00bf9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:32.136760 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-2cdce72c-c667-49f9-8c08-a70c8b00bf9d None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:32.139962 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-2cdce72c-c667-49f9-8c08-a70c8b00bf9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:32.151372 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 989/1993] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:26:32.152691 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d7a3d5-b1ca-4bbb-b405-57e2ddb94992 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:32.174648 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d7a3d5-b1ca-4bbb-b405-57e2ddb94992 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:32.180959 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473e39be-6cff-4f23-9810-45ce03a2ab4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:32.181813 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e39be-6cff-4f23-9810-45ce03a2ab4a admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:32.182253 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e39be-6cff-4f23-9810-45ce03a2ab4a admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:32.182530 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e39be-6cff-4f23-9810-45ce03a2ab4a admin admin] PATH_INFO: `/v3/domains` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:32.183784 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473e39be-6cff-4f23-9810-45ce03a2ab4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:26:32.184100 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473e39be-6cff-4f23-9810-45ce03a2ab4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:32.185742 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473e39be-6cff-4f23-9810-45ce03a2ab4a admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:32.205304 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1005/1994] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 12 18:26:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:26:32.211239 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdce72c-c667-49f9-8c08-a70c8b00bf9d None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:32.230902 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdce72c-c667-49f9-8c08-a70c8b00bf9d None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:32.235813 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a619b-231b-441c-988c-dd1bc43c6362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:32.236496 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a619b-231b-441c-988c-dd1bc43c6362 admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:32.236832 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a619b-231b-441c-988c-dd1bc43c6362 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:32.238096 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a619b-231b-441c-988c-dd1bc43c6362 admin admin] PATH_INFO: `/v3/projects` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:32.238433 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0a619b-231b-441c-988c-dd1bc43c6362 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:32.240636 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0a619b-231b-441c-988c-dd1bc43c6362 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:32.344771 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 990/1995] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:26:32 2021] POST /identity/v3/projects => generated 385 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:26:32.349599 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473e39be-6cff-4f23-9810-45ce03a2ab4a admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:32.365554 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473e39be-6cff-4f23-9810-45ce03a2ab4a admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:32.381104 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a619b-231b-441c-988c-dd1bc43c6362 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:32.383119 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-1d0a619b-231b-441c-988c-dd1bc43c6362 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:32.460851 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a619b-231b-441c-988c-dd1bc43c6362 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:32.462913 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270b874f-6eca-4e47-be48-49906aba412f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:32.463603 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b874f-6eca-4e47-be48-49906aba412f admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:32.463887 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b874f-6eca-4e47-be48-49906aba412f admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:32.464174 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b874f-6eca-4e47-be48-49906aba412f admin admin] PATH_INFO: `/v3/users` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:32.464923 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270b874f-6eca-4e47-be48-49906aba412f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:32.466680 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21b8b24-dad5-4ea3-b7d8-bb65a19e956c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:32.466927 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270b874f-6eca-4e47-be48-49906aba412f admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:32.467579 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21b8b24-dad5-4ea3-b7d8-bb65a19e956c admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:32.467879 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21b8b24-dad5-4ea3-b7d8-bb65a19e956c admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:32.468142 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21b8b24-dad5-4ea3-b7d8-bb65a19e956c admin admin] PATH_INFO: `/v3/projects/6c60d585614545668c14fd9dd7c3fc49` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:32.469386 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21b8b24-dad5-4ea3-b7d8-bb65a19e956c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c60d585614545668c14fd9dd7c3fc49)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:32.471281 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21b8b24-dad5-4ea3-b7d8-bb65a19e956c admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:32.561852 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1006/1996] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:26:32 2021] POST /identity/v3/users => generated 293 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:26:32.566378 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270b874f-6eca-4e47-be48-49906aba412f admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:32.579170 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270b874f-6eca-4e47-be48-49906aba412f admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:32.580881 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-e21b8b24-dad5-4ea3-b7d8-bb65a19e956c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c60d585614545668c14fd9dd7c3fc49', 'request_id': 'req-e21b8b24-dad5-4ea3-b7d8-bb65a19e956c'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:32.640596 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baec7d3-77d5-4cf0-931c-cfa2de2e0d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:32.641294 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baec7d3-77d5-4cf0-931c-cfa2de2e0d3f admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:32.641579 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baec7d3-77d5-4cf0-931c-cfa2de2e0d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:32.641855 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baec7d3-77d5-4cf0-931c-cfa2de2e0d3f admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:32.642608 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baec7d3-77d5-4cf0-931c-cfa2de2e0d3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:32.644223 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baec7d3-77d5-4cf0-931c-cfa2de2e0d3f admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:32.654814 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1007/1997] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:26:32 2021] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:26:32.658644 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-e21b8b24-dad5-4ea3-b7d8-bb65a19e956c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c60d585614545668c14fd9dd7c3fc49', 'request_id': 'req-e21b8b24-dad5-4ea3-b7d8-bb65a19e956c'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:32.658983 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baec7d3-77d5-4cf0-931c-cfa2de2e0d3f admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:32.666725 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-e21b8b24-dad5-4ea3-b7d8-bb65a19e956c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c60d585614545668c14fd9dd7c3fc49', 'request_id': 'req-e21b8b24-dad5-4ea3-b7d8-bb65a19e956c'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:32.669713 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baec7d3-77d5-4cf0-931c-cfa2de2e0d3f admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:32.674806 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec9490d-871a-41b9-91e6-a433844acfc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:32.676020 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec9490d-871a-41b9-91e6-a433844acfc3 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:32.676377 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec9490d-871a-41b9-91e6-a433844acfc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:32.676756 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec9490d-871a-41b9-91e6-a433844acfc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:32.677591 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec9490d-871a-41b9-91e6-a433844acfc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:32.679248 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec9490d-871a-41b9-91e6-a433844acfc3 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:32.679842 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-e21b8b24-dad5-4ea3-b7d8-bb65a19e956c admin admin] The token cache is being invalidate because project 6c60d585614545668c14fd9dd7c3fc49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:26:32.680163 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-e21b8b24-dad5-4ea3-b7d8-bb65a19e956c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:32.681103 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-e21b8b24-dad5-4ea3-b7d8-bb65a19e956c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:32.683064 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 991/1998] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:26:32 2021] DELETE /identity/v3/projects/6c60d585614545668c14fd9dd7c3fc49 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 18:26:32.688560 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7cd33e-573e-4ce2-a52e-192d21840db0 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:32.688925 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7cd33e-573e-4ce2-a52e-192d21840db0 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:32.689294 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7cd33e-573e-4ce2-a52e-192d21840db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:32.692223 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1008/1999] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:26:32 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 18:26:32.703439 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec9490d-871a-41b9-91e6-a433844acfc3 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:32.705171 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-bec9490d-871a-41b9-91e6-a433844acfc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:32.709424 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-7a7cd33e-573e-4ce2-a52e-192d21840db0 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:32.710748 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-7a7cd33e-573e-4ce2-a52e-192d21840db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:32.720981 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 992/2000] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:26:32.721724 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec9490d-871a-41b9-91e6-a433844acfc3 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:32.727008 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358f3b17-e3eb-4570-ac72-bd000d08e389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:32.727905 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f3b17-e3eb-4570-ac72-bd000d08e389 admin admin] REQUEST_METHOD: `PUT` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:32.728196 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f3b17-e3eb-4570-ac72-bd000d08e389 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:32.728506 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f3b17-e3eb-4570-ac72-bd000d08e389 admin admin] PATH_INFO: `/v3/projects/85f5fd256b8543aeb27f62d9a75587c9/users/7fdeedef4d424c62bf8d81bdb08a4a5b/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:32.730520 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2711bc34-f041-48b2-adec-1c4b7d5c08db None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:32.730812 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2711bc34-f041-48b2-adec-1c4b7d5c08db None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:32.731101 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2711bc34-f041-48b2-adec-1c4b7d5c08db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:32.756065 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358f3b17-e3eb-4570-ac72-bd000d08e389 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85f5fd256b8543aeb27f62d9a75587c9, user_id=7fdeedef4d424c62bf8d81bdb08a4a5b, role_id=33b8a5a8d1d643f2a98f598e6ab0a1cf)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:32.758725 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-2711bc34-f041-48b2-adec-1c4b7d5c08db None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:32.759251 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358f3b17-e3eb-4570-ac72-bd000d08e389 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:32.760236 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-2711bc34-f041-48b2-adec-1c4b7d5c08db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:32.769173 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 993/2001] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:26:32.772862 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2711bc34-f041-48b2-adec-1c4b7d5c08db None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:32.782442 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2711bc34-f041-48b2-adec-1c4b7d5c08db None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:32.787896 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd178aa2-133b-4812-aa6b-c179824ee02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:32.788754 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd178aa2-133b-4812-aa6b-c179824ee02d admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:32.789041 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd178aa2-133b-4812-aa6b-c179824ee02d admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:32.789363 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd178aa2-133b-4812-aa6b-c179824ee02d admin admin] PATH_INFO: `/v3/domains` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:32.790063 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd178aa2-133b-4812-aa6b-c179824ee02d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:26:32.790516 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd178aa2-133b-4812-aa6b-c179824ee02d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:32.793758 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd178aa2-133b-4812-aa6b-c179824ee02d admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:32.810583 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 994/2002] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 12 18:26:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:26:32.814869 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd178aa2-133b-4812-aa6b-c179824ee02d admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:32.826406 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd178aa2-133b-4812-aa6b-c179824ee02d admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:32.838418 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb48e9a-90d0-4477-b2e5-745307a63a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:32.839132 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb48e9a-90d0-4477-b2e5-745307a63a3b admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:32.839411 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb48e9a-90d0-4477-b2e5-745307a63a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:32.839720 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb48e9a-90d0-4477-b2e5-745307a63a3b admin admin] PATH_INFO: `/v3/projects` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:32.840392 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb48e9a-90d0-4477-b2e5-745307a63a3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:32.842472 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb48e9a-90d0-4477-b2e5-745307a63a3b admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:32.869648 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1009/2003] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:26:32 2021] PUT /identity/v3/projects/85f5fd256b8543aeb27f62d9a75587c9/users/7fdeedef4d424c62bf8d81bdb08a4a5b/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:26:32.886192 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008feb38-61fe-4c4f-8465-8340a6138f16 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:32.886741 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008feb38-61fe-4c4f-8465-8340a6138f16 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:32.887287 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008feb38-61fe-4c4f-8465-8340a6138f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:32.917386 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-008feb38-61fe-4c4f-8465-8340a6138f16 None None] MFA Rules not processed for user `7fdeedef4d424c62bf8d81bdb08a4a5b`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:32.918677 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-008feb38-61fe-4c4f-8465-8340a6138f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:32.940231 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 995/2004] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:26:32 2021] POST /identity/v3/projects => generated 387 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 18:26:32.941996 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb48e9a-90d0-4477-b2e5-745307a63a3b admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:32.987274 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1010/2005] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:32 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:26:32.998447 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008feb38-61fe-4c4f-8465-8340a6138f16 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:32.999866 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-008feb38-61fe-4c4f-8465-8340a6138f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:33.033404 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb48e9a-90d0-4477-b2e5-745307a63a3b admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:33.038867 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd30acf5-915e-4043-86e0-cd675ff7a100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:33.039246 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd30acf5-915e-4043-86e0-cd675ff7a100 admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:33.039587 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd30acf5-915e-4043-86e0-cd675ff7a100 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:33.039852 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd30acf5-915e-4043-86e0-cd675ff7a100 admin admin] PATH_INFO: `/v3/users` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:33.040593 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd30acf5-915e-4043-86e0-cd675ff7a100 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:33.045350 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd30acf5-915e-4043-86e0-cd675ff7a100 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:33.060504 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008feb38-61fe-4c4f-8465-8340a6138f16 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:33.113309 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d870c6b-6652-4723-813b-49ed4e9e8bfa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6966ce0774f4437a9b688494e9d0574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:33.114122 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d870c6b-6652-4723-813b-49ed4e9e8bfa service cinder] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:33.114337 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d870c6b-6652-4723-813b-49ed4e9e8bfa service cinder] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:33.114832 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d870c6b-6652-4723-813b-49ed4e9e8bfa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:33.165722 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 996/2006] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:26:32 2021] POST /identity/v3/users => generated 294 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 18:26:33.178246 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd30acf5-915e-4043-86e0-cd675ff7a100 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:33.181888 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d870c6b-6652-4723-813b-49ed4e9e8bfa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:33.184103 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d870c6b-6652-4723-813b-49ed4e9e8bfa service cinder] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:33.189610 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd30acf5-915e-4043-86e0-cd675ff7a100 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:33.200717 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1011/2007] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:26:32 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 18:26:33.200832 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e708ad-7ba2-4535-a187-697c239f783e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:33.200832 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e708ad-7ba2-4535-a187-697c239f783e admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:33.200832 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e708ad-7ba2-4535-a187-697c239f783e admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:33.200832 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e708ad-7ba2-4535-a187-697c239f783e admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:33.201180 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e708ad-7ba2-4535-a187-697c239f783e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:33.201180 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e708ad-7ba2-4535-a187-697c239f783e admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:33.211674 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 997/2008] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:26:33 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 18:26:33.217177 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d870c6b-6652-4723-813b-49ed4e9e8bfa service cinder] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:33.231406 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d870c6b-6652-4723-813b-49ed4e9e8bfa service cinder] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:33.236516 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336fc8aa-03ce-4003-b6dd-5140d48ef018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:33.237215 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336fc8aa-03ce-4003-b6dd-5140d48ef018 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:33.237518 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336fc8aa-03ce-4003-b6dd-5140d48ef018 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:33.238306 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336fc8aa-03ce-4003-b6dd-5140d48ef018 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:33.239802 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336fc8aa-03ce-4003-b6dd-5140d48ef018 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:33.240701 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336fc8aa-03ce-4003-b6dd-5140d48ef018 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:33.252436 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1012/2009] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:26:33 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:26:33.256467 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e708ad-7ba2-4535-a187-697c239f783e admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:33.266905 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e708ad-7ba2-4535-a187-697c239f783e admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:33.271827 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8d76ef-772d-4845-9fec-5c28d8abcbbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:33.272775 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d76ef-772d-4845-9fec-5c28d8abcbbb admin admin] REQUEST_METHOD: `PUT` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:33.273988 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d76ef-772d-4845-9fec-5c28d8abcbbb admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:33.273988 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d76ef-772d-4845-9fec-5c28d8abcbbb admin admin] PATH_INFO: `/v3/projects/d052340c41ab421e99f6242bff3ba060/users/c076e75bd7b0411aba00e9ba5d689c7e/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:33.290575 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8d76ef-772d-4845-9fec-5c28d8abcbbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d052340c41ab421e99f6242bff3ba060, user_id=c076e75bd7b0411aba00e9ba5d689c7e, role_id=33b8a5a8d1d643f2a98f598e6ab0a1cf)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:33.294602 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8d76ef-772d-4845-9fec-5c28d8abcbbb admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:33.383208 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 998/2010] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:26:33 2021] PUT /identity/v3/projects/d052340c41ab421e99f6242bff3ba060/users/c076e75bd7b0411aba00e9ba5d689c7e/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:26:33.393363 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488d08c-9d5d-4394-80b5-dcf2efaea026 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:33.393856 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488d08c-9d5d-4394-80b5-dcf2efaea026 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:33.393945 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488d08c-9d5d-4394-80b5-dcf2efaea026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:33.420131 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-1488d08c-9d5d-4394-80b5-dcf2efaea026 None None] MFA Rules not processed for user `c076e75bd7b0411aba00e9ba5d689c7e`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:33.428593 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-1488d08c-9d5d-4394-80b5-dcf2efaea026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:33.488260 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1013/2011] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:33 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:26:33.492839 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8d76ef-772d-4845-9fec-5c28d8abcbbb admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:33.556564 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8d76ef-772d-4845-9fec-5c28d8abcbbb admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:33.561201 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742ebb88-b32d-4d04-9d5c-4c94bef4a664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:33.561850 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ebb88-b32d-4d04-9d5c-4c94bef4a664 admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:33.562130 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ebb88-b32d-4d04-9d5c-4c94bef4a664 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:33.562405 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ebb88-b32d-4d04-9d5c-4c94bef4a664 admin admin] PATH_INFO: `/v3/projects` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:33.563104 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742ebb88-b32d-4d04-9d5c-4c94bef4a664 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:33.565024 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742ebb88-b32d-4d04-9d5c-4c94bef4a664 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:33.694131 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 999/2012] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:26:33 2021] POST /identity/v3/projects => generated 387 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 18:26:33.698352 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1488d08c-9d5d-4394-80b5-dcf2efaea026 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:33.709087 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1488d08c-9d5d-4394-80b5-dcf2efaea026 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:33.768818 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d051849a-c5f7-4337-b0d0-7f3ebdcb4123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:33.769548 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d051849a-c5f7-4337-b0d0-7f3ebdcb4123 admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:33.769830 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d051849a-c5f7-4337-b0d0-7f3ebdcb4123 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:33.770101 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d051849a-c5f7-4337-b0d0-7f3ebdcb4123 admin admin] PATH_INFO: `/v3/users` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:33.770807 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d051849a-c5f7-4337-b0d0-7f3ebdcb4123 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:33.772762 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d051849a-c5f7-4337-b0d0-7f3ebdcb4123 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:33.965925 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1014/2013] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:26:33 2021] POST /identity/v3/users => generated 300 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 18:26:33.970006 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742ebb88-b32d-4d04-9d5c-4c94bef4a664 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:33.980321 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742ebb88-b32d-4d04-9d5c-4c94bef4a664 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:33.984973 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85093af1-433e-4d03-8688-bb3eba7d48bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:33.985623 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85093af1-433e-4d03-8688-bb3eba7d48bc admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:33.985899 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85093af1-433e-4d03-8688-bb3eba7d48bc admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:33.986167 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85093af1-433e-4d03-8688-bb3eba7d48bc admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:33.986942 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85093af1-433e-4d03-8688-bb3eba7d48bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:33.989246 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85093af1-433e-4d03-8688-bb3eba7d48bc admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:33.999977 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1000/2014] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:26:33 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:26:34.013568 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d051849a-c5f7-4337-b0d0-7f3ebdcb4123 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:34.024112 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d051849a-c5f7-4337-b0d0-7f3ebdcb4123 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:34.029316 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a95752e-8dae-4cb4-9354-d250a8f92cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:34.030205 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a95752e-8dae-4cb4-9354-d250a8f92cee admin admin] REQUEST_METHOD: `PUT` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:34.030504 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a95752e-8dae-4cb4-9354-d250a8f92cee admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:34.030766 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a95752e-8dae-4cb4-9354-d250a8f92cee admin admin] PATH_INFO: `/v3/projects/56085c4d7fc941b4ae44ddc8bff0f4da/users/4dbcc79266694293a631aa90be2f22fa/roles/6c54f239944d46e3b027ccce97eb8b49` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:34.049337 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a95752e-8dae-4cb4-9354-d250a8f92cee admin admin] RBAC: Authorizing `identity:create_grant(project_id=56085c4d7fc941b4ae44ddc8bff0f4da, user_id=4dbcc79266694293a631aa90be2f22fa, role_id=6c54f239944d46e3b027ccce97eb8b49)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:34.052044 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a95752e-8dae-4cb4-9354-d250a8f92cee admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:34.160254 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1015/2015] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:26:34 2021] PUT /identity/v3/projects/56085c4d7fc941b4ae44ddc8bff0f4da/users/4dbcc79266694293a631aa90be2f22fa/roles/6c54f239944d46e3b027ccce97eb8b49 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 18:26:34.164246 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85093af1-433e-4d03-8688-bb3eba7d48bc admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:34.176645 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85093af1-433e-4d03-8688-bb3eba7d48bc admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:34.241004 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb1e0db-c1eb-44ce-992e-ce2535aa6368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:34.245399 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1e0db-c1eb-44ce-992e-ce2535aa6368 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:34.245399 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1e0db-c1eb-44ce-992e-ce2535aa6368 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:34.245399 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1e0db-c1eb-44ce-992e-ce2535aa6368 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:34.245399 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb1e0db-c1eb-44ce-992e-ce2535aa6368 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:34.245399 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb1e0db-c1eb-44ce-992e-ce2535aa6368 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:34.254686 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1001/2016] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:26:34 2021] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:26:34.258909 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a95752e-8dae-4cb4-9354-d250a8f92cee admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:34.269657 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a95752e-8dae-4cb4-9354-d250a8f92cee admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:34.274247 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85800ff1-d1ad-46c2-bf26-763361a67f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:34.275375 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85800ff1-d1ad-46c2-bf26-763361a67f08 admin admin] REQUEST_METHOD: `PUT` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:34.275658 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85800ff1-d1ad-46c2-bf26-763361a67f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:34.275935 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85800ff1-d1ad-46c2-bf26-763361a67f08 admin admin] PATH_INFO: `/v3/projects/56085c4d7fc941b4ae44ddc8bff0f4da/users/4dbcc79266694293a631aa90be2f22fa/roles/6c54f239944d46e3b027ccce97eb8b49` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:34.277946 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85800ff1-d1ad-46c2-bf26-763361a67f08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56085c4d7fc941b4ae44ddc8bff0f4da, user_id=4dbcc79266694293a631aa90be2f22fa, role_id=6c54f239944d46e3b027ccce97eb8b49)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:34.280622 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85800ff1-d1ad-46c2-bf26-763361a67f08 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:34.291036 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1016/2017] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:26:34 2021] PUT /identity/v3/projects/56085c4d7fc941b4ae44ddc8bff0f4da/users/4dbcc79266694293a631aa90be2f22fa/roles/6c54f239944d46e3b027ccce97eb8b49 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 18:26:34.302632 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4991a57-8812-44f3-990d-10d34742a7dd None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:34.302918 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4991a57-8812-44f3-990d-10d34742a7dd None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:34.303191 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4991a57-8812-44f3-990d-10d34742a7dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:34.330339 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-c4991a57-8812-44f3-990d-10d34742a7dd None None] MFA Rules not processed for user `4dbcc79266694293a631aa90be2f22fa`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:34.332155 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-c4991a57-8812-44f3-990d-10d34742a7dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:34.398101 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1002/2018] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:34 2021] POST /identity/v3/auth/tokens => generated 3474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:26:34.409649 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85800ff1-d1ad-46c2-bf26-763361a67f08 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:34.411369 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-85800ff1-d1ad-46c2-bf26-763361a67f08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:34.467106 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85800ff1-d1ad-46c2-bf26-763361a67f08 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:34.470714 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c086d7-d55a-4937-b6d6-d3bace270dfb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6966ce0774f4437a9b688494e9d0574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:34.471349 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c086d7-d55a-4937-b6d6-d3bace270dfb service cinder] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:34.471630 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c086d7-d55a-4937-b6d6-d3bace270dfb service cinder] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:34.471930 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c086d7-d55a-4937-b6d6-d3bace270dfb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:34.480695 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c086d7-d55a-4937-b6d6-d3bace270dfb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:34.482112 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c086d7-d55a-4937-b6d6-d3bace270dfb service cinder] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:34.492229 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1017/2019] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:26:34 2021] GET /identity/v3/auth/tokens => generated 3474 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:26:36.403718 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4991a57-8812-44f3-990d-10d34742a7dd None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:36.468670 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4991a57-8812-44f3-990d-10d34742a7dd None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:36.480929 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e8ae02-b375-4202-923d-0b65fdf0e707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:36.481807 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e8ae02-b375-4202-923d-0b65fdf0e707 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:36.482084 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e8ae02-b375-4202-923d-0b65fdf0e707 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:36.482354 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e8ae02-b375-4202-923d-0b65fdf0e707 admin admin] PATH_INFO: `/v3/users/c076e75bd7b0411aba00e9ba5d689c7e` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:36.483720 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e8ae02-b375-4202-923d-0b65fdf0e707 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c076e75bd7b0411aba00e9ba5d689c7e)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:36.485738 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e8ae02-b375-4202-923d-0b65fdf0e707 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:36.697924 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-d7e8ae02-b375-4202-923d-0b65fdf0e707 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c076e75bd7b0411aba00e9ba5d689c7e'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:36.704566 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-d7e8ae02-b375-4202-923d-0b65fdf0e707 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c076e75bd7b0411aba00e9ba5d689c7e'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:36.716573 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-d7e8ae02-b375-4202-923d-0b65fdf0e707 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c076e75bd7b0411aba00e9ba5d689c7e'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:36.815882 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-d7e8ae02-b375-4202-923d-0b65fdf0e707 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c076e75bd7b0411aba00e9ba5d689c7e'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:36.815882 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-d7e8ae02-b375-4202-923d-0b65fdf0e707 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c076e75bd7b0411aba00e9ba5d689c7e'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:36.821382 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1003/2020] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:26:36 2021] DELETE /identity/v3/users/c076e75bd7b0411aba00e9ba5d689c7e => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:26:36.826340 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b274623a-4b03-4933-a86c-93c15a10dc61 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:36.826852 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b274623a-4b03-4933-a86c-93c15a10dc61 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:36.827186 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b274623a-4b03-4933-a86c-93c15a10dc61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:36.852074 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-b274623a-4b03-4933-a86c-93c15a10dc61 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:36.853443 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-b274623a-4b03-4933-a86c-93c15a10dc61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:36.895931 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e8ae02-b375-4202-923d-0b65fdf0e707 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:36.897349 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-d7e8ae02-b375-4202-923d-0b65fdf0e707 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:36.920234 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1018/2021] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:26:36.931299 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b274623a-4b03-4933-a86c-93c15a10dc61 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:36.933241 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-b274623a-4b03-4933-a86c-93c15a10dc61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:36.974714 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e8ae02-b375-4202-923d-0b65fdf0e707 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:36.980153 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df03de0b-5be6-4293-90ed-56719c29b5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:36.981061 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df03de0b-5be6-4293-90ed-56719c29b5ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:36.981340 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df03de0b-5be6-4293-90ed-56719c29b5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:36.981674 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df03de0b-5be6-4293-90ed-56719c29b5ea admin admin] PATH_INFO: `/v3/users/52368b9b6bec41f0b71949ea1bb4a949` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:36.983002 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df03de0b-5be6-4293-90ed-56719c29b5ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=52368b9b6bec41f0b71949ea1bb4a949)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:36.985159 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df03de0b-5be6-4293-90ed-56719c29b5ea admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:36.991686 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b274623a-4b03-4933-a86c-93c15a10dc61 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:36.995495 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24e8a7d-dd6e-43d9-8c7d-dcfb12196868 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:36.996148 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24e8a7d-dd6e-43d9-8c7d-dcfb12196868 service neutron] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:36.996434 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24e8a7d-dd6e-43d9-8c7d-dcfb12196868 service neutron] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:36.996715 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24e8a7d-dd6e-43d9-8c7d-dcfb12196868 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:37.006559 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24e8a7d-dd6e-43d9-8c7d-dcfb12196868 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:37.011241 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24e8a7d-dd6e-43d9-8c7d-dcfb12196868 service neutron] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:37.020551 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1019/2022] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:26:36 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 18:26:37.254629 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-df03de0b-5be6-4293-90ed-56719c29b5ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52368b9b6bec41f0b71949ea1bb4a949'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:37.262761 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-df03de0b-5be6-4293-90ed-56719c29b5ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52368b9b6bec41f0b71949ea1bb4a949'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:37.281959 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-df03de0b-5be6-4293-90ed-56719c29b5ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52368b9b6bec41f0b71949ea1bb4a949'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:37.354015 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-df03de0b-5be6-4293-90ed-56719c29b5ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52368b9b6bec41f0b71949ea1bb4a949'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:37.361622 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-df03de0b-5be6-4293-90ed-56719c29b5ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52368b9b6bec41f0b71949ea1bb4a949'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:37.365434 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1004/2023] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:26:36 2021] DELETE /identity/v3/users/52368b9b6bec41f0b71949ea1bb4a949 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 18:26:37.372033 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cdd178-cf77-434d-94d8-7ea68ddb32f9 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:37.372961 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cdd178-cf77-434d-94d8-7ea68ddb32f9 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:37.376713 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cdd178-cf77-434d-94d8-7ea68ddb32f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:37.395614 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-17cdd178-cf77-434d-94d8-7ea68ddb32f9 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:37.397535 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-17cdd178-cf77-434d-94d8-7ea68ddb32f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:37.456083 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1020/2024] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:26:37.466012 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df03de0b-5be6-4293-90ed-56719c29b5ea admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:37.467434 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-df03de0b-5be6-4293-90ed-56719c29b5ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:37.526256 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df03de0b-5be6-4293-90ed-56719c29b5ea admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:37.534046 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb38654e-76b9-4e66-9583-571984e815ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:37.537956 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb38654e-76b9-4e66-9583-571984e815ea service neutron] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:37.537956 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb38654e-76b9-4e66-9583-571984e815ea service neutron] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:37.537956 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb38654e-76b9-4e66-9583-571984e815ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:37.539465 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cdd178-cf77-434d-94d8-7ea68ddb32f9 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:37.541120 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-17cdd178-cf77-434d-94d8-7ea68ddb32f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:37.553606 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb38654e-76b9-4e66-9583-571984e815ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:37.556125 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb38654e-76b9-4e66-9583-571984e815ea service neutron] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:37.560370 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cdd178-cf77-434d-94d8-7ea68ddb32f9 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:37.569155 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1005/2025] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:26:37 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:26:37.581154 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25de8c88-794d-4291-995a-1bffc479fabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:37.582692 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25de8c88-794d-4291-995a-1bffc479fabe admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:37.583201 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25de8c88-794d-4291-995a-1bffc479fabe admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:37.583697 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25de8c88-794d-4291-995a-1bffc479fabe admin admin] PATH_INFO: `/v3/projects/d052340c41ab421e99f6242bff3ba060` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:37.585869 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25de8c88-794d-4291-995a-1bffc479fabe admin admin] RBAC: Authorizing `identity:delete_project(project_id=d052340c41ab421e99f6242bff3ba060)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:37.589631 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25de8c88-794d-4291-995a-1bffc479fabe admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:37.732041 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-25de8c88-794d-4291-995a-1bffc479fabe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd052340c41ab421e99f6242bff3ba060', 'request_id': 'req-25de8c88-794d-4291-995a-1bffc479fabe'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:37.738749 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-25de8c88-794d-4291-995a-1bffc479fabe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd052340c41ab421e99f6242bff3ba060', 'request_id': 'req-25de8c88-794d-4291-995a-1bffc479fabe'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:37.745138 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-25de8c88-794d-4291-995a-1bffc479fabe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd052340c41ab421e99f6242bff3ba060', 'request_id': 'req-25de8c88-794d-4291-995a-1bffc479fabe'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:37.834784 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-25de8c88-794d-4291-995a-1bffc479fabe admin admin] The token cache is being invalidate because project d052340c41ab421e99f6242bff3ba060 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74005) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:26:37.835509 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-25de8c88-794d-4291-995a-1bffc479fabe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:37.836452 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-25de8c88-794d-4291-995a-1bffc479fabe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:37.848084 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1021/2026] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:26:37 2021] DELETE /identity/v3/projects/d052340c41ab421e99f6242bff3ba060 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 18:26:37.852228 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb38654e-76b9-4e66-9583-571984e815ea service neutron] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:37.863267 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb38654e-76b9-4e66-9583-571984e815ea service neutron] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:37.927659 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a1b14a-aba7-4e20-b2bf-801816df65ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:37.928578 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1b14a-aba7-4e20-b2bf-801816df65ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:37.928858 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1b14a-aba7-4e20-b2bf-801816df65ec admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:37.929131 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1b14a-aba7-4e20-b2bf-801816df65ec admin admin] PATH_INFO: `/v3/users/4dbcc79266694293a631aa90be2f22fa` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:37.930461 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a1b14a-aba7-4e20-b2bf-801816df65ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dbcc79266694293a631aa90be2f22fa)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:37.932448 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a1b14a-aba7-4e20-b2bf-801816df65ec admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:38.120842 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-16a1b14a-aba7-4e20-b2bf-801816df65ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dbcc79266694293a631aa90be2f22fa'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:38.127603 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-16a1b14a-aba7-4e20-b2bf-801816df65ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dbcc79266694293a631aa90be2f22fa'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:38.139259 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-16a1b14a-aba7-4e20-b2bf-801816df65ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dbcc79266694293a631aa90be2f22fa'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:38.236195 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25de8c88-794d-4291-995a-1bffc479fabe admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:38.237923 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-25de8c88-794d-4291-995a-1bffc479fabe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:38.241554 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-16a1b14a-aba7-4e20-b2bf-801816df65ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dbcc79266694293a631aa90be2f22fa'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:38.241554 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-16a1b14a-aba7-4e20-b2bf-801816df65ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dbcc79266694293a631aa90be2f22fa'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:38.247803 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1006/2027] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:26:37 2021] DELETE /identity/v3/users/4dbcc79266694293a631aa90be2f22fa => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:26:38.255883 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25de8c88-794d-4291-995a-1bffc479fabe admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:38.434088 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d5e539-8dd9-4050-99bb-6017de0fe96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:38.435029 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d5e539-8dd9-4050-99bb-6017de0fe96f admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:38.435295 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d5e539-8dd9-4050-99bb-6017de0fe96f admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:38.435573 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d5e539-8dd9-4050-99bb-6017de0fe96f admin admin] PATH_INFO: `/v3/projects/f0c98993fa0f4da3bb2984cb4f371d2e` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:38.436809 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d5e539-8dd9-4050-99bb-6017de0fe96f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0c98993fa0f4da3bb2984cb4f371d2e)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:38.438758 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d5e539-8dd9-4050-99bb-6017de0fe96f admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:38.576310 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-73d5e539-8dd9-4050-99bb-6017de0fe96f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0c98993fa0f4da3bb2984cb4f371d2e', 'request_id': 'req-73d5e539-8dd9-4050-99bb-6017de0fe96f'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:38.583096 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-73d5e539-8dd9-4050-99bb-6017de0fe96f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0c98993fa0f4da3bb2984cb4f371d2e', 'request_id': 'req-73d5e539-8dd9-4050-99bb-6017de0fe96f'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:38.588530 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-73d5e539-8dd9-4050-99bb-6017de0fe96f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0c98993fa0f4da3bb2984cb4f371d2e', 'request_id': 'req-73d5e539-8dd9-4050-99bb-6017de0fe96f'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:38.673048 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-73d5e539-8dd9-4050-99bb-6017de0fe96f admin admin] The token cache is being invalidate because project f0c98993fa0f4da3bb2984cb4f371d2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74005) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:26:38.673331 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-73d5e539-8dd9-4050-99bb-6017de0fe96f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:38.673957 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-73d5e539-8dd9-4050-99bb-6017de0fe96f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:38.675504 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1022/2028] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:26:38 2021] DELETE /identity/v3/projects/f0c98993fa0f4da3bb2984cb4f371d2e => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 18:26:38.679451 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a1b14a-aba7-4e20-b2bf-801816df65ec admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:38.680989 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-16a1b14a-aba7-4e20-b2bf-801816df65ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:38.683751 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d5e539-8dd9-4050-99bb-6017de0fe96f admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:38.685462 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-73d5e539-8dd9-4050-99bb-6017de0fe96f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:38.700998 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a1b14a-aba7-4e20-b2bf-801816df65ec admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:38.749101 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d5e539-8dd9-4050-99bb-6017de0fe96f admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:38.754265 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ffb0d-182a-479a-8bc6-9ad1360141ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:38.755114 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ffb0d-182a-479a-8bc6-9ad1360141ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:38.755396 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ffb0d-182a-479a-8bc6-9ad1360141ae admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:38.755673 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ffb0d-182a-479a-8bc6-9ad1360141ae admin admin] PATH_INFO: `/v3/projects/56085c4d7fc941b4ae44ddc8bff0f4da` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:38.756903 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296ffb0d-182a-479a-8bc6-9ad1360141ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=56085c4d7fc941b4ae44ddc8bff0f4da)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:38.758809 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296ffb0d-182a-479a-8bc6-9ad1360141ae admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:38.763129 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89daaa05-527c-4733-8818-d4246a647f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:38.764014 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89daaa05-527c-4733-8818-d4246a647f1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:38.764296 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89daaa05-527c-4733-8818-d4246a647f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:38.764609 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89daaa05-527c-4733-8818-d4246a647f1a admin admin] PATH_INFO: `/v3/users/3e922257a5464ffc8cac6034afa01353` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:38.765822 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89daaa05-527c-4733-8818-d4246a647f1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e922257a5464ffc8cac6034afa01353)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:38.767718 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89daaa05-527c-4733-8818-d4246a647f1a admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:38.891987 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-296ffb0d-182a-479a-8bc6-9ad1360141ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56085c4d7fc941b4ae44ddc8bff0f4da', 'request_id': 'req-296ffb0d-182a-479a-8bc6-9ad1360141ae'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:38.899102 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-296ffb0d-182a-479a-8bc6-9ad1360141ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56085c4d7fc941b4ae44ddc8bff0f4da', 'request_id': 'req-296ffb0d-182a-479a-8bc6-9ad1360141ae'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:38.905560 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-296ffb0d-182a-479a-8bc6-9ad1360141ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56085c4d7fc941b4ae44ddc8bff0f4da', 'request_id': 'req-296ffb0d-182a-479a-8bc6-9ad1360141ae'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:39.001703 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-89daaa05-527c-4733-8818-d4246a647f1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e922257a5464ffc8cac6034afa01353'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:39.005325 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-296ffb0d-182a-479a-8bc6-9ad1360141ae admin admin] The token cache is being invalidate because project 56085c4d7fc941b4ae44ddc8bff0f4da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74005) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:26:39.005618 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-296ffb0d-182a-479a-8bc6-9ad1360141ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:39.006280 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-296ffb0d-182a-479a-8bc6-9ad1360141ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:39.007830 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1023/2029] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:26:38 2021] DELETE /identity/v3/projects/56085c4d7fc941b4ae44ddc8bff0f4da => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 18:26:39.012037 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-89daaa05-527c-4733-8818-d4246a647f1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e922257a5464ffc8cac6034afa01353'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:39.013450 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdfd075-310b-420e-9980-cad0adff4252 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:39.013744 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdfd075-310b-420e-9980-cad0adff4252 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:39.014024 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdfd075-310b-420e-9980-cad0adff4252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:39.021156 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-89daaa05-527c-4733-8818-d4246a647f1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e922257a5464ffc8cac6034afa01353'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:39.032001 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-6fdfd075-310b-420e-9980-cad0adff4252 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:39.033229 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-6fdfd075-310b-420e-9980-cad0adff4252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:39.089868 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1024/2030] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:26:39.091419 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-89daaa05-527c-4733-8818-d4246a647f1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e922257a5464ffc8cac6034afa01353'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:39.092034 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-89daaa05-527c-4733-8818-d4246a647f1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e922257a5464ffc8cac6034afa01353'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:39.098848 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69602f0-7cbf-4d17-acc5-49420eec7a00 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:39.099100 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1007/2031] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:26:38 2021] DELETE /identity/v3/users/3e922257a5464ffc8cac6034afa01353 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:26:39.099225 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69602f0-7cbf-4d17-acc5-49420eec7a00 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:39.099403 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69602f0-7cbf-4d17-acc5-49420eec7a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:39.118570 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-b69602f0-7cbf-4d17-acc5-49420eec7a00 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:39.119795 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-b69602f0-7cbf-4d17-acc5-49420eec7a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:39.177903 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1025/2032] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:26:39.181886 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89daaa05-527c-4733-8818-d4246a647f1a admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:39.192741 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89daaa05-527c-4733-8818-d4246a647f1a admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:39.197584 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab7bf06-3d6e-4a5b-95c9-072cd2e2725f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:39.198241 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab7bf06-3d6e-4a5b-95c9-072cd2e2725f admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:39.198547 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab7bf06-3d6e-4a5b-95c9-072cd2e2725f admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:39.198826 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab7bf06-3d6e-4a5b-95c9-072cd2e2725f admin admin] PATH_INFO: `/v3/domains` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:39.199563 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab7bf06-3d6e-4a5b-95c9-072cd2e2725f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:26:39.199870 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab7bf06-3d6e-4a5b-95c9-072cd2e2725f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:39.201492 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab7bf06-3d6e-4a5b-95c9-072cd2e2725f admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:39.213112 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1008/2033] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 12 18:26:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:26:39.217484 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69602f0-7cbf-4d17-acc5-49420eec7a00 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:39.227012 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69602f0-7cbf-4d17-acc5-49420eec7a00 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:39.231625 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5a3aea-5a0a-4ab7-812a-1b1161bd00ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:39.232261 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a3aea-5a0a-4ab7-812a-1b1161bd00ef admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:39.232571 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a3aea-5a0a-4ab7-812a-1b1161bd00ef admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:39.232841 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a3aea-5a0a-4ab7-812a-1b1161bd00ef admin admin] PATH_INFO: `/v3/projects` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:39.233548 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5a3aea-5a0a-4ab7-812a-1b1161bd00ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:39.235569 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5a3aea-5a0a-4ab7-812a-1b1161bd00ef admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:39.355152 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1026/2034] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:26:39 2021] POST /identity/v3/projects => generated 385 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:26:39.359589 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab7bf06-3d6e-4a5b-95c9-072cd2e2725f admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:39.370394 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab7bf06-3d6e-4a5b-95c9-072cd2e2725f admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:39.425709 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3646e497-3c46-4a96-9c91-1141cf1a2ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:39.426313 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3646e497-3c46-4a96-9c91-1141cf1a2ab3 admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:39.426598 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3646e497-3c46-4a96-9c91-1141cf1a2ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:39.426876 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3646e497-3c46-4a96-9c91-1141cf1a2ab3 admin admin] PATH_INFO: `/v3/users` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:39.427576 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3646e497-3c46-4a96-9c91-1141cf1a2ab3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:39.429583 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3646e497-3c46-4a96-9c91-1141cf1a2ab3 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:39.486592 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5a3aea-5a0a-4ab7-812a-1b1161bd00ef admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:39.489368 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-2c5a3aea-5a0a-4ab7-812a-1b1161bd00ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:39.504217 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5a3aea-5a0a-4ab7-812a-1b1161bd00ef admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:39.510117 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0a9093-73d5-4e82-90f8-6420878a734b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:39.511112 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a9093-73d5-4e82-90f8-6420878a734b admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:39.512094 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a9093-73d5-4e82-90f8-6420878a734b admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:39.512094 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a9093-73d5-4e82-90f8-6420878a734b admin admin] PATH_INFO: `/v3/projects/fd72c5b05c304c6a86b0ea79cd0bd467` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:39.514128 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0a9093-73d5-4e82-90f8-6420878a734b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd72c5b05c304c6a86b0ea79cd0bd467)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:39.517952 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1009/2035] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:26:39 2021] POST /identity/v3/users => generated 293 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 18:26:39.518082 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0a9093-73d5-4e82-90f8-6420878a734b admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:39.519221 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3646e497-3c46-4a96-9c91-1141cf1a2ab3 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:39.529266 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3646e497-3c46-4a96-9c91-1141cf1a2ab3 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:39.533918 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2923eaf-02c3-480c-801b-885c8b0dc696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:39.535087 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2923eaf-02c3-480c-801b-885c8b0dc696 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:39.535368 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2923eaf-02c3-480c-801b-885c8b0dc696 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:39.535642 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2923eaf-02c3-480c-801b-885c8b0dc696 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:39.536384 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2923eaf-02c3-480c-801b-885c8b0dc696 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:39.540682 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2923eaf-02c3-480c-801b-885c8b0dc696 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:39.547969 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1010/2036] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:26:39 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 18:26:39.552606 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2923eaf-02c3-480c-801b-885c8b0dc696 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:39.561938 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2923eaf-02c3-480c-801b-885c8b0dc696 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:39.566600 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fdc72e-1cce-47ba-8615-f1f3bfe598e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:39.567256 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fdc72e-1cce-47ba-8615-f1f3bfe598e4 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:39.567543 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fdc72e-1cce-47ba-8615-f1f3bfe598e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:39.567822 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fdc72e-1cce-47ba-8615-f1f3bfe598e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:39.568577 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fdc72e-1cce-47ba-8615-f1f3bfe598e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:39.570136 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fdc72e-1cce-47ba-8615-f1f3bfe598e4 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:39.581913 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1011/2037] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:26:39 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 18:26:39.585899 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fdc72e-1cce-47ba-8615-f1f3bfe598e4 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:39.594861 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fdc72e-1cce-47ba-8615-f1f3bfe598e4 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:39.600033 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d05c7f5-24c4-4a86-ab41-f2d356e8a427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:39.600905 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d05c7f5-24c4-4a86-ab41-f2d356e8a427 admin admin] REQUEST_METHOD: `PUT` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:39.601190 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d05c7f5-24c4-4a86-ab41-f2d356e8a427 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:39.601468 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d05c7f5-24c4-4a86-ab41-f2d356e8a427 admin admin] PATH_INFO: `/v3/projects/f1d89399a662419abd9e68a1e4bbeb6f/users/78a94a29ad9142988e26f90d99bd7ce5/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:39.615593 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d05c7f5-24c4-4a86-ab41-f2d356e8a427 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1d89399a662419abd9e68a1e4bbeb6f, user_id=78a94a29ad9142988e26f90d99bd7ce5, role_id=33b8a5a8d1d643f2a98f598e6ab0a1cf)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:39.618234 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d05c7f5-24c4-4a86-ab41-f2d356e8a427 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:39.622151 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-ad0a9093-73d5-4e82-90f8-6420878a734b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd72c5b05c304c6a86b0ea79cd0bd467', 'request_id': 'req-ad0a9093-73d5-4e82-90f8-6420878a734b'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:39.628968 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-ad0a9093-73d5-4e82-90f8-6420878a734b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd72c5b05c304c6a86b0ea79cd0bd467', 'request_id': 'req-ad0a9093-73d5-4e82-90f8-6420878a734b'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:39.634254 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-ad0a9093-73d5-4e82-90f8-6420878a734b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd72c5b05c304c6a86b0ea79cd0bd467', 'request_id': 'req-ad0a9093-73d5-4e82-90f8-6420878a734b'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:39.680277 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1012/2038] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:26:39 2021] PUT /identity/v3/projects/f1d89399a662419abd9e68a1e4bbeb6f/users/78a94a29ad9142988e26f90d99bd7ce5/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 18:26:39.690809 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf2c9c7-7224-4cc2-bb5a-3e4100697921 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:39.691093 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf2c9c7-7224-4cc2-bb5a-3e4100697921 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:39.691393 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf2c9c7-7224-4cc2-bb5a-3e4100697921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:39.702030 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-ad0a9093-73d5-4e82-90f8-6420878a734b admin admin] The token cache is being invalidate because project fd72c5b05c304c6a86b0ea79cd0bd467 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74005) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:26:39.702284 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-ad0a9093-73d5-4e82-90f8-6420878a734b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:39.702959 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-ad0a9093-73d5-4e82-90f8-6420878a734b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:39.709051 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1027/2039] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:26:39 2021] DELETE /identity/v3/projects/fd72c5b05c304c6a86b0ea79cd0bd467 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 18:26:39.710035 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0a9093-73d5-4e82-90f8-6420878a734b admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:39.711388 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-ad0a9093-73d5-4e82-90f8-6420878a734b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:39.718931 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-bdf2c9c7-7224-4cc2-bb5a-3e4100697921 None None] MFA Rules not processed for user `78a94a29ad9142988e26f90d99bd7ce5`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:39.720132 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-bdf2c9c7-7224-4cc2-bb5a-3e4100697921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:39.796279 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0a9093-73d5-4e82-90f8-6420878a734b admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:39.802807 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1013/2040] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:39 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:26:39.807351 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf2c9c7-7224-4cc2-bb5a-3e4100697921 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:39.808786 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-bdf2c9c7-7224-4cc2-bb5a-3e4100697921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:39.867909 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dea9d3-0adb-4947-8211-2aab34a4e3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:39.868888 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dea9d3-0adb-4947-8211-2aab34a4e3a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:39.869169 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dea9d3-0adb-4947-8211-2aab34a4e3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:39.869441 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dea9d3-0adb-4947-8211-2aab34a4e3a8 admin admin] PATH_INFO: `/v3/users/99aa590a737f4f6bb7bc991e24cadf7d` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:39.870782 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dea9d3-0adb-4947-8211-2aab34a4e3a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99aa590a737f4f6bb7bc991e24cadf7d)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:39.872754 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dea9d3-0adb-4947-8211-2aab34a4e3a8 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:39.883301 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf2c9c7-7224-4cc2-bb5a-3e4100697921 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:39.889082 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27941852-28b6-48dd-87a6-6c8f9a924f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:39.892523 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27941852-28b6-48dd-87a6-6c8f9a924f1d admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:39.892523 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27941852-28b6-48dd-87a6-6c8f9a924f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:39.892523 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27941852-28b6-48dd-87a6-6c8f9a924f1d admin admin] PATH_INFO: `/v3/projects` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:39.892523 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27941852-28b6-48dd-87a6-6c8f9a924f1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:39.895797 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27941852-28b6-48dd-87a6-6c8f9a924f1d admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:40.018538 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1014/2041] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:26:39 2021] POST /identity/v3/projects => generated 383 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 18:26:40.022801 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27941852-28b6-48dd-87a6-6c8f9a924f1d admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:40.082455 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27941852-28b6-48dd-87a6-6c8f9a924f1d admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:40.087151 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaa6e53-a3ba-4067-9150-f418a057d189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:40.087779 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa6e53-a3ba-4067-9150-f418a057d189 admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:40.088052 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa6e53-a3ba-4067-9150-f418a057d189 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:40.088329 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa6e53-a3ba-4067-9150-f418a057d189 admin admin] PATH_INFO: `/v3/users` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:40.089049 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaa6e53-a3ba-4067-9150-f418a057d189 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:40.090962 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaa6e53-a3ba-4067-9150-f418a057d189 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:40.092503 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-61dea9d3-0adb-4947-8211-2aab34a4e3a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99aa590a737f4f6bb7bc991e24cadf7d'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:40.093169 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-61dea9d3-0adb-4947-8211-2aab34a4e3a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99aa590a737f4f6bb7bc991e24cadf7d'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:40.105055 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-61dea9d3-0adb-4947-8211-2aab34a4e3a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99aa590a737f4f6bb7bc991e24cadf7d'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:40.105719 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-61dea9d3-0adb-4947-8211-2aab34a4e3a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99aa590a737f4f6bb7bc991e24cadf7d'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:40.112576 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-61dea9d3-0adb-4947-8211-2aab34a4e3a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99aa590a737f4f6bb7bc991e24cadf7d'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:40.177734 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1015/2042] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:26:40 2021] POST /identity/v3/users => generated 298 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 18:26:40.181588 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaa6e53-a3ba-4067-9150-f418a057d189 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:40.182767 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1028/2043] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:26:39 2021] DELETE /identity/v3/users/99aa590a737f4f6bb7bc991e24cadf7d => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 18:26:40.187983 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-afaa6e53-a3ba-4067-9150-f418a057d189 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:40.195736 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaa6e53-a3ba-4067-9150-f418a057d189 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:40.250794 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0cab11-a36b-46fc-8099-87f55900cb5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:40.251468 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0cab11-a36b-46fc-8099-87f55900cb5b admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:40.251747 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0cab11-a36b-46fc-8099-87f55900cb5b admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:40.252018 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0cab11-a36b-46fc-8099-87f55900cb5b admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:40.252798 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0cab11-a36b-46fc-8099-87f55900cb5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:40.254930 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0cab11-a36b-46fc-8099-87f55900cb5b admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:40.264791 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1016/2044] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:26:40 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 18:26:40.269626 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dea9d3-0adb-4947-8211-2aab34a4e3a8 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:40.279983 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dea9d3-0adb-4947-8211-2aab34a4e3a8 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:40.284690 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9443fc-92b6-4d4e-895b-facfa477d577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:40.285580 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9443fc-92b6-4d4e-895b-facfa477d577 admin admin] REQUEST_METHOD: `PUT` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:40.285861 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9443fc-92b6-4d4e-895b-facfa477d577 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:40.286132 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9443fc-92b6-4d4e-895b-facfa477d577 admin admin] PATH_INFO: `/v3/projects/f77a2a2e456b441486f41e62c8bc3310/users/e55e62242d10405d920c5ce8e30b24a7/roles/6c54f239944d46e3b027ccce97eb8b49` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:40.300378 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9443fc-92b6-4d4e-895b-facfa477d577 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f77a2a2e456b441486f41e62c8bc3310, user_id=e55e62242d10405d920c5ce8e30b24a7, role_id=6c54f239944d46e3b027ccce97eb8b49)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:40.303061 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9443fc-92b6-4d4e-895b-facfa477d577 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:40.395260 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1029/2045] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:26:40 2021] PUT /identity/v3/projects/f77a2a2e456b441486f41e62c8bc3310/users/e55e62242d10405d920c5ce8e30b24a7/roles/6c54f239944d46e3b027ccce97eb8b49 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:26:40.401028 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0cab11-a36b-46fc-8099-87f55900cb5b admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:40.410918 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0cab11-a36b-46fc-8099-87f55900cb5b admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:40.466937 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0505e2e-6d8e-4ca2-872c-bd4fb13adc8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:40.467535 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0505e2e-6d8e-4ca2-872c-bd4fb13adc8c admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:40.467815 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0505e2e-6d8e-4ca2-872c-bd4fb13adc8c admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:40.468100 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0505e2e-6d8e-4ca2-872c-bd4fb13adc8c admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:40.468897 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0505e2e-6d8e-4ca2-872c-bd4fb13adc8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:40.470497 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0505e2e-6d8e-4ca2-872c-bd4fb13adc8c admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:40.481093 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1017/2046] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:26:40 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:26:40.485174 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9443fc-92b6-4d4e-895b-facfa477d577 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:40.496168 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9443fc-92b6-4d4e-895b-facfa477d577 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:40.501224 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edde5db-6bc8-4fe5-8aa4-b57e35cfdcc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:40.501715 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edde5db-6bc8-4fe5-8aa4-b57e35cfdcc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:40.502040 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edde5db-6bc8-4fe5-8aa4-b57e35cfdcc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:40.502306 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edde5db-6bc8-4fe5-8aa4-b57e35cfdcc3 admin admin] PATH_INFO: `/v3/projects/f77a2a2e456b441486f41e62c8bc3310/users/e55e62242d10405d920c5ce8e30b24a7/roles/6c54f239944d46e3b027ccce97eb8b49` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:40.505106 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edde5db-6bc8-4fe5-8aa4-b57e35cfdcc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f77a2a2e456b441486f41e62c8bc3310, user_id=e55e62242d10405d920c5ce8e30b24a7, role_id=6c54f239944d46e3b027ccce97eb8b49)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:40.507722 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edde5db-6bc8-4fe5-8aa4-b57e35cfdcc3 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:40.517687 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1030/2047] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:26:40 2021] PUT /identity/v3/projects/f77a2a2e456b441486f41e62c8bc3310/users/e55e62242d10405d920c5ce8e30b24a7/roles/6c54f239944d46e3b027ccce97eb8b49 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:26:40.529455 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d66910f-0778-49d7-87c8-18a5db016d75 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:40.529798 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d66910f-0778-49d7-87c8-18a5db016d75 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:40.530183 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d66910f-0778-49d7-87c8-18a5db016d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:40.556847 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-7d66910f-0778-49d7-87c8-18a5db016d75 None None] MFA Rules not processed for user `e55e62242d10405d920c5ce8e30b24a7`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:40.558022 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-7d66910f-0778-49d7-87c8-18a5db016d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:40.572808 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edde5db-6bc8-4fe5-8aa4-b57e35cfdcc3 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:40.574675 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-3edde5db-6bc8-4fe5-8aa4-b57e35cfdcc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:40.628915 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1018/2048] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:40 2021] POST /identity/v3/auth/tokens => generated 3470 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:26:40.638259 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d66910f-0778-49d7-87c8-18a5db016d75 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:40.639614 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-7d66910f-0778-49d7-87c8-18a5db016d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:40.651256 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edde5db-6bc8-4fe5-8aa4-b57e35cfdcc3 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:40.656188 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dd54ac-8451-4887-878c-00a0a15ba5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:40.657063 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd54ac-8451-4887-878c-00a0a15ba5cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:40.657369 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd54ac-8451-4887-878c-00a0a15ba5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:40.657638 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd54ac-8451-4887-878c-00a0a15ba5cd admin admin] PATH_INFO: `/v3/projects/940954e715a14badb4b58c0662062403` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:40.658808 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dd54ac-8451-4887-878c-00a0a15ba5cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=940954e715a14badb4b58c0662062403)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:40.660830 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dd54ac-8451-4887-878c-00a0a15ba5cd admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:40.694103 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d66910f-0778-49d7-87c8-18a5db016d75 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:40.697851 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aeaf77-75ed-41bb-9b22-86e7af1ab8cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6966ce0774f4437a9b688494e9d0574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:40.698491 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aeaf77-75ed-41bb-9b22-86e7af1ab8cc service cinder] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:40.698773 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aeaf77-75ed-41bb-9b22-86e7af1ab8cc service cinder] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:40.699051 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aeaf77-75ed-41bb-9b22-86e7af1ab8cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:40.700861 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-f0aeaf77-75ed-41bb-9b22-86e7af1ab8cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:40.756756 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aeaf77-75ed-41bb-9b22-86e7af1ab8cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:40.758120 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aeaf77-75ed-41bb-9b22-86e7af1ab8cc service cinder] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:40.766762 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1019/2049] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:26:40 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 18:26:40.789733 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-40dd54ac-8451-4887-878c-00a0a15ba5cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '940954e715a14badb4b58c0662062403', 'request_id': 'req-40dd54ac-8451-4887-878c-00a0a15ba5cd'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:40.795742 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-40dd54ac-8451-4887-878c-00a0a15ba5cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '940954e715a14badb4b58c0662062403', 'request_id': 'req-40dd54ac-8451-4887-878c-00a0a15ba5cd'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:40.801594 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-40dd54ac-8451-4887-878c-00a0a15ba5cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '940954e715a14badb4b58c0662062403', 'request_id': 'req-40dd54ac-8451-4887-878c-00a0a15ba5cd'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:40.896377 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-40dd54ac-8451-4887-878c-00a0a15ba5cd admin admin] The token cache is being invalidate because project 940954e715a14badb4b58c0662062403 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74005) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:26:40.896715 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-40dd54ac-8451-4887-878c-00a0a15ba5cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:40.897356 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-40dd54ac-8451-4887-878c-00a0a15ba5cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:40.898936 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1031/2050] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:26:40 2021] DELETE /identity/v3/projects/940954e715a14badb4b58c0662062403 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 18:26:40.905872 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01434356-1c43-4df6-a4ba-6c72d5be862b None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:40.906154 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01434356-1c43-4df6-a4ba-6c72d5be862b None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:40.906430 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01434356-1c43-4df6-a4ba-6c72d5be862b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:40.924182 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-01434356-1c43-4df6-a4ba-6c72d5be862b None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:40.925456 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-01434356-1c43-4df6-a4ba-6c72d5be862b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:40.994790 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1020/2051] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:26:40.996431 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a5a0a3-5023-480c-a0f2-bf573f21b889 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:40.996717 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a5a0a3-5023-480c-a0f2-bf573f21b889 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:40.996988 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a5a0a3-5023-480c-a0f2-bf573f21b889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:41.015136 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-c9a5a0a3-5023-480c-a0f2-bf573f21b889 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:41.016368 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-c9a5a0a3-5023-480c-a0f2-bf573f21b889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:41.024190 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1032/2052] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:26:41.028672 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01434356-1c43-4df6-a4ba-6c72d5be862b None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:41.038887 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01434356-1c43-4df6-a4ba-6c72d5be862b None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:41.044249 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b298bb6-c1d8-494b-947a-8018f2485bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:41.044964 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b298bb6-c1d8-494b-947a-8018f2485bf3 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:41.045244 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b298bb6-c1d8-494b-947a-8018f2485bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:41.045518 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b298bb6-c1d8-494b-947a-8018f2485bf3 admin admin] PATH_INFO: `/v3/domains` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:41.046248 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b298bb6-c1d8-494b-947a-8018f2485bf3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:26:41.046555 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b298bb6-c1d8-494b-947a-8018f2485bf3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:41.051221 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b298bb6-c1d8-494b-947a-8018f2485bf3 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:41.060049 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1021/2053] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 12 18:26:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:26:41.064365 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a5a0a3-5023-480c-a0f2-bf573f21b889 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:41.073356 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a5a0a3-5023-480c-a0f2-bf573f21b889 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:41.078042 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1581621b-6eb8-44d0-9ed7-7e5ac614364c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:41.078682 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1581621b-6eb8-44d0-9ed7-7e5ac614364c admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:41.078962 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1581621b-6eb8-44d0-9ed7-7e5ac614364c admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:41.079236 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1581621b-6eb8-44d0-9ed7-7e5ac614364c admin admin] PATH_INFO: `/v3/projects` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:41.079938 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1581621b-6eb8-44d0-9ed7-7e5ac614364c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:41.082382 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1581621b-6eb8-44d0-9ed7-7e5ac614364c admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:41.172808 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1033/2054] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:26:41 2021] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 18:26:41.176848 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b298bb6-c1d8-494b-947a-8018f2485bf3 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:41.187811 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b298bb6-c1d8-494b-947a-8018f2485bf3 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:41.251615 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78362272-fc51-4da5-a0df-dcb5736b8846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:41.257803 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78362272-fc51-4da5-a0df-dcb5736b8846 admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:41.257803 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78362272-fc51-4da5-a0df-dcb5736b8846 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:41.257803 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78362272-fc51-4da5-a0df-dcb5736b8846 admin admin] PATH_INFO: `/v3/users` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:41.257803 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78362272-fc51-4da5-a0df-dcb5736b8846 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:41.257803 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78362272-fc51-4da5-a0df-dcb5736b8846 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:41.345643 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1022/2055] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:26:41 2021] POST /identity/v3/users => generated 293 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:26:41.347310 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1581621b-6eb8-44d0-9ed7-7e5ac614364c admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:41.357594 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1581621b-6eb8-44d0-9ed7-7e5ac614364c admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:41.362649 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e2ca4f-7cd8-41e3-aa6c-8160a6954ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:41.363303 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2ca4f-7cd8-41e3-aa6c-8160a6954ddf admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:41.363739 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2ca4f-7cd8-41e3-aa6c-8160a6954ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:41.363912 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2ca4f-7cd8-41e3-aa6c-8160a6954ddf admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:41.364717 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e2ca4f-7cd8-41e3-aa6c-8160a6954ddf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:41.366316 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e2ca4f-7cd8-41e3-aa6c-8160a6954ddf admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:41.377384 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1034/2056] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:26:41 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:26:41.381677 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78362272-fc51-4da5-a0df-dcb5736b8846 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:41.391654 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78362272-fc51-4da5-a0df-dcb5736b8846 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:41.397090 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1d7a18-10bb-4801-afad-11c4acfac3f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:41.397757 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d7a18-10bb-4801-afad-11c4acfac3f9 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:41.398041 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d7a18-10bb-4801-afad-11c4acfac3f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:41.398318 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d7a18-10bb-4801-afad-11c4acfac3f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:41.399115 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1d7a18-10bb-4801-afad-11c4acfac3f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:41.401081 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1d7a18-10bb-4801-afad-11c4acfac3f9 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:41.416482 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1023/2057] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:26:41 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 18:26:41.416644 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e2ca4f-7cd8-41e3-aa6c-8160a6954ddf admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:41.426173 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e2ca4f-7cd8-41e3-aa6c-8160a6954ddf admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:41.430851 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d857798-d329-4b11-ab7a-ed1c9e596504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:41.431748 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d857798-d329-4b11-ab7a-ed1c9e596504 admin admin] REQUEST_METHOD: `PUT` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:41.435669 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d857798-d329-4b11-ab7a-ed1c9e596504 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:41.435669 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d857798-d329-4b11-ab7a-ed1c9e596504 admin admin] PATH_INFO: `/v3/projects/905ac49b678b4fb4b6777470e5f39a62/users/a0b814e43fc4434daee097bfca95ad5b/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:41.447248 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d857798-d329-4b11-ab7a-ed1c9e596504 admin admin] RBAC: Authorizing `identity:create_grant(project_id=905ac49b678b4fb4b6777470e5f39a62, user_id=a0b814e43fc4434daee097bfca95ad5b, role_id=33b8a5a8d1d643f2a98f598e6ab0a1cf)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:41.449925 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d857798-d329-4b11-ab7a-ed1c9e596504 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:41.526500 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1035/2058] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:26:41 2021] PUT /identity/v3/projects/905ac49b678b4fb4b6777470e5f39a62/users/a0b814e43fc4434daee097bfca95ad5b/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 18:26:41.537091 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296df1f6-2ffc-430e-a4e8-541fbb3a7141 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:41.537395 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296df1f6-2ffc-430e-a4e8-541fbb3a7141 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:41.537648 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296df1f6-2ffc-430e-a4e8-541fbb3a7141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:41.570881 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-296df1f6-2ffc-430e-a4e8-541fbb3a7141 None None] MFA Rules not processed for user `a0b814e43fc4434daee097bfca95ad5b`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:41.572384 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-296df1f6-2ffc-430e-a4e8-541fbb3a7141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:41.646225 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1024/2059] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:41 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:26:41.657961 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d857798-d329-4b11-ab7a-ed1c9e596504 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:41.661348 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-0d857798-d329-4b11-ab7a-ed1c9e596504 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:41.727647 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d857798-d329-4b11-ab7a-ed1c9e596504 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:41.731771 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de344310-980b-490d-8b79-a32c23f277a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6966ce0774f4437a9b688494e9d0574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:41.732641 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de344310-980b-490d-8b79-a32c23f277a3 service cinder] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:41.733033 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de344310-980b-490d-8b79-a32c23f277a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:41.733423 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de344310-980b-490d-8b79-a32c23f277a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:41.748533 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de344310-980b-490d-8b79-a32c23f277a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:41.750266 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de344310-980b-490d-8b79-a32c23f277a3 service cinder] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:41.767612 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1036/2060] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:26:41 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:26:41.787878 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296df1f6-2ffc-430e-a4e8-541fbb3a7141 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:41.866491 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296df1f6-2ffc-430e-a4e8-541fbb3a7141 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:41.871593 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68015dce-e723-4ced-b3e2-8450f9de4366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:41.872615 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68015dce-e723-4ced-b3e2-8450f9de4366 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:41.872888 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68015dce-e723-4ced-b3e2-8450f9de4366 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:41.873165 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68015dce-e723-4ced-b3e2-8450f9de4366 admin admin] PATH_INFO: `/v3/users/a0b814e43fc4434daee097bfca95ad5b` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:41.874505 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68015dce-e723-4ced-b3e2-8450f9de4366 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0b814e43fc4434daee097bfca95ad5b)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:41.876549 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68015dce-e723-4ced-b3e2-8450f9de4366 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:42.070992 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-68015dce-e723-4ced-b3e2-8450f9de4366 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0b814e43fc4434daee097bfca95ad5b'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:42.078563 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-68015dce-e723-4ced-b3e2-8450f9de4366 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0b814e43fc4434daee097bfca95ad5b'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:42.092202 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-68015dce-e723-4ced-b3e2-8450f9de4366 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0b814e43fc4434daee097bfca95ad5b'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:42.199796 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-68015dce-e723-4ced-b3e2-8450f9de4366 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0b814e43fc4434daee097bfca95ad5b'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:42.200494 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-68015dce-e723-4ced-b3e2-8450f9de4366 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0b814e43fc4434daee097bfca95ad5b'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:42.209281 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1025/2061] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:26:41 2021] DELETE /identity/v3/users/a0b814e43fc4434daee097bfca95ad5b => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:26:42.213978 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e11fa-cb7f-4858-9b89-5baab1a531d1 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:42.214511 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e11fa-cb7f-4858-9b89-5baab1a531d1 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:42.214764 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e11fa-cb7f-4858-9b89-5baab1a531d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:42.275500 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-ed2e11fa-cb7f-4858-9b89-5baab1a531d1 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:42.276781 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-ed2e11fa-cb7f-4858-9b89-5baab1a531d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:42.378546 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1037/2062] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:26:42.389944 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68015dce-e723-4ced-b3e2-8450f9de4366 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:42.391761 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-68015dce-e723-4ced-b3e2-8450f9de4366 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:42.467336 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68015dce-e723-4ced-b3e2-8450f9de4366 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:42.472659 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ac5da8-0b22-4370-8696-56e8a152b53d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:42.473553 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac5da8-0b22-4370-8696-56e8a152b53d service neutron] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:42.473845 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac5da8-0b22-4370-8696-56e8a152b53d service neutron] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:42.474255 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac5da8-0b22-4370-8696-56e8a152b53d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:42.485572 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ac5da8-0b22-4370-8696-56e8a152b53d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:42.488229 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ac5da8-0b22-4370-8696-56e8a152b53d service neutron] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:42.500457 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1026/2063] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:26:42 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:26:42.628896 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2e11fa-cb7f-4858-9b89-5baab1a531d1 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:42.633912 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-ed2e11fa-cb7f-4858-9b89-5baab1a531d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:42.648286 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2e11fa-cb7f-4858-9b89-5baab1a531d1 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:42.654999 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100d3d24-5013-4f35-bd97-858ff01f9c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:42.657860 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d3d24-5013-4f35-bd97-858ff01f9c33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:42.657860 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d3d24-5013-4f35-bd97-858ff01f9c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:42.657860 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d3d24-5013-4f35-bd97-858ff01f9c33 admin admin] PATH_INFO: `/v3/users/d66a14c3aaa34c0ea5f0e06541f1a770` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:42.658613 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100d3d24-5013-4f35-bd97-858ff01f9c33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d66a14c3aaa34c0ea5f0e06541f1a770)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:42.661913 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100d3d24-5013-4f35-bd97-858ff01f9c33 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:42.927175 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-100d3d24-5013-4f35-bd97-858ff01f9c33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd66a14c3aaa34c0ea5f0e06541f1a770'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:42.927828 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-100d3d24-5013-4f35-bd97-858ff01f9c33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd66a14c3aaa34c0ea5f0e06541f1a770'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:42.939598 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-100d3d24-5013-4f35-bd97-858ff01f9c33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd66a14c3aaa34c0ea5f0e06541f1a770'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:42.940796 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-100d3d24-5013-4f35-bd97-858ff01f9c33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd66a14c3aaa34c0ea5f0e06541f1a770'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:42.948662 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-100d3d24-5013-4f35-bd97-858ff01f9c33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd66a14c3aaa34c0ea5f0e06541f1a770'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:43.120948 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1038/2064] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:26:42 2021] DELETE /identity/v3/users/d66a14c3aaa34c0ea5f0e06541f1a770 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:26:43.124085 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ac5da8-0b22-4370-8696-56e8a152b53d service neutron] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:43.125854 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a784ea3-c27c-47a8-9264-bd0ff25e7799 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:43.125984 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-d0ac5da8-0b22-4370-8696-56e8a152b53d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:43.126148 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a784ea3-c27c-47a8-9264-bd0ff25e7799 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:43.126427 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a784ea3-c27c-47a8-9264-bd0ff25e7799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:43.146986 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-2a784ea3-c27c-47a8-9264-bd0ff25e7799 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:43.147226 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ac5da8-0b22-4370-8696-56e8a152b53d service neutron] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:43.148269 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-2a784ea3-c27c-47a8-9264-bd0ff25e7799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:43.214475 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd31bdf3-6eb5-428a-96a7-5bf3fa26bc19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:43.215387 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd31bdf3-6eb5-428a-96a7-5bf3fa26bc19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:43.215673 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd31bdf3-6eb5-428a-96a7-5bf3fa26bc19 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:43.215949 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd31bdf3-6eb5-428a-96a7-5bf3fa26bc19 admin admin] PATH_INFO: `/v3/projects/905ac49b678b4fb4b6777470e5f39a62` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:43.217168 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd31bdf3-6eb5-428a-96a7-5bf3fa26bc19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=905ac49b678b4fb4b6777470e5f39a62)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:43.219236 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd31bdf3-6eb5-428a-96a7-5bf3fa26bc19 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:43.220024 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1039/2065] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:26:43.230406 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a784ea3-c27c-47a8-9264-bd0ff25e7799 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:43.231774 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-2a784ea3-c27c-47a8-9264-bd0ff25e7799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:43.295569 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a784ea3-c27c-47a8-9264-bd0ff25e7799 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:43.301696 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcba3a0-3d99-4395-85d1-3e4b250e37ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:43.302381 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcba3a0-3d99-4395-85d1-3e4b250e37ff service neutron] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:43.302896 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcba3a0-3d99-4395-85d1-3e4b250e37ff service neutron] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:43.303174 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcba3a0-3d99-4395-85d1-3e4b250e37ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:43.315181 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcba3a0-3d99-4395-85d1-3e4b250e37ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:43.317274 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcba3a0-3d99-4395-85d1-3e4b250e37ff service neutron] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:43.330732 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1040/2066] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:26:43 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 18:26:43.377364 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-cd31bdf3-6eb5-428a-96a7-5bf3fa26bc19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '905ac49b678b4fb4b6777470e5f39a62', 'request_id': 'req-cd31bdf3-6eb5-428a-96a7-5bf3fa26bc19'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:43.503799 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-cd31bdf3-6eb5-428a-96a7-5bf3fa26bc19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '905ac49b678b4fb4b6777470e5f39a62', 'request_id': 'req-cd31bdf3-6eb5-428a-96a7-5bf3fa26bc19'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:43.516653 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-cd31bdf3-6eb5-428a-96a7-5bf3fa26bc19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '905ac49b678b4fb4b6777470e5f39a62', 'request_id': 'req-cd31bdf3-6eb5-428a-96a7-5bf3fa26bc19'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:43.546071 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-cd31bdf3-6eb5-428a-96a7-5bf3fa26bc19 admin admin] The token cache is being invalidate because project 905ac49b678b4fb4b6777470e5f39a62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:26:43.546071 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-cd31bdf3-6eb5-428a-96a7-5bf3fa26bc19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:43.546071 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-cd31bdf3-6eb5-428a-96a7-5bf3fa26bc19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:43.546071 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1027/2067] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:26:43 2021] DELETE /identity/v3/projects/905ac49b678b4fb4b6777470e5f39a62 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:26:43.553227 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f0d7e-71fd-4e46-92f6-05004897f73b None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:43.553505 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f0d7e-71fd-4e46-92f6-05004897f73b None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:43.553779 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f0d7e-71fd-4e46-92f6-05004897f73b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:43.573032 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-1d6f0d7e-71fd-4e46-92f6-05004897f73b None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:43.574231 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-1d6f0d7e-71fd-4e46-92f6-05004897f73b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:43.679985 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1041/2068] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:26:43.685524 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0527d8-f80d-4a38-99fc-f513d4d9db47 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:43.685991 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0527d8-f80d-4a38-99fc-f513d4d9db47 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:43.686467 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0527d8-f80d-4a38-99fc-f513d4d9db47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:43.740376 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-dd0527d8-f80d-4a38-99fc-f513d4d9db47 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:43.742079 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-dd0527d8-f80d-4a38-99fc-f513d4d9db47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:43.760035 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1028/2069] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:26:43.760139 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f0d7e-71fd-4e46-92f6-05004897f73b None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:43.769347 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f0d7e-71fd-4e46-92f6-05004897f73b None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:43.776053 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd8f814-4489-4e8e-94f5-a2a208dbbb3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:43.777178 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd8f814-4489-4e8e-94f5-a2a208dbbb3c admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:43.777582 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd8f814-4489-4e8e-94f5-a2a208dbbb3c admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:43.778225 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd8f814-4489-4e8e-94f5-a2a208dbbb3c admin admin] PATH_INFO: `/v3/domains` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:43.779018 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd8f814-4489-4e8e-94f5-a2a208dbbb3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:26:43.779427 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd8f814-4489-4e8e-94f5-a2a208dbbb3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:43.782334 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd8f814-4489-4e8e-94f5-a2a208dbbb3c admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:43.799041 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1042/2070] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 12 18:26:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:26:43.803828 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0527d8-f80d-4a38-99fc-f513d4d9db47 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:43.815726 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0527d8-f80d-4a38-99fc-f513d4d9db47 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:43.820804 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1634779-a2da-49b8-8459-e580c363e7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:43.821495 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1634779-a2da-49b8-8459-e580c363e7d2 admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:43.821815 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1634779-a2da-49b8-8459-e580c363e7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:43.822091 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1634779-a2da-49b8-8459-e580c363e7d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:43.822819 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1634779-a2da-49b8-8459-e580c363e7d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:43.824939 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1634779-a2da-49b8-8459-e580c363e7d2 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:43.987882 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd8f814-4489-4e8e-94f5-a2a208dbbb3c admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:43.989964 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-8fd8f814-4489-4e8e-94f5-a2a208dbbb3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:43.994036 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1029/2071] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:26:43 2021] POST /identity/v3/projects => generated 361 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:26:43.998073 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1634779-a2da-49b8-8459-e580c363e7d2 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:44.021061 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd8f814-4489-4e8e-94f5-a2a208dbbb3c admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:44.069478 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1634779-a2da-49b8-8459-e580c363e7d2 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:44.074342 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaa7dc0-f750-4819-bb22-54ee218820d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:44.075017 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa7dc0-f750-4819-bb22-54ee218820d2 admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:44.075299 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa7dc0-f750-4819-bb22-54ee218820d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:44.075574 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa7dc0-f750-4819-bb22-54ee218820d2 admin admin] PATH_INFO: `/v3/users` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:44.076284 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaa7dc0-f750-4819-bb22-54ee218820d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:44.078241 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaa7dc0-f750-4819-bb22-54ee218820d2 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:44.088714 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe4f367-7bd9-41f7-9853-7ce1126f1725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:44.089561 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe4f367-7bd9-41f7-9853-7ce1126f1725 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:44.089956 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe4f367-7bd9-41f7-9853-7ce1126f1725 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:44.090196 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe4f367-7bd9-41f7-9853-7ce1126f1725 admin admin] PATH_INFO: `/v3/projects/3ece9a3f33194dd5a1c30a5d10b602e1` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:44.091400 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe4f367-7bd9-41f7-9853-7ce1126f1725 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ece9a3f33194dd5a1c30a5d10b602e1)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:44.093354 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe4f367-7bd9-41f7-9853-7ce1126f1725 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:44.176681 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1030/2072] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:26:43 2021] POST /identity/v3/users => generated 281 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:26:44.180864 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaa7dc0-f750-4819-bb22-54ee218820d2 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:44.190181 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaa7dc0-f750-4819-bb22-54ee218820d2 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:44.194939 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d4966-a462-48ae-b453-5c765aa80ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:44.195573 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d4966-a462-48ae-b453-5c765aa80ff2 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:44.195851 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d4966-a462-48ae-b453-5c765aa80ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:44.196125 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d4966-a462-48ae-b453-5c765aa80ff2 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:44.196887 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1d4966-a462-48ae-b453-5c765aa80ff2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:44.198456 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1d4966-a462-48ae-b453-5c765aa80ff2 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:44.208708 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1031/2073] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:26:44 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 18:26:44.212917 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d4966-a462-48ae-b453-5c765aa80ff2 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:44.222997 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d4966-a462-48ae-b453-5c765aa80ff2 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:44.230378 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-bfe4f367-7bd9-41f7-9853-7ce1126f1725 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ece9a3f33194dd5a1c30a5d10b602e1', 'request_id': 'req-bfe4f367-7bd9-41f7-9853-7ce1126f1725'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:44.236909 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-bfe4f367-7bd9-41f7-9853-7ce1126f1725 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ece9a3f33194dd5a1c30a5d10b602e1', 'request_id': 'req-bfe4f367-7bd9-41f7-9853-7ce1126f1725'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:44.242606 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-bfe4f367-7bd9-41f7-9853-7ce1126f1725 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ece9a3f33194dd5a1c30a5d10b602e1', 'request_id': 'req-bfe4f367-7bd9-41f7-9853-7ce1126f1725'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:44.279119 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cc76ff-70cd-4fc3-b221-281c50fb7b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:44.279782 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc76ff-70cd-4fc3-b221-281c50fb7b6a admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:44.280070 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc76ff-70cd-4fc3-b221-281c50fb7b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:44.280325 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc76ff-70cd-4fc3-b221-281c50fb7b6a admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:44.281079 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cc76ff-70cd-4fc3-b221-281c50fb7b6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:44.282652 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cc76ff-70cd-4fc3-b221-281c50fb7b6a admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:44.293289 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1032/2074] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:26:44 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 18:26:44.300618 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cc76ff-70cd-4fc3-b221-281c50fb7b6a admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:44.311461 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cc76ff-70cd-4fc3-b221-281c50fb7b6a admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:44.316452 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c463a727-c3fe-4641-8112-f7199082ab62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:44.317556 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463a727-c3fe-4641-8112-f7199082ab62 admin admin] REQUEST_METHOD: `PUT` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:44.317835 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463a727-c3fe-4641-8112-f7199082ab62 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:44.318136 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463a727-c3fe-4641-8112-f7199082ab62 admin admin] PATH_INFO: `/v3/projects/8ede619131e542568d562ea8eb3e43d3/users/b5b67cc8a29341e89844297407f40788/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:44.335241 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c463a727-c3fe-4641-8112-f7199082ab62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ede619131e542568d562ea8eb3e43d3, user_id=b5b67cc8a29341e89844297407f40788, role_id=33b8a5a8d1d643f2a98f598e6ab0a1cf)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:44.339762 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c463a727-c3fe-4641-8112-f7199082ab62 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:44.347936 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-bfe4f367-7bd9-41f7-9853-7ce1126f1725 admin admin] The token cache is being invalidate because project 3ece9a3f33194dd5a1c30a5d10b602e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74005) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:26:44.348268 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-bfe4f367-7bd9-41f7-9853-7ce1126f1725 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:44.350038 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-bfe4f367-7bd9-41f7-9853-7ce1126f1725 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:44.352297 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1043/2075] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:26:43 2021] DELETE /identity/v3/projects/3ece9a3f33194dd5a1c30a5d10b602e1 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 18:26:44.357932 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa5649-937f-4585-9686-abdeddb9967a None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:44.358193 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa5649-937f-4585-9686-abdeddb9967a None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:44.358471 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa5649-937f-4585-9686-abdeddb9967a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:44.376501 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-07fa5649-937f-4585-9686-abdeddb9967a None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:44.377728 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-07fa5649-937f-4585-9686-abdeddb9967a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:44.385810 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1044/2076] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:26:44.394091 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb414174-5213-41b4-8814-bb75db4ef81b None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:44.394369 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb414174-5213-41b4-8814-bb75db4ef81b None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:44.394664 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb414174-5213-41b4-8814-bb75db4ef81b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:44.413227 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-fb414174-5213-41b4-8814-bb75db4ef81b None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:44.414395 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-fb414174-5213-41b4-8814-bb75db4ef81b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:44.422252 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1045/2077] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:26:44.426201 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb414174-5213-41b4-8814-bb75db4ef81b None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:44.434623 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb414174-5213-41b4-8814-bb75db4ef81b None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:44.439075 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5488e7e-4df3-413b-947a-e360ff333966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:44.439679 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5488e7e-4df3-413b-947a-e360ff333966 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:44.439956 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5488e7e-4df3-413b-947a-e360ff333966 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:44.440772 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5488e7e-4df3-413b-947a-e360ff333966 admin admin] PATH_INFO: `/v3/domains` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:44.441491 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5488e7e-4df3-413b-947a-e360ff333966 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:26:44.441963 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5488e7e-4df3-413b-947a-e360ff333966 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:44.443534 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5488e7e-4df3-413b-947a-e360ff333966 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:44.455735 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1046/2078] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 12 18:26:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:26:44.459488 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1033/2079] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:26:44 2021] PUT /identity/v3/projects/8ede619131e542568d562ea8eb3e43d3/users/b5b67cc8a29341e89844297407f40788/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:26:44.469504 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5488e7e-4df3-413b-947a-e360ff333966 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:44.470236 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab80503-eadb-4b1a-a8da-0ff840289caa None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:44.470640 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab80503-eadb-4b1a-a8da-0ff840289caa None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:44.470922 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab80503-eadb-4b1a-a8da-0ff840289caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:44.479648 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5488e7e-4df3-413b-947a-e360ff333966 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:44.506399 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-1ab80503-eadb-4b1a-a8da-0ff840289caa None None] MFA Rules not processed for user `b5b67cc8a29341e89844297407f40788`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:44.506980 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-1ab80503-eadb-4b1a-a8da-0ff840289caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:44.550174 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74bb332-33ba-4d66-aa67-4e7ca7caa19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:44.551046 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74bb332-33ba-4d66-aa67-4e7ca7caa19b admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:44.551243 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74bb332-33ba-4d66-aa67-4e7ca7caa19b admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:44.551519 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74bb332-33ba-4d66-aa67-4e7ca7caa19b admin admin] PATH_INFO: `/v3/projects` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:44.552218 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74bb332-33ba-4d66-aa67-4e7ca7caa19b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:44.554769 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74bb332-33ba-4d66-aa67-4e7ca7caa19b admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:44.583529 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1034/2080] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:44 2021] POST /identity/v3/auth/tokens => generated 3381 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:26:44.612344 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab80503-eadb-4b1a-a8da-0ff840289caa None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:44.613798 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-1ab80503-eadb-4b1a-a8da-0ff840289caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:44.669996 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1047/2081] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:26:44 2021] POST /identity/v3/projects => generated 375 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 18:26:44.671987 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab80503-eadb-4b1a-a8da-0ff840289caa None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:44.674117 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74bb332-33ba-4d66-aa67-4e7ca7caa19b admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:44.721291 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3efdde-5f38-4352-897e-3ba933f160c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6966ce0774f4437a9b688494e9d0574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:44.723078 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3efdde-5f38-4352-897e-3ba933f160c8 service cinder] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:44.723078 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3efdde-5f38-4352-897e-3ba933f160c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:44.723078 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3efdde-5f38-4352-897e-3ba933f160c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:44.734634 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74bb332-33ba-4d66-aa67-4e7ca7caa19b admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:44.740059 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065563d4-a64e-4a93-82df-d12d4bea5bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:44.740853 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065563d4-a64e-4a93-82df-d12d4bea5bb7 admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:44.741139 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065563d4-a64e-4a93-82df-d12d4bea5bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:44.741409 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065563d4-a64e-4a93-82df-d12d4bea5bb7 admin admin] PATH_INFO: `/v3/users` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:44.742112 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065563d4-a64e-4a93-82df-d12d4bea5bb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:44.744035 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065563d4-a64e-4a93-82df-d12d4bea5bb7 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:44.780373 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3efdde-5f38-4352-897e-3ba933f160c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:44.781844 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3efdde-5f38-4352-897e-3ba933f160c8 service cinder] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:44.790911 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1035/2082] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:26:44 2021] GET /identity/v3/auth/tokens => generated 3381 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 18:26:44.805800 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3efdde-5f38-4352-897e-3ba933f160c8 service cinder] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:44.806546 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-4a3efdde-5f38-4352-897e-3ba933f160c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:44.820173 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3efdde-5f38-4352-897e-3ba933f160c8 service cinder] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:44.824793 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1a1536-4c70-4b61-a574-0119ce07478b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:44.825645 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1a1536-4c70-4b61-a574-0119ce07478b admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:44.826045 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1a1536-4c70-4b61-a574-0119ce07478b admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:44.826203 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1a1536-4c70-4b61-a574-0119ce07478b admin admin] PATH_INFO: `/v3/users/b5b67cc8a29341e89844297407f40788` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:44.827531 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1a1536-4c70-4b61-a574-0119ce07478b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5b67cc8a29341e89844297407f40788)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:44.829487 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1a1536-4c70-4b61-a574-0119ce07478b admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:44.989065 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1048/2083] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:26:44 2021] POST /identity/v3/users => generated 288 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:26:44.993159 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065563d4-a64e-4a93-82df-d12d4bea5bb7 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:45.002378 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065563d4-a64e-4a93-82df-d12d4bea5bb7 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:45.007574 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e73ca8-b086-4b54-bbe0-9b9191ed8da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:45.008191 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e73ca8-b086-4b54-bbe0-9b9191ed8da9 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:45.008504 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e73ca8-b086-4b54-bbe0-9b9191ed8da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:45.008782 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e73ca8-b086-4b54-bbe0-9b9191ed8da9 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:45.009507 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e73ca8-b086-4b54-bbe0-9b9191ed8da9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:45.011238 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e73ca8-b086-4b54-bbe0-9b9191ed8da9 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:45.020901 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1049/2084] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:26:44 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 18:26:45.024602 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e73ca8-b086-4b54-bbe0-9b9191ed8da9 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:45.033884 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e73ca8-b086-4b54-bbe0-9b9191ed8da9 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:45.038604 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0b9862-993f-4712-94d0-19ae4033e8cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:45.039241 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b9862-993f-4712-94d0-19ae4033e8cc admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:45.039528 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b9862-993f-4712-94d0-19ae4033e8cc admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:45.039802 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b9862-993f-4712-94d0-19ae4033e8cc admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:45.040562 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0b9862-993f-4712-94d0-19ae4033e8cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:45.042132 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0b9862-993f-4712-94d0-19ae4033e8cc admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:45.052322 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1050/2085] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:26:45 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 18:26:45.056433 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0b9862-993f-4712-94d0-19ae4033e8cc admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:45.066274 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0b9862-993f-4712-94d0-19ae4033e8cc admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:45.070892 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a65d2f-e0a0-4703-934a-ca4ef5dab604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:45.071734 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a65d2f-e0a0-4703-934a-ca4ef5dab604 admin admin] REQUEST_METHOD: `PUT` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:45.072016 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a65d2f-e0a0-4703-934a-ca4ef5dab604 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:45.072291 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a65d2f-e0a0-4703-934a-ca4ef5dab604 admin admin] PATH_INFO: `/v3/projects/a45c008831ec45c69ede876b29e30bad/users/959dc719d24e4f74827c4eef73d65dd4/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:45.086269 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a65d2f-e0a0-4703-934a-ca4ef5dab604 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a45c008831ec45c69ede876b29e30bad, user_id=959dc719d24e4f74827c4eef73d65dd4, role_id=33b8a5a8d1d643f2a98f598e6ab0a1cf)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:45.088956 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a65d2f-e0a0-4703-934a-ca4ef5dab604 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:45.149574 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-bd1a1536-4c70-4b61-a574-0119ce07478b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5b67cc8a29341e89844297407f40788'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:45.156481 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-bd1a1536-4c70-4b61-a574-0119ce07478b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5b67cc8a29341e89844297407f40788'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:45.168891 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-bd1a1536-4c70-4b61-a574-0119ce07478b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5b67cc8a29341e89844297407f40788'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:45.233516 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1051/2086] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:26:45 2021] PUT /identity/v3/projects/a45c008831ec45c69ede876b29e30bad/users/959dc719d24e4f74827c4eef73d65dd4/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 18:26:45.244812 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73c22c-41ac-4705-863e-997e482410f7 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:45.245050 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73c22c-41ac-4705-863e-997e482410f7 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:45.245493 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73c22c-41ac-4705-863e-997e482410f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:45.283693 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-7c73c22c-41ac-4705-863e-997e482410f7 None None] MFA Rules not processed for user `959dc719d24e4f74827c4eef73d65dd4`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:45.283693 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-7c73c22c-41ac-4705-863e-997e482410f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:45.296729 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-bd1a1536-4c70-4b61-a574-0119ce07478b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5b67cc8a29341e89844297407f40788'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:45.297371 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-bd1a1536-4c70-4b61-a574-0119ce07478b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5b67cc8a29341e89844297407f40788'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:45.304473 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1036/2087] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:26:44 2021] DELETE /identity/v3/users/b5b67cc8a29341e89844297407f40788 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 18:26:45.308856 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a8dedd-084e-4057-8293-73fc5a34e67f None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:45.309168 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a8dedd-084e-4057-8293-73fc5a34e67f None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:45.309447 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a8dedd-084e-4057-8293-73fc5a34e67f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:45.326350 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-50a8dedd-084e-4057-8293-73fc5a34e67f None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:45.327309 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-50a8dedd-084e-4057-8293-73fc5a34e67f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:45.344854 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1052/2088] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:45 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:26:45.355058 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c73c22c-41ac-4705-863e-997e482410f7 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:45.356477 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-7c73c22c-41ac-4705-863e-997e482410f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:45.389051 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1037/2089] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:26:45.399520 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a8dedd-084e-4057-8293-73fc5a34e67f None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:45.401315 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-50a8dedd-084e-4057-8293-73fc5a34e67f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:45.422427 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c73c22c-41ac-4705-863e-997e482410f7 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:45.427919 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a76b2-83a0-4e18-9e54-3d1e9641a2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:45.428614 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a76b2-83a0-4e18-9e54-3d1e9641a2a3 admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:45.428896 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a76b2-83a0-4e18-9e54-3d1e9641a2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:45.429167 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a76b2-83a0-4e18-9e54-3d1e9641a2a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:45.429864 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89a76b2-83a0-4e18-9e54-3d1e9641a2a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:45.431831 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89a76b2-83a0-4e18-9e54-3d1e9641a2a3 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:45.458284 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a8dedd-084e-4057-8293-73fc5a34e67f None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:45.461840 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac97fc96-6bfd-4f49-bd17-cb9a921c9cfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:45.462472 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac97fc96-6bfd-4f49-bd17-cb9a921c9cfd service neutron] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:45.462749 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac97fc96-6bfd-4f49-bd17-cb9a921c9cfd service neutron] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:45.463019 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac97fc96-6bfd-4f49-bd17-cb9a921c9cfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:45.472064 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac97fc96-6bfd-4f49-bd17-cb9a921c9cfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:45.473516 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac97fc96-6bfd-4f49-bd17-cb9a921c9cfd service neutron] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:45.482572 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1038/2090] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:26:45 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 18:26:45.483339 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac97fc96-6bfd-4f49-bd17-cb9a921c9cfd service neutron] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:45.484604 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-ac97fc96-6bfd-4f49-bd17-cb9a921c9cfd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:45.497099 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac97fc96-6bfd-4f49-bd17-cb9a921c9cfd service neutron] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:45.501722 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5131b9e2-5dc9-4457-8538-1ac99d1e6736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:45.502555 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5131b9e2-5dc9-4457-8538-1ac99d1e6736 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:45.502859 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5131b9e2-5dc9-4457-8538-1ac99d1e6736 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:45.503133 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5131b9e2-5dc9-4457-8538-1ac99d1e6736 admin admin] PATH_INFO: `/v3/users/bb6d2b02e646406aaadb089f9243f98e` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:45.504330 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5131b9e2-5dc9-4457-8538-1ac99d1e6736 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb6d2b02e646406aaadb089f9243f98e)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:45.506257 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5131b9e2-5dc9-4457-8538-1ac99d1e6736 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:45.682557 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1053/2091] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:26:45 2021] POST /identity/v3/projects => generated 377 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:26:45.685945 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a76b2-83a0-4e18-9e54-3d1e9641a2a3 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:45.755421 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a76b2-83a0-4e18-9e54-3d1e9641a2a3 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:45.759713 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac93f9e-d4d6-49fb-bfea-ff7b74203acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:45.760372 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac93f9e-d4d6-49fb-bfea-ff7b74203acc admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:45.760688 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac93f9e-d4d6-49fb-bfea-ff7b74203acc admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:45.760960 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac93f9e-d4d6-49fb-bfea-ff7b74203acc admin admin] PATH_INFO: `/v3/users` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:45.761654 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac93f9e-d4d6-49fb-bfea-ff7b74203acc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:45.763691 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac93f9e-d4d6-49fb-bfea-ff7b74203acc admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:45.825742 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-5131b9e2-5dc9-4457-8538-1ac99d1e6736 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb6d2b02e646406aaadb089f9243f98e'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:45.833289 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-5131b9e2-5dc9-4457-8538-1ac99d1e6736 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb6d2b02e646406aaadb089f9243f98e'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:45.844978 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-5131b9e2-5dc9-4457-8538-1ac99d1e6736 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb6d2b02e646406aaadb089f9243f98e'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:45.886807 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1054/2092] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:26:45 2021] POST /identity/v3/users => generated 289 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 18:26:45.890835 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac93f9e-d4d6-49fb-bfea-ff7b74203acc admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:45.902011 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac93f9e-d4d6-49fb-bfea-ff7b74203acc admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:45.907116 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b159366-ab3a-4b9f-93d2-35def00a3e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:45.908157 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b159366-ab3a-4b9f-93d2-35def00a3e31 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:45.908157 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b159366-ab3a-4b9f-93d2-35def00a3e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:45.908389 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b159366-ab3a-4b9f-93d2-35def00a3e31 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:45.909808 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b159366-ab3a-4b9f-93d2-35def00a3e31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:45.911492 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b159366-ab3a-4b9f-93d2-35def00a3e31 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:45.921526 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1055/2093] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:26:45 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:26:45.925447 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b159366-ab3a-4b9f-93d2-35def00a3e31 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:45.934648 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b159366-ab3a-4b9f-93d2-35def00a3e31 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:45.939193 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c84894f-947b-49a0-9ec6-bf5318e3cef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:45.939798 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c84894f-947b-49a0-9ec6-bf5318e3cef3 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:45.940076 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c84894f-947b-49a0-9ec6-bf5318e3cef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:45.941043 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c84894f-947b-49a0-9ec6-bf5318e3cef3 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:45.941748 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c84894f-947b-49a0-9ec6-bf5318e3cef3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:45.942676 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-5131b9e2-5dc9-4457-8538-1ac99d1e6736 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb6d2b02e646406aaadb089f9243f98e'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:45.943298 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-5131b9e2-5dc9-4457-8538-1ac99d1e6736 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb6d2b02e646406aaadb089f9243f98e'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:45.943408 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c84894f-947b-49a0-9ec6-bf5318e3cef3 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:45.949701 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1039/2094] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:26:45 2021] DELETE /identity/v3/users/bb6d2b02e646406aaadb089f9243f98e => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:26:45.957666 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1056/2095] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:26:45 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 18:26:45.957845 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8867c9b-22a5-41ac-a333-b3149ea6de76 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:45.957845 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8867c9b-22a5-41ac-a333-b3149ea6de76 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:45.957845 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8867c9b-22a5-41ac-a333-b3149ea6de76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:45.958735 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c84894f-947b-49a0-9ec6-bf5318e3cef3 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:45.960344 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-2c84894f-947b-49a0-9ec6-bf5318e3cef3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:45.971955 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-b8867c9b-22a5-41ac-a333-b3149ea6de76 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:45.972381 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c84894f-947b-49a0-9ec6-bf5318e3cef3 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:45.973172 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-b8867c9b-22a5-41ac-a333-b3149ea6de76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:46.040251 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1040/2096] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:26:46.041355 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8867c9b-22a5-41ac-a333-b3149ea6de76 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:46.042770 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-b8867c9b-22a5-41ac-a333-b3149ea6de76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:46.046953 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b0bd0a-1aef-4973-9293-b3f2a9f30324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:46.047841 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b0bd0a-1aef-4973-9293-b3f2a9f30324 admin admin] REQUEST_METHOD: `PUT` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:46.048121 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b0bd0a-1aef-4973-9293-b3f2a9f30324 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:46.048393 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b0bd0a-1aef-4973-9293-b3f2a9f30324 admin admin] PATH_INFO: `/v3/projects/00ecfacaa05c41bd8b89d62f18cb1f6e/users/59f156fc61ad4cae80c3bfe29dde7b83/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:46.055169 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8867c9b-22a5-41ac-a333-b3149ea6de76 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:46.059894 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f49b60-635a-4371-8ca2-259d26310e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:46.060772 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f49b60-635a-4371-8ca2-259d26310e9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:46.066344 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f49b60-635a-4371-8ca2-259d26310e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:46.066344 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f49b60-635a-4371-8ca2-259d26310e9b admin admin] PATH_INFO: `/v3/projects/8ede619131e542568d562ea8eb3e43d3` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:46.066344 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f49b60-635a-4371-8ca2-259d26310e9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ede619131e542568d562ea8eb3e43d3)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:46.066612 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b0bd0a-1aef-4973-9293-b3f2a9f30324 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00ecfacaa05c41bd8b89d62f18cb1f6e, user_id=59f156fc61ad4cae80c3bfe29dde7b83, role_id=33b8a5a8d1d643f2a98f598e6ab0a1cf)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:46.066693 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f49b60-635a-4371-8ca2-259d26310e9b admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:46.066775 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b0bd0a-1aef-4973-9293-b3f2a9f30324 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:46.268103 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1057/2097] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:26:45 2021] PUT /identity/v3/projects/00ecfacaa05c41bd8b89d62f18cb1f6e/users/59f156fc61ad4cae80c3bfe29dde7b83/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:26:46.269157 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b0bd0a-1aef-4973-9293-b3f2a9f30324 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:46.270723 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-e3b0bd0a-1aef-4973-9293-b3f2a9f30324 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:46.317756 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-47f49b60-635a-4371-8ca2-259d26310e9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ede619131e542568d562ea8eb3e43d3', 'request_id': 'req-47f49b60-635a-4371-8ca2-259d26310e9b'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:46.330186 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b0bd0a-1aef-4973-9293-b3f2a9f30324 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:46.377483 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1249d4-c70a-44f5-af82-173157743ae0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:46.378847 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1249d4-c70a-44f5-af82-173157743ae0 service neutron] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:46.379137 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1249d4-c70a-44f5-af82-173157743ae0 service neutron] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:46.384120 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1249d4-c70a-44f5-af82-173157743ae0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:46.439621 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-47f49b60-635a-4371-8ca2-259d26310e9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ede619131e542568d562ea8eb3e43d3', 'request_id': 'req-47f49b60-635a-4371-8ca2-259d26310e9b'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:46.449445 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-47f49b60-635a-4371-8ca2-259d26310e9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ede619131e542568d562ea8eb3e43d3', 'request_id': 'req-47f49b60-635a-4371-8ca2-259d26310e9b'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:46.455595 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1249d4-c70a-44f5-af82-173157743ae0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:46.457192 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1249d4-c70a-44f5-af82-173157743ae0 service neutron] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:46.468141 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1058/2098] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:26:46 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:26:46.469512 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37b3c09-51c7-49ed-8747-53c039d88006 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:46.469804 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37b3c09-51c7-49ed-8747-53c039d88006 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:46.470075 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37b3c09-51c7-49ed-8747-53c039d88006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:46.471241 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-47f49b60-635a-4371-8ca2-259d26310e9b admin admin] The token cache is being invalidate because project 8ede619131e542568d562ea8eb3e43d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:26:46.471748 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-47f49b60-635a-4371-8ca2-259d26310e9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:46.472851 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-47f49b60-635a-4371-8ca2-259d26310e9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:46.477317 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1041/2099] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:26:46 2021] DELETE /identity/v3/projects/8ede619131e542568d562ea8eb3e43d3 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:26:46.488248 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc58ad-051c-46d1-bad5-ab5c6dbb5e0b None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:46.488590 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc58ad-051c-46d1-bad5-ab5c6dbb5e0b None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:46.488859 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc58ad-051c-46d1-bad5-ab5c6dbb5e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:46.511594 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-a37b3c09-51c7-49ed-8747-53c039d88006 None None] MFA Rules not processed for user `59f156fc61ad4cae80c3bfe29dde7b83`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:46.511594 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-a37b3c09-51c7-49ed-8747-53c039d88006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:46.512559 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-dfdc58ad-051c-46d1-bad5-ab5c6dbb5e0b None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:46.513754 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-dfdc58ad-051c-46d1-bad5-ab5c6dbb5e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:46.522555 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1042/2100] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:26:46.530658 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf8637-046b-446b-a18f-6774e4428f80 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:46.531017 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf8637-046b-446b-a18f-6774e4428f80 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:46.531359 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf8637-046b-446b-a18f-6774e4428f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:46.559779 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-77bf8637-046b-446b-a18f-6774e4428f80 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:46.561376 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-77bf8637-046b-446b-a18f-6774e4428f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:46.576296 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1043/2101] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:26:46.577407 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf8637-046b-446b-a18f-6774e4428f80 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:46.580658 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1059/2102] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:46 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:26:46.586497 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37b3c09-51c7-49ed-8747-53c039d88006 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:46.590564 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-a37b3c09-51c7-49ed-8747-53c039d88006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:46.594239 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf8637-046b-446b-a18f-6774e4428f80 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:46.600037 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf6b55e-bb97-4acf-af40-e5db8794c601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:46.600854 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf6b55e-bb97-4acf-af40-e5db8794c601 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:46.601216 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf6b55e-bb97-4acf-af40-e5db8794c601 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:46.601558 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf6b55e-bb97-4acf-af40-e5db8794c601 admin admin] PATH_INFO: `/v3/domains` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:46.602378 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf6b55e-bb97-4acf-af40-e5db8794c601 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:26:46.602756 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf6b55e-bb97-4acf-af40-e5db8794c601 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:46.604528 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf6b55e-bb97-4acf-af40-e5db8794c601 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:46.608292 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37b3c09-51c7-49ed-8747-53c039d88006 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:46.616824 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86316975-1c7d-4fd2-b605-b7b7ee732568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:46.617498 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86316975-1c7d-4fd2-b605-b7b7ee732568 admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:46.618507 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86316975-1c7d-4fd2-b605-b7b7ee732568 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:46.618784 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86316975-1c7d-4fd2-b605-b7b7ee732568 admin admin] PATH_INFO: `/v3/projects` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:46.619490 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86316975-1c7d-4fd2-b605-b7b7ee732568 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:46.621448 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86316975-1c7d-4fd2-b605-b7b7ee732568 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:46.626430 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1044/2103] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 12 18:26:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:26:46.626552 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf6b55e-bb97-4acf-af40-e5db8794c601 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:46.637268 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf6b55e-bb97-4acf-af40-e5db8794c601 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:46.641975 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c403b412-ce81-42da-a3c2-94443f38be85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:46.642623 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403b412-ce81-42da-a3c2-94443f38be85 admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:46.642905 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403b412-ce81-42da-a3c2-94443f38be85 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:46.643180 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403b412-ce81-42da-a3c2-94443f38be85 admin admin] PATH_INFO: `/v3/projects` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:46.643909 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c403b412-ce81-42da-a3c2-94443f38be85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:46.645837 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c403b412-ce81-42da-a3c2-94443f38be85 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:46.740443 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1060/2104] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:26:46 2021] POST /identity/v3/projects => generated 375 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 18:26:46.741686 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86316975-1c7d-4fd2-b605-b7b7ee732568 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:46.745039 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-86316975-1c7d-4fd2-b605-b7b7ee732568 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:46.790628 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1045/2105] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:26:46 2021] POST /identity/v3/projects => generated 381 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 18:26:46.790628 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c403b412-ce81-42da-a3c2-94443f38be85 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:46.831174 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86316975-1c7d-4fd2-b605-b7b7ee732568 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:46.891394 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c403b412-ce81-42da-a3c2-94443f38be85 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:46.896741 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739f9281-45d8-4be2-b554-175cf80197cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:46.897326 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f9281-45d8-4be2-b554-175cf80197cb admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:46.897634 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f9281-45d8-4be2-b554-175cf80197cb admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:46.897883 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f9281-45d8-4be2-b554-175cf80197cb admin admin] PATH_INFO: `/v3/users` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:46.898754 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739f9281-45d8-4be2-b554-175cf80197cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:46.901198 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739f9281-45d8-4be2-b554-175cf80197cb admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:46.903403 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96efc35e-72a9-4315-8e16-5341ab9335e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:46.904792 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96efc35e-72a9-4315-8e16-5341ab9335e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:46.905368 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96efc35e-72a9-4315-8e16-5341ab9335e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:46.905795 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96efc35e-72a9-4315-8e16-5341ab9335e5 admin admin] PATH_INFO: `/v3/users/7fdeedef4d424c62bf8d81bdb08a4a5b` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:46.907425 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96efc35e-72a9-4315-8e16-5341ab9335e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fdeedef4d424c62bf8d81bdb08a4a5b)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:46.910380 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96efc35e-72a9-4315-8e16-5341ab9335e5 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:47.052713 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1046/2106] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:26:46 2021] POST /identity/v3/users => generated 294 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:26:47.053563 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739f9281-45d8-4be2-b554-175cf80197cb admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:47.062959 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739f9281-45d8-4be2-b554-175cf80197cb admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:47.067598 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1f3757-172e-4660-abfa-1a9262c3f166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:47.068222 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1f3757-172e-4660-abfa-1a9262c3f166 admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:47.071195 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1f3757-172e-4660-abfa-1a9262c3f166 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:47.071195 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1f3757-172e-4660-abfa-1a9262c3f166 admin admin] PATH_INFO: `/v3/users` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:47.071195 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1f3757-172e-4660-abfa-1a9262c3f166 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:47.071436 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1f3757-172e-4660-abfa-1a9262c3f166 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:47.165296 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1047/2107] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:26:47 2021] POST /identity/v3/users => generated 291 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:26:47.166151 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1f3757-172e-4660-abfa-1a9262c3f166 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:47.175963 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1f3757-172e-4660-abfa-1a9262c3f166 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:47.180782 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c19272-ee57-486b-8cb6-0aceb25b5c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:47.181437 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c19272-ee57-486b-8cb6-0aceb25b5c3a admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:47.181720 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c19272-ee57-486b-8cb6-0aceb25b5c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:47.181996 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c19272-ee57-486b-8cb6-0aceb25b5c3a admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:47.182729 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c19272-ee57-486b-8cb6-0aceb25b5c3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:47.184361 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c19272-ee57-486b-8cb6-0aceb25b5c3a admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:47.194288 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1048/2108] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:26:47 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:26:47.195126 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c19272-ee57-486b-8cb6-0aceb25b5c3a admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:47.197090 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-34c19272-ee57-486b-8cb6-0aceb25b5c3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:47.210494 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c19272-ee57-486b-8cb6-0aceb25b5c3a admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:47.215403 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4dc9ce-eab8-4cff-808e-90d4b9e40e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:47.216238 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4dc9ce-eab8-4cff-808e-90d4b9e40e6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:47.216560 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4dc9ce-eab8-4cff-808e-90d4b9e40e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:47.216830 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4dc9ce-eab8-4cff-808e-90d4b9e40e6e admin admin] PATH_INFO: `/v3/projects/227abc7af06b46c79c4682c7bd82e316` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:47.218004 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4dc9ce-eab8-4cff-808e-90d4b9e40e6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=227abc7af06b46c79c4682c7bd82e316)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:47.219919 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4dc9ce-eab8-4cff-808e-90d4b9e40e6e admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:47.241225 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-96efc35e-72a9-4315-8e16-5341ab9335e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fdeedef4d424c62bf8d81bdb08a4a5b'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:47.242179 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-96efc35e-72a9-4315-8e16-5341ab9335e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fdeedef4d424c62bf8d81bdb08a4a5b'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:47.253434 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-96efc35e-72a9-4315-8e16-5341ab9335e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fdeedef4d424c62bf8d81bdb08a4a5b'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:47.254267 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-96efc35e-72a9-4315-8e16-5341ab9335e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fdeedef4d424c62bf8d81bdb08a4a5b'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:47.260888 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-96efc35e-72a9-4315-8e16-5341ab9335e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fdeedef4d424c62bf8d81bdb08a4a5b'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:47.324439 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-fe4dc9ce-eab8-4cff-808e-90d4b9e40e6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '227abc7af06b46c79c4682c7bd82e316', 'request_id': 'req-fe4dc9ce-eab8-4cff-808e-90d4b9e40e6e'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:47.341738 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1061/2109] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:26:46 2021] DELETE /identity/v3/users/7fdeedef4d424c62bf8d81bdb08a4a5b => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:26:47.342696 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96efc35e-72a9-4315-8e16-5341ab9335e5 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:47.344046 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-96efc35e-72a9-4315-8e16-5341ab9335e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:47.405335 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96efc35e-72a9-4315-8e16-5341ab9335e5 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:47.410659 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb89586a-bcc2-43ac-b71c-0d6726c78373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:47.411509 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb89586a-bcc2-43ac-b71c-0d6726c78373 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:47.411789 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb89586a-bcc2-43ac-b71c-0d6726c78373 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:47.412060 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb89586a-bcc2-43ac-b71c-0d6726c78373 admin admin] PATH_INFO: `/v3/users/15239896ef4b4f50af6af54712301f5b` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:47.413288 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb89586a-bcc2-43ac-b71c-0d6726c78373 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15239896ef4b4f50af6af54712301f5b)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:47.415194 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb89586a-bcc2-43ac-b71c-0d6726c78373 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:47.422532 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-fe4dc9ce-eab8-4cff-808e-90d4b9e40e6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '227abc7af06b46c79c4682c7bd82e316', 'request_id': 'req-fe4dc9ce-eab8-4cff-808e-90d4b9e40e6e'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:47.429662 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-fe4dc9ce-eab8-4cff-808e-90d4b9e40e6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '227abc7af06b46c79c4682c7bd82e316', 'request_id': 'req-fe4dc9ce-eab8-4cff-808e-90d4b9e40e6e'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:47.439845 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-fe4dc9ce-eab8-4cff-808e-90d4b9e40e6e admin admin] The token cache is being invalidate because project 227abc7af06b46c79c4682c7bd82e316 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:26:47.440755 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-fe4dc9ce-eab8-4cff-808e-90d4b9e40e6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:47.441532 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-fe4dc9ce-eab8-4cff-808e-90d4b9e40e6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:47.443111 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1049/2110] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:26:47 2021] DELETE /identity/v3/projects/227abc7af06b46c79c4682c7bd82e316 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:26:47.443993 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4dc9ce-eab8-4cff-808e-90d4b9e40e6e admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:47.445292 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-fe4dc9ce-eab8-4cff-808e-90d4b9e40e6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:47.507392 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4dc9ce-eab8-4cff-808e-90d4b9e40e6e admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:47.512077 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f2031e-74ea-4ba9-acb5-d224ca8d7a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:47.512764 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f2031e-74ea-4ba9-acb5-d224ca8d7a3b admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:47.513246 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f2031e-74ea-4ba9-acb5-d224ca8d7a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:47.513514 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f2031e-74ea-4ba9-acb5-d224ca8d7a3b admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:47.514255 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f2031e-74ea-4ba9-acb5-d224ca8d7a3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:47.515830 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f2031e-74ea-4ba9-acb5-d224ca8d7a3b admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:47.526915 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1050/2111] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:26:47 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:26:47.538033 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f2031e-74ea-4ba9-acb5-d224ca8d7a3b admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:47.538033 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-13f2031e-74ea-4ba9-acb5-d224ca8d7a3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:47.543659 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f2031e-74ea-4ba9-acb5-d224ca8d7a3b admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:47.548012 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc01f02c-5f49-47b6-bd24-f600b5cfffb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:47.548928 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01f02c-5f49-47b6-bd24-f600b5cfffb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:47.549211 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01f02c-5f49-47b6-bd24-f600b5cfffb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:47.549495 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01f02c-5f49-47b6-bd24-f600b5cfffb5 admin admin] PATH_INFO: `/v3/projects/c4749f4bb47846b7996e25d8ba06a292/users/85252e29db1c47829652f6e18af1892f/roles/6c54f239944d46e3b027ccce97eb8b49` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:47.564409 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc01f02c-5f49-47b6-bd24-f600b5cfffb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4749f4bb47846b7996e25d8ba06a292, user_id=85252e29db1c47829652f6e18af1892f, role_id=6c54f239944d46e3b027ccce97eb8b49)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:47.567598 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc01f02c-5f49-47b6-bd24-f600b5cfffb5 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:47.668469 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1051/2112] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:26:47 2021] PUT /identity/v3/projects/c4749f4bb47846b7996e25d8ba06a292/users/85252e29db1c47829652f6e18af1892f/roles/6c54f239944d46e3b027ccce97eb8b49 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:26:47.669812 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2a5dce-54c6-47e4-a3c4-21427adc57bb None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:47.670190 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2a5dce-54c6-47e4-a3c4-21427adc57bb None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:47.670369 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2a5dce-54c6-47e4-a3c4-21427adc57bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:47.675820 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-cb89586a-bcc2-43ac-b71c-0d6726c78373 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15239896ef4b4f50af6af54712301f5b'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:47.676497 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-cb89586a-bcc2-43ac-b71c-0d6726c78373 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15239896ef4b4f50af6af54712301f5b'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:47.686734 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-8c2a5dce-54c6-47e4-a3c4-21427adc57bb None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:47.687936 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-8c2a5dce-54c6-47e4-a3c4-21427adc57bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:47.688049 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-cb89586a-bcc2-43ac-b71c-0d6726c78373 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15239896ef4b4f50af6af54712301f5b'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:47.688711 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-cb89586a-bcc2-43ac-b71c-0d6726c78373 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15239896ef4b4f50af6af54712301f5b'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:47.696062 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-cb89586a-bcc2-43ac-b71c-0d6726c78373 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15239896ef4b4f50af6af54712301f5b'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:47.744684 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1052/2113] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:26:47.746131 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d69d3e0-5814-4c3d-990c-4d761364bfa9 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:47.746421 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d69d3e0-5814-4c3d-990c-4d761364bfa9 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:47.746697 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d69d3e0-5814-4c3d-990c-4d761364bfa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:47.764967 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-1d69d3e0-5814-4c3d-990c-4d761364bfa9 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:47.766150 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-1d69d3e0-5814-4c3d-990c-4d761364bfa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:47.774679 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1053/2114] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:26:47.775824 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d69d3e0-5814-4c3d-990c-4d761364bfa9 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:47.777022 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-1d69d3e0-5814-4c3d-990c-4d761364bfa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:47.788193 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d69d3e0-5814-4c3d-990c-4d761364bfa9 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:47.788540 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1062/2115] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:26:47 2021] DELETE /identity/v3/users/15239896ef4b4f50af6af54712301f5b => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:26:47.789391 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb89586a-bcc2-43ac-b71c-0d6726c78373 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:47.790855 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-cb89586a-bcc2-43ac-b71c-0d6726c78373 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:47.852023 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb89586a-bcc2-43ac-b71c-0d6726c78373 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:47.854239 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b0c351-965c-49e8-a558-ccfa1c21e89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:47.854905 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0c351-965c-49e8-a558-ccfa1c21e89e admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:47.855468 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0c351-965c-49e8-a558-ccfa1c21e89e admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:47.855760 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0c351-965c-49e8-a558-ccfa1c21e89e admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:47.855887 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be1ad8d-80c8-4029-852d-1db39e1176f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6966ce0774f4437a9b688494e9d0574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:47.856536 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b0c351-965c-49e8-a558-ccfa1c21e89e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:47.856660 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1ad8d-80c8-4029-852d-1db39e1176f3 service cinder] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:47.857007 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1ad8d-80c8-4029-852d-1db39e1176f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:47.857281 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1ad8d-80c8-4029-852d-1db39e1176f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:47.858274 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b0c351-965c-49e8-a558-ccfa1c21e89e admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:47.859168 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-0be1ad8d-80c8-4029-852d-1db39e1176f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:47.878251 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1054/2116] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:26:47 2021] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:26:47.878251 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b0c351-965c-49e8-a558-ccfa1c21e89e admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:47.880086 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-d8b0c351-965c-49e8-a558-ccfa1c21e89e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:47.903619 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b0c351-965c-49e8-a558-ccfa1c21e89e admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:47.912631 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dfb53a-7062-4831-b13e-729de6e76eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:47.913867 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dfb53a-7062-4831-b13e-729de6e76eab admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:47.914246 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dfb53a-7062-4831-b13e-729de6e76eab admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:47.914619 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dfb53a-7062-4831-b13e-729de6e76eab admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:47.915478 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dfb53a-7062-4831-b13e-729de6e76eab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:47.917767 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dfb53a-7062-4831-b13e-729de6e76eab admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:47.933664 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1055/2117] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:26:47 2021] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:26:47.934682 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dfb53a-7062-4831-b13e-729de6e76eab admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:47.936542 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-70dfb53a-7062-4831-b13e-729de6e76eab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:47.939976 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be1ad8d-80c8-4029-852d-1db39e1176f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:47.942184 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be1ad8d-80c8-4029-852d-1db39e1176f3 service cinder] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:47.953033 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1063/2118] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:26:47 2021] GET /identity/v3/auth/tokens => generated 3470 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:26:47.954145 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f03226-36b5-4990-89ff-ed7af2f9232c None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:47.954429 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f03226-36b5-4990-89ff-ed7af2f9232c None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:47.954700 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f03226-36b5-4990-89ff-ed7af2f9232c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:47.976067 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-f6f03226-36b5-4990-89ff-ed7af2f9232c None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:47.977430 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-f6f03226-36b5-4990-89ff-ed7af2f9232c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:47.995340 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1064/2119] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:26:47.995340 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f03226-36b5-4990-89ff-ed7af2f9232c None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:48.006091 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f03226-36b5-4990-89ff-ed7af2f9232c None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:48.014258 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e004608-b32d-46bb-a63c-ef717cfa0015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:48.015142 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e004608-b32d-46bb-a63c-ef717cfa0015 admin admin] REQUEST_METHOD: `PUT` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:48.015501 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e004608-b32d-46bb-a63c-ef717cfa0015 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:48.015818 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e004608-b32d-46bb-a63c-ef717cfa0015 admin admin] PATH_INFO: `/v3/projects/e28f8af988f8432eb33c6d4af8e0b48d/users/dd7ea0f93dc8467ea3591381710b09c3/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:48.037747 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dfb53a-7062-4831-b13e-729de6e76eab admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:48.037902 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e004608-b32d-46bb-a63c-ef717cfa0015 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e28f8af988f8432eb33c6d4af8e0b48d, user_id=dd7ea0f93dc8467ea3591381710b09c3, role_id=33b8a5a8d1d643f2a98f598e6ab0a1cf)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:48.037902 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e004608-b32d-46bb-a63c-ef717cfa0015 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:48.038176 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8fe192-c7cf-40f6-8c32-28569457c2c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:48.038176 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8fe192-c7cf-40f6-8c32-28569457c2c7 service neutron] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:48.038176 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8fe192-c7cf-40f6-8c32-28569457c2c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:48.038176 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8fe192-c7cf-40f6-8c32-28569457c2c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:48.047095 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8fe192-c7cf-40f6-8c32-28569457c2c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:48.048600 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8fe192-c7cf-40f6-8c32-28569457c2c7 service neutron] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:48.058562 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1056/2120] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:26:47 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:26:48.059321 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8fe192-c7cf-40f6-8c32-28569457c2c7 service neutron] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:48.069128 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8fe192-c7cf-40f6-8c32-28569457c2c7 service neutron] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:48.074460 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3a2c09-fac7-441b-b6a6-929f9cee59cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:48.075172 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3a2c09-fac7-441b-b6a6-929f9cee59cb admin admin] REQUEST_METHOD: `PUT` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:48.075455 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3a2c09-fac7-441b-b6a6-929f9cee59cb admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:48.075932 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3a2c09-fac7-441b-b6a6-929f9cee59cb admin admin] PATH_INFO: `/v3/projects/c4749f4bb47846b7996e25d8ba06a292/users/85252e29db1c47829652f6e18af1892f/roles/6c54f239944d46e3b027ccce97eb8b49` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:48.078064 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3a2c09-fac7-441b-b6a6-929f9cee59cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4749f4bb47846b7996e25d8ba06a292, user_id=85252e29db1c47829652f6e18af1892f, role_id=6c54f239944d46e3b027ccce97eb8b49)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:48.080807 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3a2c09-fac7-441b-b6a6-929f9cee59cb admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:48.091811 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1057/2121] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:26:48 2021] PUT /identity/v3/projects/c4749f4bb47846b7996e25d8ba06a292/users/85252e29db1c47829652f6e18af1892f/roles/6c54f239944d46e3b027ccce97eb8b49 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:26:48.092704 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3a2c09-fac7-441b-b6a6-929f9cee59cb admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:48.137306 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1065/2122] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:26:47 2021] PUT /identity/v3/projects/e28f8af988f8432eb33c6d4af8e0b48d/users/dd7ea0f93dc8467ea3591381710b09c3/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:26:48.149578 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b8847-c9b1-4298-a7d9-d0e13ce6589f None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:48.149891 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b8847-c9b1-4298-a7d9-d0e13ce6589f None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:48.150404 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b8847-c9b1-4298-a7d9-d0e13ce6589f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:48.179061 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3a2c09-fac7-441b-b6a6-929f9cee59cb admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:48.181492 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-d17b8847-c9b1-4298-a7d9-d0e13ce6589f None None] MFA Rules not processed for user `85252e29db1c47829652f6e18af1892f`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:48.182712 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-d17b8847-c9b1-4298-a7d9-d0e13ce6589f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:48.241561 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10d9483-a7d6-46e5-b369-27d2ea701a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:48.242223 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d9483-a7d6-46e5-b369-27d2ea701a6e admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:48.242617 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d9483-a7d6-46e5-b369-27d2ea701a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:48.242894 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d9483-a7d6-46e5-b369-27d2ea701a6e admin admin] PATH_INFO: `/v3/domains` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:48.243625 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10d9483-a7d6-46e5-b369-27d2ea701a6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:26:48.243956 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10d9483-a7d6-46e5-b369-27d2ea701a6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:48.245650 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10d9483-a7d6-46e5-b369-27d2ea701a6e admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:48.254964 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1066/2123] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:48 2021] POST /identity/v3/auth/tokens => generated 3462 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:26:48.255802 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17b8847-c9b1-4298-a7d9-d0e13ce6589f None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:48.257065 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-d17b8847-c9b1-4298-a7d9-d0e13ce6589f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:48.261340 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1058/2124] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 12 18:26:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:26:48.261340 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe32b9c-eafb-4a35-8147-cd8b4813c5f7 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:48.261340 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe32b9c-eafb-4a35-8147-cd8b4813c5f7 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:48.261340 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe32b9c-eafb-4a35-8147-cd8b4813c5f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:48.275934 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17b8847-c9b1-4298-a7d9-d0e13ce6589f None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:48.280929 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f525a259-21b9-47e9-a581-03bb557edf03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:48.281906 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f525a259-21b9-47e9-a581-03bb557edf03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:48.282287 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f525a259-21b9-47e9-a581-03bb557edf03 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:48.282707 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f525a259-21b9-47e9-a581-03bb557edf03 admin admin] PATH_INFO: `/v3/projects/9da6195bb2d64abfa8cd8671874f1830` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:48.284549 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f525a259-21b9-47e9-a581-03bb557edf03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9da6195bb2d64abfa8cd8671874f1830)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:48.286696 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f525a259-21b9-47e9-a581-03bb557edf03 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:48.292960 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-ebe32b9c-eafb-4a35-8147-cd8b4813c5f7 None None] MFA Rules not processed for user `dd7ea0f93dc8467ea3591381710b09c3`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:48.294639 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-ebe32b9c-eafb-4a35-8147-cd8b4813c5f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:48.364317 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1059/2125] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:48 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:26:48.368666 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe32b9c-eafb-4a35-8147-cd8b4813c5f7 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:48.377656 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe32b9c-eafb-4a35-8147-cd8b4813c5f7 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:48.382346 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a49e821-9372-4514-abf6-1b1a525bff59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:48.382989 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a49e821-9372-4514-abf6-1b1a525bff59 admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:48.383317 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a49e821-9372-4514-abf6-1b1a525bff59 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:48.383537 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a49e821-9372-4514-abf6-1b1a525bff59 admin admin] PATH_INFO: `/v3/projects` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:48.384228 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a49e821-9372-4514-abf6-1b1a525bff59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:48.386162 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a49e821-9372-4514-abf6-1b1a525bff59 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:48.413410 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-f525a259-21b9-47e9-a581-03bb557edf03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9da6195bb2d64abfa8cd8671874f1830', 'request_id': 'req-f525a259-21b9-47e9-a581-03bb557edf03'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:48.419723 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-f525a259-21b9-47e9-a581-03bb557edf03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9da6195bb2d64abfa8cd8671874f1830', 'request_id': 'req-f525a259-21b9-47e9-a581-03bb557edf03'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:48.426337 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-f525a259-21b9-47e9-a581-03bb557edf03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9da6195bb2d64abfa8cd8671874f1830', 'request_id': 'req-f525a259-21b9-47e9-a581-03bb557edf03'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:48.486198 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1060/2126] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:26:48 2021] POST /identity/v3/projects => generated 367 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:26:48.487060 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a49e821-9372-4514-abf6-1b1a525bff59 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:48.488629 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-1a49e821-9372-4514-abf6-1b1a525bff59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:48.539232 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-f525a259-21b9-47e9-a581-03bb557edf03 admin admin] The token cache is being invalidate because project 9da6195bb2d64abfa8cd8671874f1830 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74005) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:26:48.539686 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-f525a259-21b9-47e9-a581-03bb557edf03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:48.540692 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-f525a259-21b9-47e9-a581-03bb557edf03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:48.542548 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1067/2127] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:26:48 2021] DELETE /identity/v3/projects/9da6195bb2d64abfa8cd8671874f1830 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:26:48.543259 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f525a259-21b9-47e9-a581-03bb557edf03 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:48.544580 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-f525a259-21b9-47e9-a581-03bb557edf03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:48.552507 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a49e821-9372-4514-abf6-1b1a525bff59 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:48.556182 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a18f8c7-3202-4d07-b743-4c81b9538dab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6966ce0774f4437a9b688494e9d0574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:48.556882 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18f8c7-3202-4d07-b743-4c81b9538dab service cinder] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:48.557442 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18f8c7-3202-4d07-b743-4c81b9538dab service cinder] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:48.557442 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18f8c7-3202-4d07-b743-4c81b9538dab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:48.559256 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-5a18f8c7-3202-4d07-b743-4c81b9538dab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:48.608343 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f525a259-21b9-47e9-a581-03bb557edf03 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:48.623709 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a18f8c7-3202-4d07-b743-4c81b9538dab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:48.625193 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a18f8c7-3202-4d07-b743-4c81b9538dab service cinder] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:48.635476 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1061/2128] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:26:48 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:26:48.636287 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a18f8c7-3202-4d07-b743-4c81b9538dab service cinder] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:48.662662 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-5a18f8c7-3202-4d07-b743-4c81b9538dab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:48.667364 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d966d3-417c-47ff-8e49-ef20139cb01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:48.668020 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d966d3-417c-47ff-8e49-ef20139cb01a admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:48.668303 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d966d3-417c-47ff-8e49-ef20139cb01a admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:48.668606 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d966d3-417c-47ff-8e49-ef20139cb01a admin admin] PATH_INFO: `/v3/projects` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:48.669303 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d966d3-417c-47ff-8e49-ef20139cb01a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:48.671190 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d966d3-417c-47ff-8e49-ef20139cb01a admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:48.722453 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a18f8c7-3202-4d07-b743-4c81b9538dab service cinder] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:48.727326 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483862c9-2f2c-4c51-92f2-8a03c4f4d829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:48.727983 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483862c9-2f2c-4c51-92f2-8a03c4f4d829 admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:48.728258 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483862c9-2f2c-4c51-92f2-8a03c4f4d829 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:48.728580 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483862c9-2f2c-4c51-92f2-8a03c4f4d829 admin admin] PATH_INFO: `/v3/users` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:48.729276 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483862c9-2f2c-4c51-92f2-8a03c4f4d829 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:48.741243 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483862c9-2f2c-4c51-92f2-8a03c4f4d829 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:48.804495 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1068/2129] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:26:48 2021] POST /identity/v3/projects => generated 385 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:26:48.804495 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d966d3-417c-47ff-8e49-ef20139cb01a admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:48.804495 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-d1d966d3-417c-47ff-8e49-ef20139cb01a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:48.866479 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d966d3-417c-47ff-8e49-ef20139cb01a admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:48.871202 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72ca0ff-98c2-4ea2-942f-f59d12bedb2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:48.872281 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ca0ff-98c2-4ea2-942f-f59d12bedb2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:48.872612 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ca0ff-98c2-4ea2-942f-f59d12bedb2c admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:48.872884 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ca0ff-98c2-4ea2-942f-f59d12bedb2c admin admin] PATH_INFO: `/v3/projects/85f5fd256b8543aeb27f62d9a75587c9` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:48.874176 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72ca0ff-98c2-4ea2-942f-f59d12bedb2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=85f5fd256b8543aeb27f62d9a75587c9)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:48.876289 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72ca0ff-98c2-4ea2-942f-f59d12bedb2c admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:48.886299 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1062/2130] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:26:48 2021] POST /identity/v3/users => generated 284 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:26:48.887625 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e895fe2e-7cf7-4f57-ae8b-4cf4fc230a06 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:48.887916 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e895fe2e-7cf7-4f57-ae8b-4cf4fc230a06 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:48.888192 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e895fe2e-7cf7-4f57-ae8b-4cf4fc230a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:48.906371 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-e895fe2e-7cf7-4f57-ae8b-4cf4fc230a06 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:48.907566 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-e895fe2e-7cf7-4f57-ae8b-4cf4fc230a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:48.915580 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1063/2131] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:26:48.916495 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e895fe2e-7cf7-4f57-ae8b-4cf4fc230a06 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:48.926239 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e895fe2e-7cf7-4f57-ae8b-4cf4fc230a06 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:48.930836 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a2fa50-049d-46c7-bd7b-72d6f15d022f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:48.931483 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a2fa50-049d-46c7-bd7b-72d6f15d022f admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:48.931761 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a2fa50-049d-46c7-bd7b-72d6f15d022f admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:48.932033 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a2fa50-049d-46c7-bd7b-72d6f15d022f admin admin] PATH_INFO: `/v3/users` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:48.932760 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a2fa50-049d-46c7-bd7b-72d6f15d022f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:48.934674 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a2fa50-049d-46c7-bd7b-72d6f15d022f admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:49.062931 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-d72ca0ff-98c2-4ea2-942f-f59d12bedb2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85f5fd256b8543aeb27f62d9a75587c9', 'request_id': 'req-d72ca0ff-98c2-4ea2-942f-f59d12bedb2c'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:49.069160 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-d72ca0ff-98c2-4ea2-942f-f59d12bedb2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85f5fd256b8543aeb27f62d9a75587c9', 'request_id': 'req-d72ca0ff-98c2-4ea2-942f-f59d12bedb2c'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:49.074315 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-d72ca0ff-98c2-4ea2-942f-f59d12bedb2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85f5fd256b8543aeb27f62d9a75587c9', 'request_id': 'req-d72ca0ff-98c2-4ea2-942f-f59d12bedb2c'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:49.111472 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1064/2132] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:26:48 2021] POST /identity/v3/users => generated 293 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:26:49.111472 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a2fa50-049d-46c7-bd7b-72d6f15d022f admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:49.121521 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a2fa50-049d-46c7-bd7b-72d6f15d022f admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:49.175881 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebeb7c5-d152-4b2b-9081-b047d7428527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:49.176485 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebeb7c5-d152-4b2b-9081-b047d7428527 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:49.176767 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebeb7c5-d152-4b2b-9081-b047d7428527 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:49.177040 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebeb7c5-d152-4b2b-9081-b047d7428527 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:49.177839 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebeb7c5-d152-4b2b-9081-b047d7428527 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:49.179432 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebeb7c5-d152-4b2b-9081-b047d7428527 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:49.187669 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-d72ca0ff-98c2-4ea2-942f-f59d12bedb2c admin admin] The token cache is being invalidate because project 85f5fd256b8543aeb27f62d9a75587c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74005) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:26:49.187962 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-d72ca0ff-98c2-4ea2-942f-f59d12bedb2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:49.189280 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1065/2133] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:26:49 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:26:49.190878 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-d72ca0ff-98c2-4ea2-942f-f59d12bedb2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:26:49.192680 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1069/2134] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:26:48 2021] DELETE /identity/v3/projects/85f5fd256b8543aeb27f62d9a75587c9 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:26:49.196646 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72ca0ff-98c2-4ea2-942f-f59d12bedb2c admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:49.196730 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ea537b-8e61-4585-9a34-a9b7bb80179c None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:49.196730 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ea537b-8e61-4585-9a34-a9b7bb80179c None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:49.196730 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ea537b-8e61-4585-9a34-a9b7bb80179c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:49.197293 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-d72ca0ff-98c2-4ea2-942f-f59d12bedb2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:49.207364 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72ca0ff-98c2-4ea2-942f-f59d12bedb2c admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:49.213414 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee10f26-34d2-4869-b577-d09a59cde858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:49.214063 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-16ea537b-8e61-4585-9a34-a9b7bb80179c None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:49.214464 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee10f26-34d2-4869-b577-d09a59cde858 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:49.214746 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee10f26-34d2-4869-b577-d09a59cde858 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:49.215011 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee10f26-34d2-4869-b577-d09a59cde858 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:49.215263 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-16ea537b-8e61-4585-9a34-a9b7bb80179c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:49.215748 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee10f26-34d2-4869-b577-d09a59cde858 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:49.217385 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee10f26-34d2-4869-b577-d09a59cde858 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:49.228083 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1066/2135] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:26:49.228083 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ea537b-8e61-4585-9a34-a9b7bb80179c None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:49.229557 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-16ea537b-8e61-4585-9a34-a9b7bb80179c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:49.232829 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1070/2136] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:26:49 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:26:49.234118 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f651524c-5290-468e-9194-6d108d31c1c8 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:49.234556 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f651524c-5290-468e-9194-6d108d31c1c8 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:49.234837 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f651524c-5290-468e-9194-6d108d31c1c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:49.243543 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ea537b-8e61-4585-9a34-a9b7bb80179c None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:49.248528 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605ffdb7-e4c1-4cb5-8b87-4b012de2b218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:49.249205 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ffdb7-e4c1-4cb5-8b87-4b012de2b218 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:49.249541 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ffdb7-e4c1-4cb5-8b87-4b012de2b218 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:49.249830 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ffdb7-e4c1-4cb5-8b87-4b012de2b218 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:49.250597 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605ffdb7-e4c1-4cb5-8b87-4b012de2b218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:49.252248 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605ffdb7-e4c1-4cb5-8b87-4b012de2b218 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:49.261426 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-f651524c-5290-468e-9194-6d108d31c1c8 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:49.262403 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1067/2137] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:26:49 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:26:49.262638 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-f651524c-5290-468e-9194-6d108d31c1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:49.263301 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605ffdb7-e4c1-4cb5-8b87-4b012de2b218 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:49.270476 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1071/2138] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:26:49.271250 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f651524c-5290-468e-9194-6d108d31c1c8 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:49.273186 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605ffdb7-e4c1-4cb5-8b87-4b012de2b218 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:49.278271 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f31797-ed4f-481a-a153-19f8cae6e202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:49.278939 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f31797-ed4f-481a-a153-19f8cae6e202 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:49.279238 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f31797-ed4f-481a-a153-19f8cae6e202 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:49.279623 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f31797-ed4f-481a-a153-19f8cae6e202 admin admin] PATH_INFO: `/v3/domains` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:49.280372 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f31797-ed4f-481a-a153-19f8cae6e202 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:26:49.280704 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f31797-ed4f-481a-a153-19f8cae6e202 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:49.282358 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f31797-ed4f-481a-a153-19f8cae6e202 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:49.283459 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f651524c-5290-468e-9194-6d108d31c1c8 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:49.288646 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4df624-9365-4cb5-b45c-0aeb691bc675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:49.289472 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4df624-9365-4cb5-b45c-0aeb691bc675 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:49.289752 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4df624-9365-4cb5-b45c-0aeb691bc675 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:49.290020 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4df624-9365-4cb5-b45c-0aeb691bc675 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:49.290750 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4df624-9365-4cb5-b45c-0aeb691bc675 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:49.292329 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4df624-9365-4cb5-b45c-0aeb691bc675 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:49.294932 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1068/2139] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 12 18:26:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:26:49.295790 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f31797-ed4f-481a-a153-19f8cae6e202 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:49.304443 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1072/2140] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:26:49 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:26:49.304766 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7208b414-d92a-4fc1-aa3d-e10fbd1682f8 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:49.305050 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7208b414-d92a-4fc1-aa3d-e10fbd1682f8 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:49.305323 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7208b414-d92a-4fc1-aa3d-e10fbd1682f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:49.306498 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f31797-ed4f-481a-a153-19f8cae6e202 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:49.311167 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab46e9-bbba-4955-98d8-f7835b13a83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:49.312034 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab46e9-bbba-4955-98d8-f7835b13a83e admin admin] REQUEST_METHOD: `PUT` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:49.312315 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab46e9-bbba-4955-98d8-f7835b13a83e admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:49.315137 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab46e9-bbba-4955-98d8-f7835b13a83e admin admin] PATH_INFO: `/v3/projects/e7dda566af7549639a88fae453164814/users/385ca42ad77c4cafad79134fceb55779/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:49.322937 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-7208b414-d92a-4fc1-aa3d-e10fbd1682f8 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:49.324196 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-7208b414-d92a-4fc1-aa3d-e10fbd1682f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:49.327066 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ab46e9-bbba-4955-98d8-f7835b13a83e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7dda566af7549639a88fae453164814, user_id=385ca42ad77c4cafad79134fceb55779, role_id=33b8a5a8d1d643f2a98f598e6ab0a1cf)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:49.329930 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ab46e9-bbba-4955-98d8-f7835b13a83e admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:49.336096 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1073/2141] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:26:49.336096 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7208b414-d92a-4fc1-aa3d-e10fbd1682f8 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:49.343194 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7208b414-d92a-4fc1-aa3d-e10fbd1682f8 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:49.348497 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72185224-fb7a-4414-ab3e-1fc740f6f3f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:49.349134 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72185224-fb7a-4414-ab3e-1fc740f6f3f3 admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:49.349410 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72185224-fb7a-4414-ab3e-1fc740f6f3f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:49.356829 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72185224-fb7a-4414-ab3e-1fc740f6f3f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:49.356829 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72185224-fb7a-4414-ab3e-1fc740f6f3f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:49.356829 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72185224-fb7a-4414-ab3e-1fc740f6f3f3 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:49.457160 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1069/2142] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:26:49 2021] PUT /identity/v3/projects/e7dda566af7549639a88fae453164814/users/385ca42ad77c4cafad79134fceb55779/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:26:49.457888 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab46e9-bbba-4955-98d8-f7835b13a83e admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:49.488925 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1074/2143] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:26:49 2021] POST /identity/v3/projects => generated 393 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:26:49.489869 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72185224-fb7a-4414-ab3e-1fc740f6f3f3 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:49.523256 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab46e9-bbba-4955-98d8-f7835b13a83e admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:49.554237 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72185224-fb7a-4414-ab3e-1fc740f6f3f3 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:49.559064 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee031a7-568c-4d8d-a30b-0b801fc770e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:49.559710 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee031a7-568c-4d8d-a30b-0b801fc770e7 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:49.559988 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee031a7-568c-4d8d-a30b-0b801fc770e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:49.560259 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee031a7-568c-4d8d-a30b-0b801fc770e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:49.561025 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee031a7-568c-4d8d-a30b-0b801fc770e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:26:49.561328 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee031a7-568c-4d8d-a30b-0b801fc770e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:49.562910 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee031a7-568c-4d8d-a30b-0b801fc770e7 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:49.576087 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1075/2144] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 12 18:26:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:26:49.577397 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a305119-8f20-4fea-80f9-047a5ad9f713 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:49.577686 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a305119-8f20-4fea-80f9-047a5ad9f713 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:49.577962 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a305119-8f20-4fea-80f9-047a5ad9f713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:49.580507 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a527b8-7630-49c3-9926-8be3a3ad69e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:49.581454 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a527b8-7630-49c3-9926-8be3a3ad69e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:49.581822 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a527b8-7630-49c3-9926-8be3a3ad69e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:49.582005 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a527b8-7630-49c3-9926-8be3a3ad69e3 admin admin] PATH_INFO: `/v3/projects/e4d5e435139e4983bcda6cbac220d75a/users/b5e7f450352b4bb2a98417654e134e3f/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:49.596151 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a527b8-7630-49c3-9926-8be3a3ad69e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4d5e435139e4983bcda6cbac220d75a, user_id=b5e7f450352b4bb2a98417654e134e3f, role_id=33b8a5a8d1d643f2a98f598e6ab0a1cf)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:49.598758 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a527b8-7630-49c3-9926-8be3a3ad69e3 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:49.605093 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-8a305119-8f20-4fea-80f9-047a5ad9f713 None None] MFA Rules not processed for user `385ca42ad77c4cafad79134fceb55779`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:49.609014 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-8a305119-8f20-4fea-80f9-047a5ad9f713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:49.670373 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1076/2145] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:49 2021] POST /identity/v3/auth/tokens => generated 3387 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:26:49.671173 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a305119-8f20-4fea-80f9-047a5ad9f713 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:49.682054 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a305119-8f20-4fea-80f9-047a5ad9f713 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:49.686613 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805adddb-8116-40c6-b80f-6ac4af477d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:49.687253 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805adddb-8116-40c6-b80f-6ac4af477d77 admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:49.687532 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805adddb-8116-40c6-b80f-6ac4af477d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:49.687802 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805adddb-8116-40c6-b80f-6ac4af477d77 admin admin] PATH_INFO: `/v3/users` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:49.688526 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805adddb-8116-40c6-b80f-6ac4af477d77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:49.691284 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805adddb-8116-40c6-b80f-6ac4af477d77 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:50.417466 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1070/2146] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:26:49 2021] PUT /identity/v3/projects/e4d5e435139e4983bcda6cbac220d75a/users/b5e7f450352b4bb2a98417654e134e3f/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf => generated 0 bytes in 960 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:26:50.418727 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a527b8-7630-49c3-9926-8be3a3ad69e3 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:50.476347 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a527b8-7630-49c3-9926-8be3a3ad69e3 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:50.481192 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15911e30-06a4-47c2-8874-3c40612d4f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:50.481837 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15911e30-06a4-47c2-8874-3c40612d4f5a admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:50.482112 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15911e30-06a4-47c2-8874-3c40612d4f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:50.482462 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15911e30-06a4-47c2-8874-3c40612d4f5a admin admin] PATH_INFO: `/v3/projects` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:50.483151 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15911e30-06a4-47c2-8874-3c40612d4f5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:50.485080 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15911e30-06a4-47c2-8874-3c40612d4f5a admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:50.550143 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1077/2147] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:26:49 2021] POST /identity/v3/users => generated 297 bytes in 879 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:26:50.551459 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805adddb-8116-40c6-b80f-6ac4af477d77 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:50.555137 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-805adddb-8116-40c6-b80f-6ac4af477d77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:50.604308 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1071/2148] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:26:50 2021] POST /identity/v3/projects => generated 375 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:26:50.605969 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4560af2c-e551-4792-b1d2-8d19fa8ef1a0 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:50.606241 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4560af2c-e551-4792-b1d2-8d19fa8ef1a0 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:50.606519 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4560af2c-e551-4792-b1d2-8d19fa8ef1a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:50.616368 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805adddb-8116-40c6-b80f-6ac4af477d77 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:50.641911 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-4560af2c-e551-4792-b1d2-8d19fa8ef1a0 None None] MFA Rules not processed for user `b5e7f450352b4bb2a98417654e134e3f`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:50.644524 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-4560af2c-e551-4792-b1d2-8d19fa8ef1a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:50.678759 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc7429-2628-40d1-a551-8177f6eeb8ca service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a3d3e5a5cfc4ac3afcece4e55f23552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:50.679410 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc7429-2628-40d1-a551-8177f6eeb8ca service glance] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:50.679690 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc7429-2628-40d1-a551-8177f6eeb8ca service glance] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:50.679963 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc7429-2628-40d1-a551-8177f6eeb8ca service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:50.714275 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1072/2149] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:50 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:26:50.715548 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4560af2c-e551-4792-b1d2-8d19fa8ef1a0 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:50.736757 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc7429-2628-40d1-a551-8177f6eeb8ca service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:50.738254 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc7429-2628-40d1-a551-8177f6eeb8ca service glance] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:50.747192 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1078/2150] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:26:50 2021] GET /identity/v3/auth/tokens => generated 3387 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:26:50.750175 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc7429-2628-40d1-a551-8177f6eeb8ca service glance] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:50.783576 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4560af2c-e551-4792-b1d2-8d19fa8ef1a0 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:50.788456 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af66d739-a9d2-43ff-adca-6feaadc66734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:50.789253 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af66d739-a9d2-43ff-adca-6feaadc66734 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:50.792001 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af66d739-a9d2-43ff-adca-6feaadc66734 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:50.792284 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af66d739-a9d2-43ff-adca-6feaadc66734 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:50.793283 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af66d739-a9d2-43ff-adca-6feaadc66734 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:50.794793 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af66d739-a9d2-43ff-adca-6feaadc66734 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:50.808098 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1073/2151] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:26:50 2021] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:26:50.808098 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af66d739-a9d2-43ff-adca-6feaadc66734 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:50.812958 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc7429-2628-40d1-a551-8177f6eeb8ca service glance] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:50.816687 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af66d739-a9d2-43ff-adca-6feaadc66734 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:50.819002 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f2a8c1-3684-42b8-878e-257ed4f6c878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:50.819671 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f2a8c1-3684-42b8-878e-257ed4f6c878 admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:50.819961 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f2a8c1-3684-42b8-878e-257ed4f6c878 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:50.820276 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f2a8c1-3684-42b8-878e-257ed4f6c878 admin admin] PATH_INFO: `/v3/users` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:50.821168 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f2a8c1-3684-42b8-878e-257ed4f6c878 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:50.821499 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c564b74-533f-4202-b617-7802951e542a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:50.822152 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c564b74-533f-4202-b617-7802951e542a admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:50.822437 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c564b74-533f-4202-b617-7802951e542a admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:50.822714 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c564b74-533f-4202-b617-7802951e542a admin admin] PATH_INFO: `/v3/projects` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:50.823054 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f2a8c1-3684-42b8-878e-257ed4f6c878 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:50.823425 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c564b74-533f-4202-b617-7802951e542a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:50.825356 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c564b74-533f-4202-b617-7802951e542a admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:50.974343 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1079/2152] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:26:50 2021] POST /identity/v3/users => generated 288 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:26:50.974343 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f2a8c1-3684-42b8-878e-257ed4f6c878 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:50.974343 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f2a8c1-3684-42b8-878e-257ed4f6c878 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:50.974343 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4090bf0-df89-414a-874e-28fe3c15a63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:50.974708 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4090bf0-df89-414a-874e-28fe3c15a63a admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:50.974708 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4090bf0-df89-414a-874e-28fe3c15a63a admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:50.974708 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4090bf0-df89-414a-874e-28fe3c15a63a admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:50.974708 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4090bf0-df89-414a-874e-28fe3c15a63a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:50.974708 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4090bf0-df89-414a-874e-28fe3c15a63a admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:50.981581 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1080/2153] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:26:50 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:26:50.981581 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4090bf0-df89-414a-874e-28fe3c15a63a admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:50.991686 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4090bf0-df89-414a-874e-28fe3c15a63a admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:50.996527 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec34250c-011d-47a8-9920-d9792c6a6454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:50.997175 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec34250c-011d-47a8-9920-d9792c6a6454 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:50.997578 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec34250c-011d-47a8-9920-d9792c6a6454 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:51.000067 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec34250c-011d-47a8-9920-d9792c6a6454 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:51.000793 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec34250c-011d-47a8-9920-d9792c6a6454 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:51.002404 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec34250c-011d-47a8-9920-d9792c6a6454 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:51.009869 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1074/2154] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:26:50 2021] POST /identity/v3/projects => generated 385 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:26:51.009869 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c564b74-533f-4202-b617-7802951e542a admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:51.013529 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1081/2155] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:26:50 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:26:51.021181 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec34250c-011d-47a8-9920-d9792c6a6454 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:51.026127 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec34250c-011d-47a8-9920-d9792c6a6454 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:51.083406 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c564b74-533f-4202-b617-7802951e542a admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:51.088842 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb4221b-e064-4b1f-bb0f-361b71cb94c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:51.089803 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb4221b-e064-4b1f-bb0f-361b71cb94c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:51.090011 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb4221b-e064-4b1f-bb0f-361b71cb94c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:51.090290 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb4221b-e064-4b1f-bb0f-361b71cb94c5 admin admin] PATH_INFO: `/v3/projects/7f9fb6543096402dbf4351b0e6639431/users/adee358392264c9cad3d3ee92c9aadd2/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:51.098965 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c8658-138b-4a59-a4be-0d0518c44b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:51.099617 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c8658-138b-4a59-a4be-0d0518c44b74 admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:51.099837 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c8658-138b-4a59-a4be-0d0518c44b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:51.100099 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c8658-138b-4a59-a4be-0d0518c44b74 admin admin] PATH_INFO: `/v3/users` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:51.100867 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7c8658-138b-4a59-a4be-0d0518c44b74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:51.102878 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7c8658-138b-4a59-a4be-0d0518c44b74 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:51.107030 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb4221b-e064-4b1f-bb0f-361b71cb94c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f9fb6543096402dbf4351b0e6639431, user_id=adee358392264c9cad3d3ee92c9aadd2, role_id=33b8a5a8d1d643f2a98f598e6ab0a1cf)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:51.109824 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb4221b-e064-4b1f-bb0f-361b71cb94c5 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:51.215726 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1075/2156] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:26:51 2021] PUT /identity/v3/projects/7f9fb6543096402dbf4351b0e6639431/users/adee358392264c9cad3d3ee92c9aadd2/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:26:51.220577 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb4221b-e064-4b1f-bb0f-361b71cb94c5 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:51.220898 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1082/2157] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:26:51 2021] POST /identity/v3/users => generated 299 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:26:51.220898 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c8658-138b-4a59-a4be-0d0518c44b74 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:51.231110 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c8658-138b-4a59-a4be-0d0518c44b74 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:51.280453 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb4221b-e064-4b1f-bb0f-361b71cb94c5 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:51.286125 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda2bf4c-40fd-47bb-8414-26e0a986f491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:51.286792 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda2bf4c-40fd-47bb-8414-26e0a986f491 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:51.287073 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda2bf4c-40fd-47bb-8414-26e0a986f491 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:51.287355 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda2bf4c-40fd-47bb-8414-26e0a986f491 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:51.288089 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda2bf4c-40fd-47bb-8414-26e0a986f491 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:51.289813 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda2bf4c-40fd-47bb-8414-26e0a986f491 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:51.300254 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9387ca47-a812-47e6-bfde-892d679ef1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:51.300254 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9387ca47-a812-47e6-bfde-892d679ef1c0 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:51.300254 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9387ca47-a812-47e6-bfde-892d679ef1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:51.300254 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9387ca47-a812-47e6-bfde-892d679ef1c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:51.300697 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9387ca47-a812-47e6-bfde-892d679ef1c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:51.300697 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9387ca47-a812-47e6-bfde-892d679ef1c0 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:51.301092 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1076/2158] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:26:51 2021] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:26:51.302893 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9db603-3168-43b7-a725-1a192967470a None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:51.303178 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9db603-3168-43b7-a725-1a192967470a None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:51.303453 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9db603-3168-43b7-a725-1a192967470a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:51.312301 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1083/2159] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:26:51 2021] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:26:51.312301 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9387ca47-a812-47e6-bfde-892d679ef1c0 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:51.320761 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9387ca47-a812-47e6-bfde-892d679ef1c0 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:51.322034 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-8c9db603-3168-43b7-a725-1a192967470a None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:51.323226 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-8c9db603-3168-43b7-a725-1a192967470a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:51.325696 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2405132f-9280-47c2-b7e1-3e833cf7fdec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:51.328492 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2405132f-9280-47c2-b7e1-3e833cf7fdec admin admin] REQUEST_METHOD: `PUT` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:51.328492 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2405132f-9280-47c2-b7e1-3e833cf7fdec admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:51.328492 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2405132f-9280-47c2-b7e1-3e833cf7fdec admin admin] PATH_INFO: `/v3/projects/46eadf3e60ed40499127f4e85e1150d5/users/b07cc3785d7d4d3095c3d03f1705bc71/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:51.331737 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1077/2160] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:26:51.333579 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9db603-3168-43b7-a725-1a192967470a None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:51.344017 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2405132f-9280-47c2-b7e1-3e833cf7fdec admin admin] RBAC: Authorizing `identity:create_grant(project_id=46eadf3e60ed40499127f4e85e1150d5, user_id=b07cc3785d7d4d3095c3d03f1705bc71, role_id=33b8a5a8d1d643f2a98f598e6ab0a1cf)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:51.347121 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2405132f-9280-47c2-b7e1-3e833cf7fdec admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:51.347701 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9db603-3168-43b7-a725-1a192967470a None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:51.353430 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea5bdc3-6322-45cc-95c5-dee9478d15f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:51.368040 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea5bdc3-6322-45cc-95c5-dee9478d15f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:51.368040 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea5bdc3-6322-45cc-95c5-dee9478d15f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:51.368040 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea5bdc3-6322-45cc-95c5-dee9478d15f6 admin admin] PATH_INFO: `/v3/projects/c7f48ae02b684d19aea04b0d3b595907/users/d0f78ab4315248c682f1ff402b6e0933/roles/6c54f239944d46e3b027ccce97eb8b49` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:51.373192 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea5bdc3-6322-45cc-95c5-dee9478d15f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7f48ae02b684d19aea04b0d3b595907, user_id=d0f78ab4315248c682f1ff402b6e0933, role_id=6c54f239944d46e3b027ccce97eb8b49)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:51.376114 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea5bdc3-6322-45cc-95c5-dee9478d15f6 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:51.451361 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1084/2161] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:26:51 2021] PUT /identity/v3/projects/46eadf3e60ed40499127f4e85e1150d5/users/b07cc3785d7d4d3095c3d03f1705bc71/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:26:51.452349 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2405132f-9280-47c2-b7e1-3e833cf7fdec admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:51.454003 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-2405132f-9280-47c2-b7e1-3e833cf7fdec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:51.491937 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1078/2162] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:26:51 2021] PUT /identity/v3/projects/c7f48ae02b684d19aea04b0d3b595907/users/d0f78ab4315248c682f1ff402b6e0933/roles/6c54f239944d46e3b027ccce97eb8b49 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:26:51.494997 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3846177-0bd0-43e2-ae1d-c983afb27af2 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:51.494997 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3846177-0bd0-43e2-ae1d-c983afb27af2 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:51.494997 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3846177-0bd0-43e2-ae1d-c983afb27af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:51.525889 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2405132f-9280-47c2-b7e1-3e833cf7fdec admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:51.529209 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-b3846177-0bd0-43e2-ae1d-c983afb27af2 None None] MFA Rules not processed for user `b07cc3785d7d4d3095c3d03f1705bc71`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:51.535102 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-b3846177-0bd0-43e2-ae1d-c983afb27af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:51.573602 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679baf9b-6bbb-4927-9800-f6eb0134fe0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:51.574254 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679baf9b-6bbb-4927-9800-f6eb0134fe0e service neutron] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:51.574540 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679baf9b-6bbb-4927-9800-f6eb0134fe0e service neutron] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:51.574815 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679baf9b-6bbb-4927-9800-f6eb0134fe0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:51.595106 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1079/2163] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:51 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:26:51.598132 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3846177-0bd0-43e2-ae1d-c983afb27af2 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:51.646303 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679baf9b-6bbb-4927-9800-f6eb0134fe0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:51.647793 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679baf9b-6bbb-4927-9800-f6eb0134fe0e service neutron] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:51.657825 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1085/2164] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:26:51 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:26:51.670167 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3846177-0bd0-43e2-ae1d-c983afb27af2 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:51.675425 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44552db-cbaa-419c-88cc-6d9a0920377d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:51.676094 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44552db-cbaa-419c-88cc-6d9a0920377d admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:51.676377 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44552db-cbaa-419c-88cc-6d9a0920377d admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:51.676685 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44552db-cbaa-419c-88cc-6d9a0920377d admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:51.677430 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44552db-cbaa-419c-88cc-6d9a0920377d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:51.679015 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44552db-cbaa-419c-88cc-6d9a0920377d admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:51.693165 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1080/2165] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:26:51 2021] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:26:51.695809 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679baf9b-6bbb-4927-9800-f6eb0134fe0e service neutron] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:51.704176 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679baf9b-6bbb-4927-9800-f6eb0134fe0e service neutron] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:51.708999 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d64f65-3b65-47c7-8606-065b11f0ecb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:51.709877 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d64f65-3b65-47c7-8606-065b11f0ecb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:51.710154 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d64f65-3b65-47c7-8606-065b11f0ecb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:51.710424 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d64f65-3b65-47c7-8606-065b11f0ecb6 admin admin] PATH_INFO: `/v3/projects/c7f48ae02b684d19aea04b0d3b595907/users/d0f78ab4315248c682f1ff402b6e0933/roles/6c54f239944d46e3b027ccce97eb8b49` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:51.712514 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d64f65-3b65-47c7-8606-065b11f0ecb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7f48ae02b684d19aea04b0d3b595907, user_id=d0f78ab4315248c682f1ff402b6e0933, role_id=6c54f239944d46e3b027ccce97eb8b49)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:51.715147 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d64f65-3b65-47c7-8606-065b11f0ecb6 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:51.725368 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1086/2166] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:26:51 2021] PUT /identity/v3/projects/c7f48ae02b684d19aea04b0d3b595907/users/d0f78ab4315248c682f1ff402b6e0933/roles/6c54f239944d46e3b027ccce97eb8b49 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:26:51.737578 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b20700-a256-4a7c-8491-9b56fdd49e0a None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:51.737578 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b20700-a256-4a7c-8491-9b56fdd49e0a None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:51.737838 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b20700-a256-4a7c-8491-9b56fdd49e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:51.745269 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d64f65-3b65-47c7-8606-065b11f0ecb6 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:51.746945 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-50d64f65-3b65-47c7-8606-065b11f0ecb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:51.766579 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-58b20700-a256-4a7c-8491-9b56fdd49e0a None None] MFA Rules not processed for user `d0f78ab4315248c682f1ff402b6e0933`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:51.767774 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-58b20700-a256-4a7c-8491-9b56fdd49e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:51.809477 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d64f65-3b65-47c7-8606-065b11f0ecb6 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:51.814612 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b01b9e-113e-4b2f-8dd2-804b662d64ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6966ce0774f4437a9b688494e9d0574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:51.816207 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b01b9e-113e-4b2f-8dd2-804b662d64ac service cinder] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:51.816326 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b01b9e-113e-4b2f-8dd2-804b662d64ac service cinder] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:51.816855 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b01b9e-113e-4b2f-8dd2-804b662d64ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:51.868844 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1081/2167] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:51 2021] POST /identity/v3/auth/tokens => generated 3472 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:26:51.902392 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b01b9e-113e-4b2f-8dd2-804b662d64ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:51.904187 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b01b9e-113e-4b2f-8dd2-804b662d64ac service cinder] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:51.915507 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1087/2168] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:26:51 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:26:52.242585 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b20700-a256-4a7c-8491-9b56fdd49e0a None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:52.244428 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-58b20700-a256-4a7c-8491-9b56fdd49e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:52.258212 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b20700-a256-4a7c-8491-9b56fdd49e0a None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:52.262098 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849f5ddb-ecb8-475e-9be8-d877ebcb8c8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6966ce0774f4437a9b688494e9d0574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:52.262760 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f5ddb-ecb8-475e-9be8-d877ebcb8c8e service cinder] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:52.263038 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f5ddb-ecb8-475e-9be8-d877ebcb8c8e service cinder] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:52.263346 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f5ddb-ecb8-475e-9be8-d877ebcb8c8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:52.265112 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-849f5ddb-ecb8-475e-9be8-d877ebcb8c8e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:52.329186 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849f5ddb-ecb8-475e-9be8-d877ebcb8c8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:52.331472 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849f5ddb-ecb8-475e-9be8-d877ebcb8c8e service cinder] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:52.341415 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1082/2169] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:26:52 2021] GET /identity/v3/auth/tokens => generated 3401 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 18:26:53.357188 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b01b9e-113e-4b2f-8dd2-804b662d64ac service cinder] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:53.366195 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b01b9e-113e-4b2f-8dd2-804b662d64ac service cinder] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:53.378328 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ad764-b97e-4795-b23a-fdfd732aa3b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6966ce0774f4437a9b688494e9d0574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:53.378328 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ad764-b97e-4795-b23a-fdfd732aa3b8 service cinder] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:53.378328 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ad764-b97e-4795-b23a-fdfd732aa3b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:53.378328 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ad764-b97e-4795-b23a-fdfd732aa3b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:53.379192 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-0a1ad764-b97e-4795-b23a-fdfd732aa3b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:53.464936 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1ad764-b97e-4795-b23a-fdfd732aa3b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:53.466568 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1ad764-b97e-4795-b23a-fdfd732aa3b8 service cinder] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:53.481736 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1088/2170] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:26:53 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:26:56.211799 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849f5ddb-ecb8-475e-9be8-d877ebcb8c8e service cinder] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:56.223738 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849f5ddb-ecb8-475e-9be8-d877ebcb8c8e service cinder] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:56.228747 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df149f59-166c-40e2-b334-290bcb957861 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6966ce0774f4437a9b688494e9d0574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:56.229644 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df149f59-166c-40e2-b334-290bcb957861 service cinder] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:56.230369 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df149f59-166c-40e2-b334-290bcb957861 service cinder] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:56.230755 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df149f59-166c-40e2-b334-290bcb957861 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:56.233329 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-df149f59-166c-40e2-b334-290bcb957861 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:56.266590 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ad764-b97e-4795-b23a-fdfd732aa3b8 service cinder] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:56.278817 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ad764-b97e-4795-b23a-fdfd732aa3b8 service cinder] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:56.286444 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d607b98c-8533-4c47-846d-be9bf77dad40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6966ce0774f4437a9b688494e9d0574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:56.287205 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d607b98c-8533-4c47-846d-be9bf77dad40 service cinder] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:56.287566 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d607b98c-8533-4c47-846d-be9bf77dad40 service cinder] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:56.287915 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d607b98c-8533-4c47-846d-be9bf77dad40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:56.317974 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df149f59-166c-40e2-b334-290bcb957861 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:56.319676 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df149f59-166c-40e2-b334-290bcb957861 service cinder] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:56.347262 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1083/2171] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:26:56 2021] GET /identity/v3/auth/tokens => generated 3462 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:26:56.385773 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d607b98c-8533-4c47-846d-be9bf77dad40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:56.388247 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d607b98c-8533-4c47-846d-be9bf77dad40 service cinder] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:56.404209 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1089/2172] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:26:56 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:26:57.923935 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c905c3-954a-4b40-a868-c80967b40ea2 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:57.925135 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c905c3-954a-4b40-a868-c80967b40ea2 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:57.925135 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c905c3-954a-4b40-a868-c80967b40ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:57.953982 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-c2c905c3-954a-4b40-a868-c80967b40ea2 None None] MFA Rules not processed for user `adee358392264c9cad3d3ee92c9aadd2`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:57.955423 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-c2c905c3-954a-4b40-a868-c80967b40ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:58.025618 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1084/2173] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:57 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:26:58.036375 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea5964-4608-48e2-9aa2-d0747ec627a3 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:58.037026 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea5964-4608-48e2-9aa2-d0747ec627a3 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:58.037026 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea5964-4608-48e2-9aa2-d0747ec627a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:58.055344 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-f9ea5964-4608-48e2-9aa2-d0747ec627a3 None None] MFA Rules not processed for user `adee358392264c9cad3d3ee92c9aadd2`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:26:58.056602 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-f9ea5964-4608-48e2-9aa2-d0747ec627a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:26:58.064354 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1090/2174] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:26:58 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:26:59.825593 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c905c3-954a-4b40-a868-c80967b40ea2 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:26:59.836454 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c905c3-954a-4b40-a868-c80967b40ea2 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:26:59.846248 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377fd6d6-b773-47a5-882f-251e18ec5572 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6966ce0774f4437a9b688494e9d0574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:26:59.846925 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377fd6d6-b773-47a5-882f-251e18ec5572 service cinder] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:26:59.847422 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377fd6d6-b773-47a5-882f-251e18ec5572 service cinder] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:26:59.847702 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377fd6d6-b773-47a5-882f-251e18ec5572 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:26:59.857818 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377fd6d6-b773-47a5-882f-251e18ec5572 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:26:59.859260 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377fd6d6-b773-47a5-882f-251e18ec5572 service cinder] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:26:59.869718 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1085/2175] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:26:59 2021] GET /identity/v3/auth/tokens => generated 3472 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:27:01.630902 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ea5964-4608-48e2-9aa2-d0747ec627a3 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:27:01.632363 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-f9ea5964-4608-48e2-9aa2-d0747ec627a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:27:01.706526 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ea5964-4608-48e2-9aa2-d0747ec627a3 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:27:01.715735 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930924ad-7e57-4d8f-8373-8ea89c20eee1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3417097a280b499086b36df9a2548239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:27:01.716553 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930924ad-7e57-4d8f-8373-8ea89c20eee1 service nova] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:01.716933 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930924ad-7e57-4d8f-8373-8ea89c20eee1 service nova] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:01.717262 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930924ad-7e57-4d8f-8373-8ea89c20eee1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:01.727432 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930924ad-7e57-4d8f-8373-8ea89c20eee1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:27:01.729069 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930924ad-7e57-4d8f-8373-8ea89c20eee1 service nova] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:27:01.737878 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1091/2176] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:27:01 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:27:02.492180 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae5ca71-8c93-4754-af0b-7009b91e2f6d None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:02.493176 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae5ca71-8c93-4754-af0b-7009b91e2f6d None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:02.493727 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae5ca71-8c93-4754-af0b-7009b91e2f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:02.510871 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930924ad-7e57-4d8f-8373-8ea89c20eee1 service nova] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:27:02.512834 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-930924ad-7e57-4d8f-8373-8ea89c20eee1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:27:02.524294 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-1ae5ca71-8c93-4754-af0b-7009b91e2f6d None None] MFA Rules not processed for user `adee358392264c9cad3d3ee92c9aadd2`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:27:02.526060 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-1ae5ca71-8c93-4754-af0b-7009b91e2f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:27:02.537423 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1086/2177] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:27:02 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:27:02.598080 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930924ad-7e57-4d8f-8373-8ea89c20eee1 service nova] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:27:02.605781 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de42ad8-26a0-4603-8f4f-b0a3cafaadf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:27:02.610728 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de42ad8-26a0-4603-8f4f-b0a3cafaadf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:02.610728 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de42ad8-26a0-4603-8f4f-b0a3cafaadf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:02.610728 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de42ad8-26a0-4603-8f4f-b0a3cafaadf1 admin admin] PATH_INFO: `/v3/users/78a94a29ad9142988e26f90d99bd7ce5` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:02.610728 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de42ad8-26a0-4603-8f4f-b0a3cafaadf1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78a94a29ad9142988e26f90d99bd7ce5)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:27:02.612710 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de42ad8-26a0-4603-8f4f-b0a3cafaadf1 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:27:02.983734 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-6de42ad8-26a0-4603-8f4f-b0a3cafaadf1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78a94a29ad9142988e26f90d99bd7ce5'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:02.985313 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-6de42ad8-26a0-4603-8f4f-b0a3cafaadf1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78a94a29ad9142988e26f90d99bd7ce5'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:03.017062 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-6de42ad8-26a0-4603-8f4f-b0a3cafaadf1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78a94a29ad9142988e26f90d99bd7ce5'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:03.019656 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-6de42ad8-26a0-4603-8f4f-b0a3cafaadf1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78a94a29ad9142988e26f90d99bd7ce5'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:03.032864 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-6de42ad8-26a0-4603-8f4f-b0a3cafaadf1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78a94a29ad9142988e26f90d99bd7ce5'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:03.166795 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1092/2178] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:27:02 2021] DELETE /identity/v3/users/78a94a29ad9142988e26f90d99bd7ce5 => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:27:03.172078 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138897b6-d954-47ab-af48-da2f15b71332 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:03.172973 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138897b6-d954-47ab-af48-da2f15b71332 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:03.173423 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138897b6-d954-47ab-af48-da2f15b71332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:03.197914 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-138897b6-d954-47ab-af48-da2f15b71332 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:27:03.200042 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-138897b6-d954-47ab-af48-da2f15b71332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:27:03.276783 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1087/2179] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:27:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:27:03.288437 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de42ad8-26a0-4603-8f4f-b0a3cafaadf1 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:27:03.290629 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-6de42ad8-26a0-4603-8f4f-b0a3cafaadf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:27:03.412731 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de42ad8-26a0-4603-8f4f-b0a3cafaadf1 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:27:03.416982 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e378fd9d-2545-40ff-9679-ccc9cbcc00d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:27:03.417805 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e378fd9d-2545-40ff-9679-ccc9cbcc00d7 service neutron] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:03.418160 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e378fd9d-2545-40ff-9679-ccc9cbcc00d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:03.418716 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e378fd9d-2545-40ff-9679-ccc9cbcc00d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:03.441898 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e378fd9d-2545-40ff-9679-ccc9cbcc00d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:27:03.444345 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e378fd9d-2545-40ff-9679-ccc9cbcc00d7 service neutron] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:27:03.469435 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1093/2180] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:27:03 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:27:04.036942 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138897b6-d954-47ab-af48-da2f15b71332 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:27:04.039883 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-138897b6-d954-47ab-af48-da2f15b71332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:27:04.065152 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138897b6-d954-47ab-af48-da2f15b71332 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:27:04.070968 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d22b05-1889-4889-8270-b3a684a4f0ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:27:04.072073 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d22b05-1889-4889-8270-b3a684a4f0ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:04.072252 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d22b05-1889-4889-8270-b3a684a4f0ea admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:04.072748 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d22b05-1889-4889-8270-b3a684a4f0ea admin admin] PATH_INFO: `/v3/projects/f1d89399a662419abd9e68a1e4bbeb6f` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:04.082746 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d22b05-1889-4889-8270-b3a684a4f0ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1d89399a662419abd9e68a1e4bbeb6f)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:27:04.082746 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d22b05-1889-4889-8270-b3a684a4f0ea admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:27:04.241761 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-27d22b05-1889-4889-8270-b3a684a4f0ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1d89399a662419abd9e68a1e4bbeb6f', 'request_id': 'req-27d22b05-1889-4889-8270-b3a684a4f0ea'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:04.324641 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-27d22b05-1889-4889-8270-b3a684a4f0ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1d89399a662419abd9e68a1e4bbeb6f', 'request_id': 'req-27d22b05-1889-4889-8270-b3a684a4f0ea'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:04.332581 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-27d22b05-1889-4889-8270-b3a684a4f0ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1d89399a662419abd9e68a1e4bbeb6f', 'request_id': 'req-27d22b05-1889-4889-8270-b3a684a4f0ea'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:04.342806 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-27d22b05-1889-4889-8270-b3a684a4f0ea admin admin] The token cache is being invalidate because project f1d89399a662419abd9e68a1e4bbeb6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:27:04.343092 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-27d22b05-1889-4889-8270-b3a684a4f0ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:04.343743 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-27d22b05-1889-4889-8270-b3a684a4f0ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:04.345323 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1088/2181] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:27:04 2021] DELETE /identity/v3/projects/f1d89399a662419abd9e68a1e4bbeb6f => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:27:04.354637 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e378fd9d-2545-40ff-9679-ccc9cbcc00d7 service neutron] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:27:04.361549 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e378fd9d-2545-40ff-9679-ccc9cbcc00d7 service neutron] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:27:04.416094 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf7ed28-a4b2-4edf-816d-0fedfc6c384a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:27:04.416995 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7ed28-a4b2-4edf-816d-0fedfc6c384a admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:04.417273 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7ed28-a4b2-4edf-816d-0fedfc6c384a admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:04.417544 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7ed28-a4b2-4edf-816d-0fedfc6c384a admin admin] PATH_INFO: `/v3/users/e55e62242d10405d920c5ce8e30b24a7` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:04.418739 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf7ed28-a4b2-4edf-816d-0fedfc6c384a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e55e62242d10405d920c5ce8e30b24a7)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:27:04.420743 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf7ed28-a4b2-4edf-816d-0fedfc6c384a admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:27:04.590739 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-2cf7ed28-a4b2-4edf-816d-0fedfc6c384a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e55e62242d10405d920c5ce8e30b24a7'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:04.591334 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-2cf7ed28-a4b2-4edf-816d-0fedfc6c384a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e55e62242d10405d920c5ce8e30b24a7'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:04.603363 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-2cf7ed28-a4b2-4edf-816d-0fedfc6c384a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e55e62242d10405d920c5ce8e30b24a7'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:04.604031 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-2cf7ed28-a4b2-4edf-816d-0fedfc6c384a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e55e62242d10405d920c5ce8e30b24a7'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:04.610568 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-2cf7ed28-a4b2-4edf-816d-0fedfc6c384a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e55e62242d10405d920c5ce8e30b24a7'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:04.657760 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1094/2182] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:27:04 2021] DELETE /identity/v3/users/e55e62242d10405d920c5ce8e30b24a7 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:27:05.121278 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d22b05-1889-4889-8270-b3a684a4f0ea admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:27:05.122915 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-27d22b05-1889-4889-8270-b3a684a4f0ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:27:05.137018 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d22b05-1889-4889-8270-b3a684a4f0ea admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:27:05.193606 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6b002a-291d-41bb-a81c-ab5ae4a8c0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:27:05.194461 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b002a-291d-41bb-a81c-ab5ae4a8c0b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:05.194734 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b002a-291d-41bb-a81c-ab5ae4a8c0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:05.195006 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b002a-291d-41bb-a81c-ab5ae4a8c0b3 admin admin] PATH_INFO: `/v3/projects/f77a2a2e456b441486f41e62c8bc3310` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:05.196173 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6b002a-291d-41bb-a81c-ab5ae4a8c0b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f77a2a2e456b441486f41e62c8bc3310)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:27:05.198123 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6b002a-291d-41bb-a81c-ab5ae4a8c0b3 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:27:05.320575 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-7d6b002a-291d-41bb-a81c-ab5ae4a8c0b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f77a2a2e456b441486f41e62c8bc3310', 'request_id': 'req-7d6b002a-291d-41bb-a81c-ab5ae4a8c0b3'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:05.468019 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-7d6b002a-291d-41bb-a81c-ab5ae4a8c0b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f77a2a2e456b441486f41e62c8bc3310', 'request_id': 'req-7d6b002a-291d-41bb-a81c-ab5ae4a8c0b3'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:05.476985 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-7d6b002a-291d-41bb-a81c-ab5ae4a8c0b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f77a2a2e456b441486f41e62c8bc3310', 'request_id': 'req-7d6b002a-291d-41bb-a81c-ab5ae4a8c0b3'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:05.487672 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-7d6b002a-291d-41bb-a81c-ab5ae4a8c0b3 admin admin] The token cache is being invalidate because project f77a2a2e456b441486f41e62c8bc3310 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:27:05.487962 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-7d6b002a-291d-41bb-a81c-ab5ae4a8c0b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:05.488671 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-7d6b002a-291d-41bb-a81c-ab5ae4a8c0b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:05.490479 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1089/2183] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:27:05 2021] DELETE /identity/v3/projects/f77a2a2e456b441486f41e62c8bc3310 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:27:05.497460 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763074d-0700-4f6f-85e5-2c75f2b833d0 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:05.497948 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763074d-0700-4f6f-85e5-2c75f2b833d0 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:05.498044 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763074d-0700-4f6f-85e5-2c75f2b833d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:05.517224 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-4763074d-0700-4f6f-85e5-2c75f2b833d0 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:27:05.519069 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-4763074d-0700-4f6f-85e5-2c75f2b833d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:27:05.576033 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1095/2184] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:27:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:27:05.584899 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763350b-31d5-4955-a3e0-62084aa3fbc7 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:05.585191 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763350b-31d5-4955-a3e0-62084aa3fbc7 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:05.585469 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763350b-31d5-4955-a3e0-62084aa3fbc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:05.603404 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-4763350b-31d5-4955-a3e0-62084aa3fbc7 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:27:05.604629 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-4763350b-31d5-4955-a3e0-62084aa3fbc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:27:05.612470 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1090/2185] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:27:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:27:05.616925 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4763074d-0700-4f6f-85e5-2c75f2b833d0 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:27:05.628133 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4763074d-0700-4f6f-85e5-2c75f2b833d0 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:27:05.632937 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee16ca0-0f13-427e-9fd1-40862afa64dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:27:05.633632 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee16ca0-0f13-427e-9fd1-40862afa64dc admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:05.633946 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee16ca0-0f13-427e-9fd1-40862afa64dc admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:05.634222 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee16ca0-0f13-427e-9fd1-40862afa64dc admin admin] PATH_INFO: `/v3/domains` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:05.634966 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee16ca0-0f13-427e-9fd1-40862afa64dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:27:05.635272 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee16ca0-0f13-427e-9fd1-40862afa64dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:27:05.636914 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee16ca0-0f13-427e-9fd1-40862afa64dc admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:27:05.649580 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1096/2186] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 12 18:27:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:27:05.655593 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4763350b-31d5-4955-a3e0-62084aa3fbc7 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:27:05.667143 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4763350b-31d5-4955-a3e0-62084aa3fbc7 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:27:05.672318 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795e0310-d83d-410f-8d8d-e05718b95d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:27:05.673046 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e0310-d83d-410f-8d8d-e05718b95d7d admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:05.673384 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e0310-d83d-410f-8d8d-e05718b95d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:05.673660 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e0310-d83d-410f-8d8d-e05718b95d7d admin admin] PATH_INFO: `/v3/projects` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:05.675387 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795e0310-d83d-410f-8d8d-e05718b95d7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:27:05.677498 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795e0310-d83d-410f-8d8d-e05718b95d7d admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:27:05.778366 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1091/2187] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:27:05 2021] POST /identity/v3/projects => generated 373 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:27:05.782506 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee16ca0-0f13-427e-9fd1-40862afa64dc admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:27:05.792295 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee16ca0-0f13-427e-9fd1-40862afa64dc admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:27:05.850892 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5983918-6591-4999-bad2-d3c13531da47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:27:05.851680 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5983918-6591-4999-bad2-d3c13531da47 admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:05.851968 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5983918-6591-4999-bad2-d3c13531da47 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:05.852243 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5983918-6591-4999-bad2-d3c13531da47 admin admin] PATH_INFO: `/v3/users` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:05.853189 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5983918-6591-4999-bad2-d3c13531da47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:27:05.855464 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5983918-6591-4999-bad2-d3c13531da47 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:27:06.125980 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1097/2188] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:27:05 2021] POST /identity/v3/users => generated 287 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:27:06.130917 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795e0310-d83d-410f-8d8d-e05718b95d7d admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:27:06.142930 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795e0310-d83d-410f-8d8d-e05718b95d7d admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:27:06.148282 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9bad06-aab5-4a41-86d4-e7a8458a82f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:27:06.149157 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9bad06-aab5-4a41-86d4-e7a8458a82f5 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:06.149439 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9bad06-aab5-4a41-86d4-e7a8458a82f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:06.149799 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9bad06-aab5-4a41-86d4-e7a8458a82f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:06.150990 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9bad06-aab5-4a41-86d4-e7a8458a82f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:27:06.153420 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9bad06-aab5-4a41-86d4-e7a8458a82f5 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:27:06.165565 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1092/2189] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:27:06 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:27:06.169468 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5983918-6591-4999-bad2-d3c13531da47 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:27:06.179954 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5983918-6591-4999-bad2-d3c13531da47 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:27:06.184844 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0358cae6-17fe-4ee4-9610-08f06036b24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:27:06.185489 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0358cae6-17fe-4ee4-9610-08f06036b24c admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:06.185764 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0358cae6-17fe-4ee4-9610-08f06036b24c admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:06.186100 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0358cae6-17fe-4ee4-9610-08f06036b24c admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:06.186796 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0358cae6-17fe-4ee4-9610-08f06036b24c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:27:06.188342 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0358cae6-17fe-4ee4-9610-08f06036b24c admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:27:06.199037 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1098/2190] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:27:06 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:27:06.203107 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9bad06-aab5-4a41-86d4-e7a8458a82f5 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:27:06.212793 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9bad06-aab5-4a41-86d4-e7a8458a82f5 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:27:06.217407 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8c6951-6b00-4576-9830-ec315e795979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:27:06.218297 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c6951-6b00-4576-9830-ec315e795979 admin admin] REQUEST_METHOD: `PUT` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:06.218572 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c6951-6b00-4576-9830-ec315e795979 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:06.218844 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c6951-6b00-4576-9830-ec315e795979 admin admin] PATH_INFO: `/v3/projects/ec6b4ea245ba455cb3a788ef7907c669/users/ac7aaed40f314bf397c414162affa8ad/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:06.234519 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8c6951-6b00-4576-9830-ec315e795979 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec6b4ea245ba455cb3a788ef7907c669, user_id=ac7aaed40f314bf397c414162affa8ad, role_id=33b8a5a8d1d643f2a98f598e6ab0a1cf)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:27:06.238387 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8c6951-6b00-4576-9830-ec315e795979 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:27:06.310863 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1093/2191] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:27:06 2021] PUT /identity/v3/projects/ec6b4ea245ba455cb3a788ef7907c669/users/ac7aaed40f314bf397c414162affa8ad/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 18:27:06.323149 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ccb066-1296-4fac-91be-8ecd0bc0e3ec None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:06.323617 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ccb066-1296-4fac-91be-8ecd0bc0e3ec None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:06.324144 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ccb066-1296-4fac-91be-8ecd0bc0e3ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:06.351248 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-d6ccb066-1296-4fac-91be-8ecd0bc0e3ec None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:27:06.353249 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-d6ccb066-1296-4fac-91be-8ecd0bc0e3ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:27:06.446139 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1099/2192] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:27:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:27:06.456840 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8c6951-6b00-4576-9830-ec315e795979 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:27:06.458757 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-1e8c6951-6b00-4576-9830-ec315e795979 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:27:06.513123 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8c6951-6b00-4576-9830-ec315e795979 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:27:06.516828 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c2c48b-aa19-4d23-befb-93c1e54928ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:27:06.517469 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c2c48b-aa19-4d23-befb-93c1e54928ea service neutron] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:06.518316 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c2c48b-aa19-4d23-befb-93c1e54928ea service neutron] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:06.518598 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c2c48b-aa19-4d23-befb-93c1e54928ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:06.528007 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c2c48b-aa19-4d23-befb-93c1e54928ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:27:06.529497 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c2c48b-aa19-4d23-befb-93c1e54928ea service neutron] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:27:06.539768 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1094/2193] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:27:06 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:27:07.927266 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a58e289-1e61-4faa-98f8-e33d62f6ff86 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:07.927760 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a58e289-1e61-4faa-98f8-e33d62f6ff86 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:07.927865 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a58e289-1e61-4faa-98f8-e33d62f6ff86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:07.954864 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-4a58e289-1e61-4faa-98f8-e33d62f6ff86 None None] MFA Rules not processed for user `ac7aaed40f314bf397c414162affa8ad`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:27:07.956076 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-4a58e289-1e61-4faa-98f8-e33d62f6ff86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:27:08.019098 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1100/2194] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:27:07 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:27:08.030148 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c2c48b-aa19-4d23-befb-93c1e54928ea service neutron] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:27:08.031706 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-24c2c48b-aa19-4d23-befb-93c1e54928ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:27:08.099480 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c2c48b-aa19-4d23-befb-93c1e54928ea service neutron] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:27:08.103205 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fd682d-23c2-4ed6-a4e8-0e3637fd99ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6966ce0774f4437a9b688494e9d0574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:27:08.104209 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd682d-23c2-4ed6-a4e8-0e3637fd99ad service cinder] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:08.104209 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd682d-23c2-4ed6-a4e8-0e3637fd99ad service cinder] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:08.104442 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd682d-23c2-4ed6-a4e8-0e3637fd99ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:08.113583 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fd682d-23c2-4ed6-a4e8-0e3637fd99ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:27:08.115022 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fd682d-23c2-4ed6-a4e8-0e3637fd99ad service cinder] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:27:08.124047 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1095/2195] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:27:08 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:27:11.903702 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a58e289-1e61-4faa-98f8-e33d62f6ff86 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:27:11.905373 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-4a58e289-1e61-4faa-98f8-e33d62f6ff86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:27:11.923265 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a58e289-1e61-4faa-98f8-e33d62f6ff86 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:27:11.932270 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e514b5c0-bcb7-4deb-a990-8bbb306f653a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:27:11.933455 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e514b5c0-bcb7-4deb-a990-8bbb306f653a admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:11.933955 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e514b5c0-bcb7-4deb-a990-8bbb306f653a admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:11.934453 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e514b5c0-bcb7-4deb-a990-8bbb306f653a admin admin] PATH_INFO: `/v3/users/959dc719d24e4f74827c4eef73d65dd4` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:11.936301 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e514b5c0-bcb7-4deb-a990-8bbb306f653a admin admin] RBAC: Authorizing `identity:delete_user(user_id=959dc719d24e4f74827c4eef73d65dd4)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:27:11.938811 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e514b5c0-bcb7-4deb-a990-8bbb306f653a admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:27:11.974041 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68015a33-f3ec-47f3-8d04-205d7faa35b2 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:11.975587 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68015a33-f3ec-47f3-8d04-205d7faa35b2 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:11.975587 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68015a33-f3ec-47f3-8d04-205d7faa35b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:12.009735 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-68015a33-f3ec-47f3-8d04-205d7faa35b2 None None] MFA Rules not processed for user `ac7aaed40f314bf397c414162affa8ad`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:27:12.011199 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-68015a33-f3ec-47f3-8d04-205d7faa35b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:27:12.028440 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1096/2196] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:27:11 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:27:12.179674 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-e514b5c0-bcb7-4deb-a990-8bbb306f653a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '959dc719d24e4f74827c4eef73d65dd4'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:12.180636 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-e514b5c0-bcb7-4deb-a990-8bbb306f653a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '959dc719d24e4f74827c4eef73d65dd4'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:12.195953 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-e514b5c0-bcb7-4deb-a990-8bbb306f653a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '959dc719d24e4f74827c4eef73d65dd4'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:12.196948 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-e514b5c0-bcb7-4deb-a990-8bbb306f653a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '959dc719d24e4f74827c4eef73d65dd4'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:12.204568 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-e514b5c0-bcb7-4deb-a990-8bbb306f653a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '959dc719d24e4f74827c4eef73d65dd4'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:12.280912 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1101/2197] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:27:11 2021] DELETE /identity/v3/users/959dc719d24e4f74827c4eef73d65dd4 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:27:12.285864 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c376b90-efd5-42c8-beac-225c17c370e0 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:12.286156 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c376b90-efd5-42c8-beac-225c17c370e0 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:12.286436 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c376b90-efd5-42c8-beac-225c17c370e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:12.304826 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-8c376b90-efd5-42c8-beac-225c17c370e0 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:27:12.306111 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-8c376b90-efd5-42c8-beac-225c17c370e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:27:12.375517 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1097/2198] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:27:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:27:12.398297 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e514b5c0-bcb7-4deb-a990-8bbb306f653a admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:27:12.399866 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-e514b5c0-bcb7-4deb-a990-8bbb306f653a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:27:12.493500 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e514b5c0-bcb7-4deb-a990-8bbb306f653a admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:27:12.519523 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70637b64-9351-4282-b5e6-4867c2693427 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:27:12.520218 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70637b64-9351-4282-b5e6-4867c2693427 service neutron] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:12.522196 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70637b64-9351-4282-b5e6-4867c2693427 service neutron] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:12.522479 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70637b64-9351-4282-b5e6-4867c2693427 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:12.533922 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70637b64-9351-4282-b5e6-4867c2693427 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:27:12.535900 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70637b64-9351-4282-b5e6-4867c2693427 service neutron] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:27:12.545508 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c376b90-efd5-42c8-beac-225c17c370e0 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:27:12.547297 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-8c376b90-efd5-42c8-beac-225c17c370e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:27:12.547894 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1102/2199] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:27:12 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:27:12.561532 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c376b90-efd5-42c8-beac-225c17c370e0 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:27:12.571997 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1474a83-8ee4-4835-94f0-19b186863dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:27:12.573991 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1474a83-8ee4-4835-94f0-19b186863dc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:12.574377 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1474a83-8ee4-4835-94f0-19b186863dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:12.575509 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1474a83-8ee4-4835-94f0-19b186863dc6 admin admin] PATH_INFO: `/v3/users/dd7ea0f93dc8467ea3591381710b09c3` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:12.578248 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1474a83-8ee4-4835-94f0-19b186863dc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd7ea0f93dc8467ea3591381710b09c3)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:27:12.582776 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1474a83-8ee4-4835-94f0-19b186863dc6 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:27:12.856781 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-d1474a83-8ee4-4835-94f0-19b186863dc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd7ea0f93dc8467ea3591381710b09c3'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:12.870494 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-d1474a83-8ee4-4835-94f0-19b186863dc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd7ea0f93dc8467ea3591381710b09c3'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:12.895892 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-d1474a83-8ee4-4835-94f0-19b186863dc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd7ea0f93dc8467ea3591381710b09c3'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:13.040138 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-d1474a83-8ee4-4835-94f0-19b186863dc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd7ea0f93dc8467ea3591381710b09c3'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:13.041744 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-d1474a83-8ee4-4835-94f0-19b186863dc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd7ea0f93dc8467ea3591381710b09c3'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:13.052951 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1098/2200] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:27:12 2021] DELETE /identity/v3/users/dd7ea0f93dc8467ea3591381710b09c3 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 18:27:13.054538 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7109b56-342a-4d55-b043-2c5f29d0c5ad None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:13.055183 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7109b56-342a-4d55-b043-2c5f29d0c5ad None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:13.055183 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7109b56-342a-4d55-b043-2c5f29d0c5ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:13.090931 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-e7109b56-342a-4d55-b043-2c5f29d0c5ad None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:27:13.092335 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-e7109b56-342a-4d55-b043-2c5f29d0c5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:27:13.218020 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1103/2201] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:27:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:27:13.229950 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1474a83-8ee4-4835-94f0-19b186863dc6 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:27:13.233219 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-d1474a83-8ee4-4835-94f0-19b186863dc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:27:13.366538 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1474a83-8ee4-4835-94f0-19b186863dc6 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:27:13.371845 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ef80c0-aeae-4995-af5a-2fab349e9043 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:27:13.372723 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef80c0-aeae-4995-af5a-2fab349e9043 service neutron] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:13.373005 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef80c0-aeae-4995-af5a-2fab349e9043 service neutron] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:13.373452 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef80c0-aeae-4995-af5a-2fab349e9043 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:13.396870 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ef80c0-aeae-4995-af5a-2fab349e9043 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:27:13.398398 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ef80c0-aeae-4995-af5a-2fab349e9043 service neutron] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:27:13.409870 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1099/2202] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:27:13 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:27:13.483410 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7109b56-342a-4d55-b043-2c5f29d0c5ad None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:27:13.485328 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-e7109b56-342a-4d55-b043-2c5f29d0c5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:27:13.507360 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7109b56-342a-4d55-b043-2c5f29d0c5ad None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:27:13.513318 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccad845-f472-46fd-a77f-d3598e829438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:27:13.515646 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccad845-f472-46fd-a77f-d3598e829438 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:13.516005 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccad845-f472-46fd-a77f-d3598e829438 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:13.516200 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccad845-f472-46fd-a77f-d3598e829438 admin admin] PATH_INFO: `/v3/projects/a45c008831ec45c69ede876b29e30bad` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:13.521323 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccad845-f472-46fd-a77f-d3598e829438 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a45c008831ec45c69ede876b29e30bad)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:27:13.521323 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccad845-f472-46fd-a77f-d3598e829438 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:27:13.637797 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-eccad845-f472-46fd-a77f-d3598e829438 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a45c008831ec45c69ede876b29e30bad', 'request_id': 'req-eccad845-f472-46fd-a77f-d3598e829438'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:13.647112 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-eccad845-f472-46fd-a77f-d3598e829438 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a45c008831ec45c69ede876b29e30bad', 'request_id': 'req-eccad845-f472-46fd-a77f-d3598e829438'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:13.669904 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-eccad845-f472-46fd-a77f-d3598e829438 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a45c008831ec45c69ede876b29e30bad', 'request_id': 'req-eccad845-f472-46fd-a77f-d3598e829438'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:13.742682 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-eccad845-f472-46fd-a77f-d3598e829438 admin admin] The token cache is being invalidate because project a45c008831ec45c69ede876b29e30bad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74005) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:27:13.742974 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-eccad845-f472-46fd-a77f-d3598e829438 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:13.743761 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-eccad845-f472-46fd-a77f-d3598e829438 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:13.745750 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1104/2203] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:27:13 2021] DELETE /identity/v3/projects/a45c008831ec45c69ede876b29e30bad => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:27:13.749981 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ef80c0-aeae-4995-af5a-2fab349e9043 service neutron] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:27:13.761395 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ef80c0-aeae-4995-af5a-2fab349e9043 service neutron] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:27:13.820172 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845ae5d9-9f40-45a6-94fc-547d930eca68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:27:13.821178 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ae5d9-9f40-45a6-94fc-547d930eca68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:13.821529 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ae5d9-9f40-45a6-94fc-547d930eca68 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:13.821877 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ae5d9-9f40-45a6-94fc-547d930eca68 admin admin] PATH_INFO: `/v3/users/59f156fc61ad4cae80c3bfe29dde7b83` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:13.823158 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845ae5d9-9f40-45a6-94fc-547d930eca68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59f156fc61ad4cae80c3bfe29dde7b83)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:27:13.825200 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845ae5d9-9f40-45a6-94fc-547d930eca68 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:27:13.973934 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccad845-f472-46fd-a77f-d3598e829438 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:27:13.975351 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-eccad845-f472-46fd-a77f-d3598e829438 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:27:13.988643 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccad845-f472-46fd-a77f-d3598e829438 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:27:13.993715 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04335a3-f35c-413b-bb84-99615ae00c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:27:13.994572 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04335a3-f35c-413b-bb84-99615ae00c8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:13.994857 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04335a3-f35c-413b-bb84-99615ae00c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:13.995137 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04335a3-f35c-413b-bb84-99615ae00c8b admin admin] PATH_INFO: `/v3/projects/e28f8af988f8432eb33c6d4af8e0b48d` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:13.996353 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04335a3-f35c-413b-bb84-99615ae00c8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e28f8af988f8432eb33c6d4af8e0b48d)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:27:13.998327 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04335a3-f35c-413b-bb84-99615ae00c8b admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:27:14.132609 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-845ae5d9-9f40-45a6-94fc-547d930eca68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59f156fc61ad4cae80c3bfe29dde7b83'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:14.139455 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-845ae5d9-9f40-45a6-94fc-547d930eca68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59f156fc61ad4cae80c3bfe29dde7b83'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:14.157930 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-845ae5d9-9f40-45a6-94fc-547d930eca68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59f156fc61ad4cae80c3bfe29dde7b83'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:14.177596 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-c04335a3-f35c-413b-bb84-99615ae00c8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e28f8af988f8432eb33c6d4af8e0b48d', 'request_id': 'req-c04335a3-f35c-413b-bb84-99615ae00c8b'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:14.183909 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-c04335a3-f35c-413b-bb84-99615ae00c8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e28f8af988f8432eb33c6d4af8e0b48d', 'request_id': 'req-c04335a3-f35c-413b-bb84-99615ae00c8b'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:14.189585 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-c04335a3-f35c-413b-bb84-99615ae00c8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e28f8af988f8432eb33c6d4af8e0b48d', 'request_id': 'req-c04335a3-f35c-413b-bb84-99615ae00c8b'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:14.285862 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-845ae5d9-9f40-45a6-94fc-547d930eca68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59f156fc61ad4cae80c3bfe29dde7b83'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:14.287086 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-845ae5d9-9f40-45a6-94fc-547d930eca68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59f156fc61ad4cae80c3bfe29dde7b83'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:14.293537 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1100/2204] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:27:13 2021] DELETE /identity/v3/users/59f156fc61ad4cae80c3bfe29dde7b83 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:27:14.404795 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-c04335a3-f35c-413b-bb84-99615ae00c8b admin admin] The token cache is being invalidate because project e28f8af988f8432eb33c6d4af8e0b48d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74005) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:27:14.405162 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-c04335a3-f35c-413b-bb84-99615ae00c8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:14.405801 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-c04335a3-f35c-413b-bb84-99615ae00c8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:14.407378 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1105/2205] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:27:13 2021] DELETE /identity/v3/projects/e28f8af988f8432eb33c6d4af8e0b48d => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 18:27:14.412103 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845ae5d9-9f40-45a6-94fc-547d930eca68 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:27:14.413821 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-845ae5d9-9f40-45a6-94fc-547d930eca68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:27:14.491041 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845ae5d9-9f40-45a6-94fc-547d930eca68 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:27:14.496348 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882b2512-b834-40e7-ab6a-28924fd667a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:27:14.497370 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b2512-b834-40e7-ab6a-28924fd667a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:14.497768 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b2512-b834-40e7-ab6a-28924fd667a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:14.498143 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b2512-b834-40e7-ab6a-28924fd667a4 admin admin] PATH_INFO: `/v3/users/b5e7f450352b4bb2a98417654e134e3f` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:14.499632 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882b2512-b834-40e7-ab6a-28924fd667a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5e7f450352b4bb2a98417654e134e3f)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:27:14.502479 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882b2512-b834-40e7-ab6a-28924fd667a4 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:27:14.664542 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-882b2512-b834-40e7-ab6a-28924fd667a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5e7f450352b4bb2a98417654e134e3f'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:14.671561 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-882b2512-b834-40e7-ab6a-28924fd667a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5e7f450352b4bb2a98417654e134e3f'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:14.682902 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-882b2512-b834-40e7-ab6a-28924fd667a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5e7f450352b4bb2a98417654e134e3f'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:14.732267 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04335a3-f35c-413b-bb84-99615ae00c8b admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:27:14.733725 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-c04335a3-f35c-413b-bb84-99615ae00c8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:27:14.782393 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-882b2512-b834-40e7-ab6a-28924fd667a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5e7f450352b4bb2a98417654e134e3f'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:14.783168 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-882b2512-b834-40e7-ab6a-28924fd667a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5e7f450352b4bb2a98417654e134e3f'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:14.789756 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1101/2206] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:27:14 2021] DELETE /identity/v3/users/b5e7f450352b4bb2a98417654e134e3f => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 18:27:14.797915 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04335a3-f35c-413b-bb84-99615ae00c8b admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:27:14.853395 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a87db96-6abb-4a8f-bccb-74242332ca93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:27:14.854374 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a87db96-6abb-4a8f-bccb-74242332ca93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:14.854654 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a87db96-6abb-4a8f-bccb-74242332ca93 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:14.854919 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a87db96-6abb-4a8f-bccb-74242332ca93 admin admin] PATH_INFO: `/v3/projects/00ecfacaa05c41bd8b89d62f18cb1f6e` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:14.856364 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a87db96-6abb-4a8f-bccb-74242332ca93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00ecfacaa05c41bd8b89d62f18cb1f6e)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:27:14.858549 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a87db96-6abb-4a8f-bccb-74242332ca93 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:27:15.074711 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-3a87db96-6abb-4a8f-bccb-74242332ca93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00ecfacaa05c41bd8b89d62f18cb1f6e', 'request_id': 'req-3a87db96-6abb-4a8f-bccb-74242332ca93'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:15.080897 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-3a87db96-6abb-4a8f-bccb-74242332ca93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00ecfacaa05c41bd8b89d62f18cb1f6e', 'request_id': 'req-3a87db96-6abb-4a8f-bccb-74242332ca93'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:15.087052 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-3a87db96-6abb-4a8f-bccb-74242332ca93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00ecfacaa05c41bd8b89d62f18cb1f6e', 'request_id': 'req-3a87db96-6abb-4a8f-bccb-74242332ca93'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:15.169598 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-3a87db96-6abb-4a8f-bccb-74242332ca93 admin admin] The token cache is being invalidate because project 00ecfacaa05c41bd8b89d62f18cb1f6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74005) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:27:15.170043 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-3a87db96-6abb-4a8f-bccb-74242332ca93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:15.170674 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-3a87db96-6abb-4a8f-bccb-74242332ca93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:15.172267 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1106/2207] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:27:14 2021] DELETE /identity/v3/projects/00ecfacaa05c41bd8b89d62f18cb1f6e => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 18:27:15.176880 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882b2512-b834-40e7-ab6a-28924fd667a4 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:27:15.178311 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-882b2512-b834-40e7-ab6a-28924fd667a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:27:15.191559 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882b2512-b834-40e7-ab6a-28924fd667a4 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:27:15.248119 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdcc4a8-0696-4695-a779-781ff83712bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:27:15.248946 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdcc4a8-0696-4695-a779-781ff83712bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:15.249226 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdcc4a8-0696-4695-a779-781ff83712bc admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:15.249497 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdcc4a8-0696-4695-a779-781ff83712bc admin admin] PATH_INFO: `/v3/users/85252e29db1c47829652f6e18af1892f` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:15.250723 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdcc4a8-0696-4695-a779-781ff83712bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=85252e29db1c47829652f6e18af1892f)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:27:15.252676 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdcc4a8-0696-4695-a779-781ff83712bc admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:27:15.333403 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a87db96-6abb-4a8f-bccb-74242332ca93 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:27:15.334924 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-3a87db96-6abb-4a8f-bccb-74242332ca93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:27:15.357315 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a87db96-6abb-4a8f-bccb-74242332ca93 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:27:15.365147 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f7e18f-d04a-415e-9850-61e83a7f1eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:27:15.366004 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7e18f-d04a-415e-9850-61e83a7f1eb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:15.366312 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7e18f-d04a-415e-9850-61e83a7f1eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:15.366582 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7e18f-d04a-415e-9850-61e83a7f1eb5 admin admin] PATH_INFO: `/v3/projects/e4d5e435139e4983bcda6cbac220d75a` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:15.368410 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f7e18f-d04a-415e-9850-61e83a7f1eb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4d5e435139e4983bcda6cbac220d75a)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:27:15.370355 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f7e18f-d04a-415e-9850-61e83a7f1eb5 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:27:15.463493 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-0fdcc4a8-0696-4695-a779-781ff83712bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85252e29db1c47829652f6e18af1892f'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:15.471244 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-0fdcc4a8-0696-4695-a779-781ff83712bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85252e29db1c47829652f6e18af1892f'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:15.483595 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-0fdcc4a8-0696-4695-a779-781ff83712bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85252e29db1c47829652f6e18af1892f'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:15.491077 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-37f7e18f-d04a-415e-9850-61e83a7f1eb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4d5e435139e4983bcda6cbac220d75a', 'request_id': 'req-37f7e18f-d04a-415e-9850-61e83a7f1eb5'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:15.497540 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-37f7e18f-d04a-415e-9850-61e83a7f1eb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4d5e435139e4983bcda6cbac220d75a', 'request_id': 'req-37f7e18f-d04a-415e-9850-61e83a7f1eb5'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:15.504011 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-37f7e18f-d04a-415e-9850-61e83a7f1eb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4d5e435139e4983bcda6cbac220d75a', 'request_id': 'req-37f7e18f-d04a-415e-9850-61e83a7f1eb5'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:15.543037 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-0fdcc4a8-0696-4695-a779-781ff83712bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85252e29db1c47829652f6e18af1892f'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:15.543901 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-0fdcc4a8-0696-4695-a779-781ff83712bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85252e29db1c47829652f6e18af1892f'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:15.552003 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1102/2208] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:27:15 2021] DELETE /identity/v3/users/85252e29db1c47829652f6e18af1892f => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:27:15.622462 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-37f7e18f-d04a-415e-9850-61e83a7f1eb5 admin admin] The token cache is being invalidate because project e4d5e435139e4983bcda6cbac220d75a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74005) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:27:15.622819 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-37f7e18f-d04a-415e-9850-61e83a7f1eb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:15.623584 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-37f7e18f-d04a-415e-9850-61e83a7f1eb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:15.629499 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1107/2209] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:27:15 2021] DELETE /identity/v3/projects/e4d5e435139e4983bcda6cbac220d75a => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 18:27:15.630756 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdcc4a8-0696-4695-a779-781ff83712bc admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:27:15.632469 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-0fdcc4a8-0696-4695-a779-781ff83712bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:27:15.721419 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdcc4a8-0696-4695-a779-781ff83712bc admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:27:15.727611 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cb9225-8740-4b36-9f7a-0c151b377269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:27:15.728529 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb9225-8740-4b36-9f7a-0c151b377269 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:15.728810 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb9225-8740-4b36-9f7a-0c151b377269 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:15.729082 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb9225-8740-4b36-9f7a-0c151b377269 admin admin] PATH_INFO: `/v3/users/d0f78ab4315248c682f1ff402b6e0933` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:15.730314 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cb9225-8740-4b36-9f7a-0c151b377269 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0f78ab4315248c682f1ff402b6e0933)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:27:15.732230 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cb9225-8740-4b36-9f7a-0c151b377269 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:27:15.946914 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-75cb9225-8740-4b36-9f7a-0c151b377269 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0f78ab4315248c682f1ff402b6e0933'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:15.956097 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-75cb9225-8740-4b36-9f7a-0c151b377269 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0f78ab4315248c682f1ff402b6e0933'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:15.974169 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-75cb9225-8740-4b36-9f7a-0c151b377269 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0f78ab4315248c682f1ff402b6e0933'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:16.121038 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f7e18f-d04a-415e-9850-61e83a7f1eb5 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:27:16.121038 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-37f7e18f-d04a-415e-9850-61e83a7f1eb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:27:16.143074 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-75cb9225-8740-4b36-9f7a-0c151b377269 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0f78ab4315248c682f1ff402b6e0933'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:16.144557 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-75cb9225-8740-4b36-9f7a-0c151b377269 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0f78ab4315248c682f1ff402b6e0933'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:16.153714 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1103/2210] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:27:15 2021] DELETE /identity/v3/users/d0f78ab4315248c682f1ff402b6e0933 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 18:27:16.273332 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f7e18f-d04a-415e-9850-61e83a7f1eb5 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:27:16.359004 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e875ea6-52ad-46de-9552-4a78f7224538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:27:16.360549 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e875ea6-52ad-46de-9552-4a78f7224538 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:16.361532 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e875ea6-52ad-46de-9552-4a78f7224538 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:16.362041 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e875ea6-52ad-46de-9552-4a78f7224538 admin admin] PATH_INFO: `/v3/projects/c4749f4bb47846b7996e25d8ba06a292` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:16.364471 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e875ea6-52ad-46de-9552-4a78f7224538 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4749f4bb47846b7996e25d8ba06a292)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:27:16.368595 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e875ea6-52ad-46de-9552-4a78f7224538 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:27:16.566042 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-7e875ea6-52ad-46de-9552-4a78f7224538 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4749f4bb47846b7996e25d8ba06a292', 'request_id': 'req-7e875ea6-52ad-46de-9552-4a78f7224538'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:16.576380 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-7e875ea6-52ad-46de-9552-4a78f7224538 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4749f4bb47846b7996e25d8ba06a292', 'request_id': 'req-7e875ea6-52ad-46de-9552-4a78f7224538'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:16.584866 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-7e875ea6-52ad-46de-9552-4a78f7224538 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4749f4bb47846b7996e25d8ba06a292', 'request_id': 'req-7e875ea6-52ad-46de-9552-4a78f7224538'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:16.664283 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-7e875ea6-52ad-46de-9552-4a78f7224538 admin admin] The token cache is being invalidate because project c4749f4bb47846b7996e25d8ba06a292 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74005) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:27:16.664283 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-7e875ea6-52ad-46de-9552-4a78f7224538 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:16.668332 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-7e875ea6-52ad-46de-9552-4a78f7224538 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:16.670289 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1108/2211] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:27:16 2021] DELETE /identity/v3/projects/c4749f4bb47846b7996e25d8ba06a292 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:27:17.093030 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cb9225-8740-4b36-9f7a-0c151b377269 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:27:17.094665 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-75cb9225-8740-4b36-9f7a-0c151b377269 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:27:17.111058 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cb9225-8740-4b36-9f7a-0c151b377269 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:27:17.171691 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f415442-5b36-4d0e-9551-66f586d64afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:27:17.172656 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f415442-5b36-4d0e-9551-66f586d64afe admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:17.173020 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f415442-5b36-4d0e-9551-66f586d64afe admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:17.173426 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f415442-5b36-4d0e-9551-66f586d64afe admin admin] PATH_INFO: `/v3/projects/c7f48ae02b684d19aea04b0d3b595907` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:17.175251 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f415442-5b36-4d0e-9551-66f586d64afe admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7f48ae02b684d19aea04b0d3b595907)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:27:17.177417 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f415442-5b36-4d0e-9551-66f586d64afe admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:27:17.279934 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-3f415442-5b36-4d0e-9551-66f586d64afe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7f48ae02b684d19aea04b0d3b595907', 'request_id': 'req-3f415442-5b36-4d0e-9551-66f586d64afe'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:17.330771 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-3f415442-5b36-4d0e-9551-66f586d64afe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7f48ae02b684d19aea04b0d3b595907', 'request_id': 'req-3f415442-5b36-4d0e-9551-66f586d64afe'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:17.337623 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-3f415442-5b36-4d0e-9551-66f586d64afe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7f48ae02b684d19aea04b0d3b595907', 'request_id': 'req-3f415442-5b36-4d0e-9551-66f586d64afe'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:17.348873 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-3f415442-5b36-4d0e-9551-66f586d64afe admin admin] The token cache is being invalidate because project c7f48ae02b684d19aea04b0d3b595907 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:27:17.349057 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-3f415442-5b36-4d0e-9551-66f586d64afe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:17.349699 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-3f415442-5b36-4d0e-9551-66f586d64afe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:17.351356 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1104/2212] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:27:17 2021] DELETE /identity/v3/projects/c7f48ae02b684d19aea04b0d3b595907 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 18:27:17.357307 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a30c8-e62e-4a39-86b0-a0c6af32a1ba None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:17.357766 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a30c8-e62e-4a39-86b0-a0c6af32a1ba None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:17.358128 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a30c8-e62e-4a39-86b0-a0c6af32a1ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:17.376765 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-006a30c8-e62e-4a39-86b0-a0c6af32a1ba None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:27:17.377947 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-006a30c8-e62e-4a39-86b0-a0c6af32a1ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:27:17.437565 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1109/2213] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:27:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:27:17.450136 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb8cc3-3b1b-4994-a799-19ea3fc6649a None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:17.450581 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb8cc3-3b1b-4994-a799-19ea3fc6649a None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:17.451031 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb8cc3-3b1b-4994-a799-19ea3fc6649a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:17.473283 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-d3fb8cc3-3b1b-4994-a799-19ea3fc6649a None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:27:17.474499 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-d3fb8cc3-3b1b-4994-a799-19ea3fc6649a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:27:17.488256 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1105/2214] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:27:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:27:17.492529 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006a30c8-e62e-4a39-86b0-a0c6af32a1ba None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:27:17.503048 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006a30c8-e62e-4a39-86b0-a0c6af32a1ba None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:27:17.508788 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a6d0c-8409-49fb-9e7a-d7e607d0d1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:27:17.509563 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a6d0c-8409-49fb-9e7a-d7e607d0d1ab admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:17.509782 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a6d0c-8409-49fb-9e7a-d7e607d0d1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:17.510064 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a6d0c-8409-49fb-9e7a-d7e607d0d1ab admin admin] PATH_INFO: `/v3/domains` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:17.510810 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030a6d0c-8409-49fb-9e7a-d7e607d0d1ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:27:17.511118 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030a6d0c-8409-49fb-9e7a-d7e607d0d1ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:27:17.512824 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030a6d0c-8409-49fb-9e7a-d7e607d0d1ab admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:27:17.531816 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1110/2215] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 12 18:27:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:27:17.534076 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fb8cc3-3b1b-4994-a799-19ea3fc6649a None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:27:17.550548 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fb8cc3-3b1b-4994-a799-19ea3fc6649a None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:27:17.561081 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65536cb6-6ee6-43a2-837b-d026259dac51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:27:17.562173 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65536cb6-6ee6-43a2-837b-d026259dac51 admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:17.562658 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65536cb6-6ee6-43a2-837b-d026259dac51 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:17.563146 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65536cb6-6ee6-43a2-837b-d026259dac51 admin admin] PATH_INFO: `/v3/projects` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:17.565039 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65536cb6-6ee6-43a2-837b-d026259dac51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:27:17.569134 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65536cb6-6ee6-43a2-837b-d026259dac51 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:27:17.663343 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1106/2216] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:27:17 2021] POST /identity/v3/projects => generated 373 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 18:27:17.667346 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a6d0c-8409-49fb-9e7a-d7e607d0d1ab admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:27:17.679465 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a6d0c-8409-49fb-9e7a-d7e607d0d1ab admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:27:17.742109 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b9745-750e-4827-8103-e204f84f4248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:27:17.742775 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b9745-750e-4827-8103-e204f84f4248 admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:17.743081 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b9745-750e-4827-8103-e204f84f4248 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:17.743346 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b9745-750e-4827-8103-e204f84f4248 admin admin] PATH_INFO: `/v3/users` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:17.744050 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2b9745-750e-4827-8103-e204f84f4248 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:27:17.746020 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2b9745-750e-4827-8103-e204f84f4248 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:27:17.863105 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1111/2217] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:27:17 2021] POST /identity/v3/users => generated 287 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:27:17.867288 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65536cb6-6ee6-43a2-837b-d026259dac51 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:27:17.878014 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65536cb6-6ee6-43a2-837b-d026259dac51 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:27:17.882887 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12746050-bb5e-4820-b3c8-172da62b005b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:27:17.883661 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12746050-bb5e-4820-b3c8-172da62b005b admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:17.883936 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12746050-bb5e-4820-b3c8-172da62b005b admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:17.884217 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12746050-bb5e-4820-b3c8-172da62b005b admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:17.885061 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12746050-bb5e-4820-b3c8-172da62b005b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:27:17.886653 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12746050-bb5e-4820-b3c8-172da62b005b admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:27:17.897221 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1107/2218] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:27:17 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:27:17.901588 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b9745-750e-4827-8103-e204f84f4248 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:27:17.911662 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b9745-750e-4827-8103-e204f84f4248 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:27:17.916424 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e83249-0c14-4aa1-a244-0ad91872fce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:27:17.917092 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e83249-0c14-4aa1-a244-0ad91872fce7 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:17.917370 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e83249-0c14-4aa1-a244-0ad91872fce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:17.917643 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e83249-0c14-4aa1-a244-0ad91872fce7 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:17.918373 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e83249-0c14-4aa1-a244-0ad91872fce7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:27:17.919959 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e83249-0c14-4aa1-a244-0ad91872fce7 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:27:17.930294 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1112/2219] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:27:17 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:27:17.934856 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12746050-bb5e-4820-b3c8-172da62b005b admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:27:17.945742 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12746050-bb5e-4820-b3c8-172da62b005b admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:27:17.950286 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dffe5d-17e4-4e3d-9875-d55d0662e0ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:27:17.951166 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dffe5d-17e4-4e3d-9875-d55d0662e0ba admin admin] REQUEST_METHOD: `PUT` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:17.951445 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dffe5d-17e4-4e3d-9875-d55d0662e0ba admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:17.951720 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dffe5d-17e4-4e3d-9875-d55d0662e0ba admin admin] PATH_INFO: `/v3/projects/af5bdd92d0cb4c5e956f75319aef51ab/users/24e5a4b1c6274512a3df0a956aaa4f05/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:17.972778 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dffe5d-17e4-4e3d-9875-d55d0662e0ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=af5bdd92d0cb4c5e956f75319aef51ab, user_id=24e5a4b1c6274512a3df0a956aaa4f05, role_id=33b8a5a8d1d643f2a98f598e6ab0a1cf)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:27:17.975646 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dffe5d-17e4-4e3d-9875-d55d0662e0ba admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:27:18.061342 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1108/2220] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:27:17 2021] PUT /identity/v3/projects/af5bdd92d0cb4c5e956f75319aef51ab/users/24e5a4b1c6274512a3df0a956aaa4f05/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 18:27:18.074977 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc289da-3ac6-4858-bc7f-84fab760955f None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:18.075335 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc289da-3ac6-4858-bc7f-84fab760955f None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:18.075678 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc289da-3ac6-4858-bc7f-84fab760955f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:18.104196 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-dcc289da-3ac6-4858-bc7f-84fab760955f None None] MFA Rules not processed for user `24e5a4b1c6274512a3df0a956aaa4f05`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:27:18.106050 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-dcc289da-3ac6-4858-bc7f-84fab760955f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:27:18.204315 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1113/2221] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:27:18 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:27:18.218144 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dffe5d-17e4-4e3d-9875-d55d0662e0ba admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:27:18.220080 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-39dffe5d-17e4-4e3d-9875-d55d0662e0ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:27:18.277180 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dffe5d-17e4-4e3d-9875-d55d0662e0ba admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:27:18.280855 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7109647-fa8f-423f-9f66-5cc0060fea94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6966ce0774f4437a9b688494e9d0574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:27:18.281495 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7109647-fa8f-423f-9f66-5cc0060fea94 service cinder] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:18.281777 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7109647-fa8f-423f-9f66-5cc0060fea94 service cinder] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:18.282050 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7109647-fa8f-423f-9f66-5cc0060fea94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:18.291025 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7109647-fa8f-423f-9f66-5cc0060fea94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:27:18.292474 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7109647-fa8f-423f-9f66-5cc0060fea94 service cinder] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:27:18.302742 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1109/2222] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:27:18 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:27:29.505656 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc289da-3ac6-4858-bc7f-84fab760955f None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:27:29.507087 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-dcc289da-3ac6-4858-bc7f-84fab760955f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:27:29.572838 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc289da-3ac6-4858-bc7f-84fab760955f None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:27:29.581485 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24771fa2-16a6-4d7b-8c97-84f054e42333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:27:29.582378 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24771fa2-16a6-4d7b-8c97-84f054e42333 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:29.582656 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24771fa2-16a6-4d7b-8c97-84f054e42333 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:29.582925 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24771fa2-16a6-4d7b-8c97-84f054e42333 admin admin] PATH_INFO: `/v3/users/b07cc3785d7d4d3095c3d03f1705bc71` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:29.584160 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24771fa2-16a6-4d7b-8c97-84f054e42333 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b07cc3785d7d4d3095c3d03f1705bc71)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:27:29.587904 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24771fa2-16a6-4d7b-8c97-84f054e42333 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:27:29.812851 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-24771fa2-16a6-4d7b-8c97-84f054e42333 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b07cc3785d7d4d3095c3d03f1705bc71'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:29.814083 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-24771fa2-16a6-4d7b-8c97-84f054e42333 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b07cc3785d7d4d3095c3d03f1705bc71'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:29.826793 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-24771fa2-16a6-4d7b-8c97-84f054e42333 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b07cc3785d7d4d3095c3d03f1705bc71'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:29.827981 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-24771fa2-16a6-4d7b-8c97-84f054e42333 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b07cc3785d7d4d3095c3d03f1705bc71'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:29.835473 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-24771fa2-16a6-4d7b-8c97-84f054e42333 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b07cc3785d7d4d3095c3d03f1705bc71'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:29.955977 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1114/2223] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:27:29 2021] DELETE /identity/v3/users/b07cc3785d7d4d3095c3d03f1705bc71 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:27:29.958967 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd946255-5397-433e-abbe-f597259e0387 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:29.959986 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd946255-5397-433e-abbe-f597259e0387 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:29.960358 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd946255-5397-433e-abbe-f597259e0387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:29.987838 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-cd946255-5397-433e-abbe-f597259e0387 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:27:29.990075 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-cd946255-5397-433e-abbe-f597259e0387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:27:30.077482 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1110/2224] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:27:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:27:30.086647 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24771fa2-16a6-4d7b-8c97-84f054e42333 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:27:30.087767 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-24771fa2-16a6-4d7b-8c97-84f054e42333 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:27:30.152967 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24771fa2-16a6-4d7b-8c97-84f054e42333 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:27:30.156553 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbff592-6aa6-46e8-a9f5-e84147fff7af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:27:30.157305 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbff592-6aa6-46e8-a9f5-e84147fff7af service neutron] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:30.157591 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbff592-6aa6-46e8-a9f5-e84147fff7af service neutron] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:30.157862 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbff592-6aa6-46e8-a9f5-e84147fff7af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:30.168580 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbff592-6aa6-46e8-a9f5-e84147fff7af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:27:30.170021 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbff592-6aa6-46e8-a9f5-e84147fff7af service neutron] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:27:30.180554 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1115/2225] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:27:30 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:27:30.925708 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd946255-5397-433e-abbe-f597259e0387 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:27:30.927194 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-cd946255-5397-433e-abbe-f597259e0387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:27:30.946300 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd946255-5397-433e-abbe-f597259e0387 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:27:30.951789 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c646a2a-cc02-47e5-b72d-ba6c10f41213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:27:30.953113 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c646a2a-cc02-47e5-b72d-ba6c10f41213 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:30.953672 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c646a2a-cc02-47e5-b72d-ba6c10f41213 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:30.954201 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c646a2a-cc02-47e5-b72d-ba6c10f41213 admin admin] PATH_INFO: `/v3/projects/46eadf3e60ed40499127f4e85e1150d5` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:30.956801 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c646a2a-cc02-47e5-b72d-ba6c10f41213 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46eadf3e60ed40499127f4e85e1150d5)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:27:30.959076 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c646a2a-cc02-47e5-b72d-ba6c10f41213 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:27:31.193422 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-8c646a2a-cc02-47e5-b72d-ba6c10f41213 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46eadf3e60ed40499127f4e85e1150d5', 'request_id': 'req-8c646a2a-cc02-47e5-b72d-ba6c10f41213'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:31.245044 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-8c646a2a-cc02-47e5-b72d-ba6c10f41213 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46eadf3e60ed40499127f4e85e1150d5', 'request_id': 'req-8c646a2a-cc02-47e5-b72d-ba6c10f41213'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:31.255759 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-8c646a2a-cc02-47e5-b72d-ba6c10f41213 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46eadf3e60ed40499127f4e85e1150d5', 'request_id': 'req-8c646a2a-cc02-47e5-b72d-ba6c10f41213'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:31.266242 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-8c646a2a-cc02-47e5-b72d-ba6c10f41213 admin admin] The token cache is being invalidate because project 46eadf3e60ed40499127f4e85e1150d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:27:31.266523 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-8c646a2a-cc02-47e5-b72d-ba6c10f41213 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:31.268643 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-8c646a2a-cc02-47e5-b72d-ba6c10f41213 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:31.269405 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1111/2226] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:27:30 2021] DELETE /identity/v3/projects/46eadf3e60ed40499127f4e85e1150d5 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:27:31.275290 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6186e2-8b52-4566-b00e-cc672191db61 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:31.276132 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6186e2-8b52-4566-b00e-cc672191db61 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:31.276132 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6186e2-8b52-4566-b00e-cc672191db61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:31.297829 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-4e6186e2-8b52-4566-b00e-cc672191db61 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:27:31.299363 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-4e6186e2-8b52-4566-b00e-cc672191db61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:27:31.375600 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1116/2227] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:27:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:27:31.377741 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721b41d2-66e1-4361-9e4f-148df4d8599a None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:31.378217 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721b41d2-66e1-4361-9e4f-148df4d8599a None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:31.378578 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721b41d2-66e1-4361-9e4f-148df4d8599a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:31.400931 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-721b41d2-66e1-4361-9e4f-148df4d8599a None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:27:31.402575 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-721b41d2-66e1-4361-9e4f-148df4d8599a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:27:31.415720 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1112/2228] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:27:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:27:31.416700 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6186e2-8b52-4566-b00e-cc672191db61 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:27:31.427357 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6186e2-8b52-4566-b00e-cc672191db61 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:27:31.433325 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ac6412-0854-4a43-81fd-5467418fdd79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:27:31.434047 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ac6412-0854-4a43-81fd-5467418fdd79 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:31.434337 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ac6412-0854-4a43-81fd-5467418fdd79 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:31.434644 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ac6412-0854-4a43-81fd-5467418fdd79 admin admin] PATH_INFO: `/v3/domains` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:31.435379 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ac6412-0854-4a43-81fd-5467418fdd79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:27:31.435684 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ac6412-0854-4a43-81fd-5467418fdd79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:27:31.437356 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ac6412-0854-4a43-81fd-5467418fdd79 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:27:31.449453 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1117/2229] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 12 18:27:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:27:31.456259 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721b41d2-66e1-4361-9e4f-148df4d8599a None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:27:31.470746 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721b41d2-66e1-4361-9e4f-148df4d8599a None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:27:31.476060 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4973b457-24f4-4105-b8b7-003b721cd22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:27:31.476754 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973b457-24f4-4105-b8b7-003b721cd22c admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:31.477033 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973b457-24f4-4105-b8b7-003b721cd22c admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:31.477304 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973b457-24f4-4105-b8b7-003b721cd22c admin admin] PATH_INFO: `/v3/projects` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:31.478002 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4973b457-24f4-4105-b8b7-003b721cd22c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:27:31.479931 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4973b457-24f4-4105-b8b7-003b721cd22c admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:27:31.563191 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1113/2230] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:27:31 2021] POST /identity/v3/projects => generated 399 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:27:31.568273 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ac6412-0854-4a43-81fd-5467418fdd79 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:27:31.587651 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ac6412-0854-4a43-81fd-5467418fdd79 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:27:31.653317 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6996b92c-619a-4dbd-a106-93704cfc864f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:27:31.654009 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6996b92c-619a-4dbd-a106-93704cfc864f admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:31.654295 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6996b92c-619a-4dbd-a106-93704cfc864f admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:31.654573 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6996b92c-619a-4dbd-a106-93704cfc864f admin admin] PATH_INFO: `/v3/users` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:31.655294 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6996b92c-619a-4dbd-a106-93704cfc864f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:27:31.657391 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6996b92c-619a-4dbd-a106-93704cfc864f admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:27:31.742202 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1118/2231] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:27:31 2021] POST /identity/v3/users => generated 300 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:27:31.746958 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4973b457-24f4-4105-b8b7-003b721cd22c admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:27:31.755256 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4973b457-24f4-4105-b8b7-003b721cd22c admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:27:31.761259 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de1bb4e-3e16-43cc-b71c-6af2b175012a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:27:31.761951 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1bb4e-3e16-43cc-b71c-6af2b175012a admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:31.762234 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1bb4e-3e16-43cc-b71c-6af2b175012a admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:31.762503 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1bb4e-3e16-43cc-b71c-6af2b175012a admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:31.763272 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de1bb4e-3e16-43cc-b71c-6af2b175012a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:27:31.764975 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de1bb4e-3e16-43cc-b71c-6af2b175012a admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:27:31.779174 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1114/2232] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:27:31 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:27:31.783763 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6996b92c-619a-4dbd-a106-93704cfc864f admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:27:31.797229 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6996b92c-619a-4dbd-a106-93704cfc864f admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:27:31.802873 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f7d009-76a2-4a5b-b1a6-50b93a0aca0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:27:31.803573 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f7d009-76a2-4a5b-b1a6-50b93a0aca0b admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:31.803856 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f7d009-76a2-4a5b-b1a6-50b93a0aca0b admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:31.804134 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f7d009-76a2-4a5b-b1a6-50b93a0aca0b admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:31.804942 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f7d009-76a2-4a5b-b1a6-50b93a0aca0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:27:31.806622 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f7d009-76a2-4a5b-b1a6-50b93a0aca0b admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:27:31.821800 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1119/2233] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:27:31 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:27:31.824837 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de1bb4e-3e16-43cc-b71c-6af2b175012a admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:27:31.835073 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de1bb4e-3e16-43cc-b71c-6af2b175012a admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:27:31.839800 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa4d78a-3d07-440f-9387-88934fdb51ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:27:31.840728 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa4d78a-3d07-440f-9387-88934fdb51ba admin admin] REQUEST_METHOD: `PUT` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:31.841009 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa4d78a-3d07-440f-9387-88934fdb51ba admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:31.841284 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa4d78a-3d07-440f-9387-88934fdb51ba admin admin] PATH_INFO: `/v3/projects/9d963ff698954272aef40203c8f54ec1/users/ab3aad431d784c55ade64227b536e749/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:31.856703 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa4d78a-3d07-440f-9387-88934fdb51ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d963ff698954272aef40203c8f54ec1, user_id=ab3aad431d784c55ade64227b536e749, role_id=33b8a5a8d1d643f2a98f598e6ab0a1cf)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:27:31.859340 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa4d78a-3d07-440f-9387-88934fdb51ba admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:27:31.991534 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1115/2234] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:27:31 2021] PUT /identity/v3/projects/9d963ff698954272aef40203c8f54ec1/users/ab3aad431d784c55ade64227b536e749/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:27:32.002032 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573d1098-f2a1-42ec-8eaa-9dfe0eb79c47 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:32.002310 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573d1098-f2a1-42ec-8eaa-9dfe0eb79c47 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:32.002585 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573d1098-f2a1-42ec-8eaa-9dfe0eb79c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:32.030084 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-573d1098-f2a1-42ec-8eaa-9dfe0eb79c47 None None] MFA Rules not processed for user `ab3aad431d784c55ade64227b536e749`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:27:32.031291 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-573d1098-f2a1-42ec-8eaa-9dfe0eb79c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:27:32.100496 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1120/2235] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:27:32 2021] POST /identity/v3/auth/tokens => generated 3419 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:27:32.115088 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa4d78a-3d07-440f-9387-88934fdb51ba admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:27:32.117065 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-faa4d78a-3d07-440f-9387-88934fdb51ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:27:32.183908 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa4d78a-3d07-440f-9387-88934fdb51ba admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:27:32.188110 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e89c7bf-d834-401e-a680-0f871b737532 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6966ce0774f4437a9b688494e9d0574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:27:32.189214 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e89c7bf-d834-401e-a680-0f871b737532 service cinder] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:32.189368 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e89c7bf-d834-401e-a680-0f871b737532 service cinder] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:32.189571 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e89c7bf-d834-401e-a680-0f871b737532 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:32.198546 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e89c7bf-d834-401e-a680-0f871b737532 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:27:32.200038 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e89c7bf-d834-401e-a680-0f871b737532 service cinder] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:27:32.210797 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1116/2236] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:27:32 2021] GET /identity/v3/auth/tokens => generated 3419 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:27:48.030238 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573d1098-f2a1-42ec-8eaa-9dfe0eb79c47 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:27:48.031638 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-573d1098-f2a1-42ec-8eaa-9dfe0eb79c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:27:48.155758 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573d1098-f2a1-42ec-8eaa-9dfe0eb79c47 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:27:48.161354 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cde8e96-a683-4549-a4f5-5456e7d689ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:27:48.162311 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde8e96-a683-4549-a4f5-5456e7d689ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:48.162590 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde8e96-a683-4549-a4f5-5456e7d689ff admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:48.162865 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde8e96-a683-4549-a4f5-5456e7d689ff admin admin] PATH_INFO: `/v3/users/24e5a4b1c6274512a3df0a956aaa4f05` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:48.164074 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cde8e96-a683-4549-a4f5-5456e7d689ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=24e5a4b1c6274512a3df0a956aaa4f05)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:27:48.166043 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cde8e96-a683-4549-a4f5-5456e7d689ff admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:27:48.485883 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-5cde8e96-a683-4549-a4f5-5456e7d689ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24e5a4b1c6274512a3df0a956aaa4f05'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:48.487153 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-5cde8e96-a683-4549-a4f5-5456e7d689ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24e5a4b1c6274512a3df0a956aaa4f05'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:48.498895 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-5cde8e96-a683-4549-a4f5-5456e7d689ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24e5a4b1c6274512a3df0a956aaa4f05'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:48.499519 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-5cde8e96-a683-4549-a4f5-5456e7d689ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24e5a4b1c6274512a3df0a956aaa4f05'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:48.507165 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-5cde8e96-a683-4549-a4f5-5456e7d689ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24e5a4b1c6274512a3df0a956aaa4f05'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:48.622383 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1121/2237] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:27:48 2021] DELETE /identity/v3/users/24e5a4b1c6274512a3df0a956aaa4f05 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:27:48.626868 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2087e1eb-fbf8-4bdb-b544-c162cb2766eb None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:48.629123 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2087e1eb-fbf8-4bdb-b544-c162cb2766eb None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:48.629123 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2087e1eb-fbf8-4bdb-b544-c162cb2766eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:48.655043 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-2087e1eb-fbf8-4bdb-b544-c162cb2766eb None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:27:48.656254 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-2087e1eb-fbf8-4bdb-b544-c162cb2766eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:27:48.722095 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1117/2238] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:27:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:27:48.737423 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cde8e96-a683-4549-a4f5-5456e7d689ff admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:27:48.739185 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-5cde8e96-a683-4549-a4f5-5456e7d689ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:27:48.844921 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cde8e96-a683-4549-a4f5-5456e7d689ff admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:27:48.848706 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29846e5d-7d91-4864-9f21-1acb4569a63c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:27:48.849348 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29846e5d-7d91-4864-9f21-1acb4569a63c service neutron] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:48.849631 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29846e5d-7d91-4864-9f21-1acb4569a63c service neutron] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:48.849897 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29846e5d-7d91-4864-9f21-1acb4569a63c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:48.859457 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29846e5d-7d91-4864-9f21-1acb4569a63c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:27:48.861454 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29846e5d-7d91-4864-9f21-1acb4569a63c service neutron] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:27:48.871510 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1122/2239] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:27:48 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:27:49.517584 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2087e1eb-fbf8-4bdb-b544-c162cb2766eb None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:27:49.517584 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-2087e1eb-fbf8-4bdb-b544-c162cb2766eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:27:49.528156 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2087e1eb-fbf8-4bdb-b544-c162cb2766eb None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:27:49.533962 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb19a6d-9a8c-435b-86b7-451d4c04c467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:27:49.534962 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb19a6d-9a8c-435b-86b7-451d4c04c467 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:49.535374 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb19a6d-9a8c-435b-86b7-451d4c04c467 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:49.535644 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb19a6d-9a8c-435b-86b7-451d4c04c467 admin admin] PATH_INFO: `/v3/users/ab3aad431d784c55ade64227b536e749` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:49.536891 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb19a6d-9a8c-435b-86b7-451d4c04c467 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab3aad431d784c55ade64227b536e749)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:27:49.538833 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb19a6d-9a8c-435b-86b7-451d4c04c467 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:27:49.676087 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-3cb19a6d-9a8c-435b-86b7-451d4c04c467 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab3aad431d784c55ade64227b536e749'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:49.682857 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-3cb19a6d-9a8c-435b-86b7-451d4c04c467 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab3aad431d784c55ade64227b536e749'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:49.694690 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-3cb19a6d-9a8c-435b-86b7-451d4c04c467 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab3aad431d784c55ade64227b536e749'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:49.715267 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29846e5d-7d91-4864-9f21-1acb4569a63c service neutron] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:27:49.716731 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-29846e5d-7d91-4864-9f21-1acb4569a63c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:27:49.729961 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29846e5d-7d91-4864-9f21-1acb4569a63c service neutron] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:27:49.736801 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867d5aec-acb9-421d-9619-b9a5fde67474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:27:49.737654 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867d5aec-acb9-421d-9619-b9a5fde67474 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:49.737932 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867d5aec-acb9-421d-9619-b9a5fde67474 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:49.738203 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867d5aec-acb9-421d-9619-b9a5fde67474 admin admin] PATH_INFO: `/v3/projects/af5bdd92d0cb4c5e956f75319aef51ab` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:49.740756 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867d5aec-acb9-421d-9619-b9a5fde67474 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af5bdd92d0cb4c5e956f75319aef51ab)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:27:49.742722 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867d5aec-acb9-421d-9619-b9a5fde67474 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:27:49.805123 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-3cb19a6d-9a8c-435b-86b7-451d4c04c467 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab3aad431d784c55ade64227b536e749'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:49.805810 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-3cb19a6d-9a8c-435b-86b7-451d4c04c467 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab3aad431d784c55ade64227b536e749'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:49.812227 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1118/2240] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:27:49 2021] DELETE /identity/v3/users/ab3aad431d784c55ade64227b536e749 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:27:49.814097 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ca0e8-d748-4af8-ac18-c2b71f6aaf87 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:49.814425 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ca0e8-d748-4af8-ac18-c2b71f6aaf87 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:49.814863 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ca0e8-d748-4af8-ac18-c2b71f6aaf87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:49.832989 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-528ca0e8-d748-4af8-ac18-c2b71f6aaf87 None None] MFA Rules not processed for user `ac7aaed40f314bf397c414162affa8ad`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:27:49.834207 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-528ca0e8-d748-4af8-ac18-c2b71f6aaf87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:27:49.857789 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-867d5aec-acb9-421d-9619-b9a5fde67474 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af5bdd92d0cb4c5e956f75319aef51ab', 'request_id': 'req-867d5aec-acb9-421d-9619-b9a5fde67474'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:49.867938 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-867d5aec-acb9-421d-9619-b9a5fde67474 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af5bdd92d0cb4c5e956f75319aef51ab', 'request_id': 'req-867d5aec-acb9-421d-9619-b9a5fde67474'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:49.877144 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-867d5aec-acb9-421d-9619-b9a5fde67474 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af5bdd92d0cb4c5e956f75319aef51ab', 'request_id': 'req-867d5aec-acb9-421d-9619-b9a5fde67474'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:49.898949 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1119/2241] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:27:49 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:27:49.900698 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c554e-058a-428f-8782-5657d2d24f66 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:49.901449 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c554e-058a-428f-8782-5657d2d24f66 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:49.901909 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c554e-058a-428f-8782-5657d2d24f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:49.922047 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-964c554e-058a-428f-8782-5657d2d24f66 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:27:49.924456 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-964c554e-058a-428f-8782-5657d2d24f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:27:50.000282 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-867d5aec-acb9-421d-9619-b9a5fde67474 admin admin] The token cache is being invalidate because project af5bdd92d0cb4c5e956f75319aef51ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74005) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:27:50.000624 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-867d5aec-acb9-421d-9619-b9a5fde67474 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:50.001279 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-867d5aec-acb9-421d-9619-b9a5fde67474 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:50.003495 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1123/2242] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:27:49 2021] DELETE /identity/v3/projects/af5bdd92d0cb4c5e956f75319aef51ab => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 18:27:50.006643 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1120/2243] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:27:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:27:50.013528 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca3b26f-2343-4ae2-820d-d517d923c7a3 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:50.013816 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca3b26f-2343-4ae2-820d-d517d923c7a3 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:50.014095 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca3b26f-2343-4ae2-820d-d517d923c7a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:50.018134 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964c554e-058a-428f-8782-5657d2d24f66 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:27:50.020713 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-964c554e-058a-428f-8782-5657d2d24f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:27:50.068836 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-6ca3b26f-2343-4ae2-820d-d517d923c7a3 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:27:50.070052 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-6ca3b26f-2343-4ae2-820d-d517d923c7a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:27:50.078739 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1124/2244] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:27:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:27:50.086819 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2058122b-a0e5-4b54-8fd9-4017e67a92ca None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:50.087159 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2058122b-a0e5-4b54-8fd9-4017e67a92ca None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:50.087441 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2058122b-a0e5-4b54-8fd9-4017e67a92ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:50.091760 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964c554e-058a-428f-8782-5657d2d24f66 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:27:50.096070 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001f0d34-29b1-4700-8f6e-988e1c321e22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:27:50.096748 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f0d34-29b1-4700-8f6e-988e1c321e22 service neutron] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:50.097030 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f0d34-29b1-4700-8f6e-988e1c321e22 service neutron] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:50.097302 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f0d34-29b1-4700-8f6e-988e1c321e22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:50.099243 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-001f0d34-29b1-4700-8f6e-988e1c321e22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:27:50.107255 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-2058122b-a0e5-4b54-8fd9-4017e67a92ca None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:27:50.108578 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-2058122b-a0e5-4b54-8fd9-4017e67a92ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:27:50.112543 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001f0d34-29b1-4700-8f6e-988e1c321e22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:27:50.113992 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001f0d34-29b1-4700-8f6e-988e1c321e22 service neutron] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:27:50.118042 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1125/2245] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:27:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:27:50.121976 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2058122b-a0e5-4b54-8fd9-4017e67a92ca None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:27:50.127719 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1121/2246] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:27:50 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 18:27:50.134004 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2058122b-a0e5-4b54-8fd9-4017e67a92ca None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:27:50.139035 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1425517e-314c-447c-93a1-be59352d326e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:27:50.139849 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1425517e-314c-447c-93a1-be59352d326e admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:50.140135 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1425517e-314c-447c-93a1-be59352d326e admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:50.140569 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1425517e-314c-447c-93a1-be59352d326e admin admin] PATH_INFO: `/v3/domains` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:50.141310 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1425517e-314c-447c-93a1-be59352d326e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:27:50.141618 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1425517e-314c-447c-93a1-be59352d326e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:27:50.143403 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1425517e-314c-447c-93a1-be59352d326e admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:27:50.158641 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1126/2247] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 12 18:27:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:27:50.159805 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001f0d34-29b1-4700-8f6e-988e1c321e22 service neutron] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:27:50.175911 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001f0d34-29b1-4700-8f6e-988e1c321e22 service neutron] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:27:50.182128 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31853858-5468-4ba5-b952-83753a240091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:27:50.183274 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31853858-5468-4ba5-b952-83753a240091 admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:50.183556 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31853858-5468-4ba5-b952-83753a240091 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:50.183829 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31853858-5468-4ba5-b952-83753a240091 admin admin] PATH_INFO: `/v3/projects` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:50.184861 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31853858-5468-4ba5-b952-83753a240091 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:27:50.186778 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31853858-5468-4ba5-b952-83753a240091 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:27:50.283598 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1122/2248] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:27:50 2021] POST /identity/v3/projects => generated 379 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:27:50.285322 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1425517e-314c-447c-93a1-be59352d326e admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:27:50.295403 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1425517e-314c-447c-93a1-be59352d326e admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:27:50.357532 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db9ef42-5d79-436d-8b97-4799e988cdc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:27:50.358316 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db9ef42-5d79-436d-8b97-4799e988cdc0 admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:50.358510 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db9ef42-5d79-436d-8b97-4799e988cdc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:50.358827 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db9ef42-5d79-436d-8b97-4799e988cdc0 admin admin] PATH_INFO: `/v3/users` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:50.359457 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db9ef42-5d79-436d-8b97-4799e988cdc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:27:50.363066 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db9ef42-5d79-436d-8b97-4799e988cdc0 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:27:50.419626 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1127/2249] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:27:50 2021] POST /identity/v3/users => generated 290 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:27:50.425875 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31853858-5468-4ba5-b952-83753a240091 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:27:50.436649 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31853858-5468-4ba5-b952-83753a240091 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:27:50.442039 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67afe75e-3fe1-4e69-a669-db246288c4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:27:50.444130 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67afe75e-3fe1-4e69-a669-db246288c4b4 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:50.444130 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67afe75e-3fe1-4e69-a669-db246288c4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:50.444130 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67afe75e-3fe1-4e69-a669-db246288c4b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:50.444130 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67afe75e-3fe1-4e69-a669-db246288c4b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:27:50.445807 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67afe75e-3fe1-4e69-a669-db246288c4b4 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:27:50.459962 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1123/2250] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:27:50 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:27:50.461324 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db9ef42-5d79-436d-8b97-4799e988cdc0 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:27:50.471802 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db9ef42-5d79-436d-8b97-4799e988cdc0 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:27:50.476714 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fb1c73-e812-4073-a301-c7586382f661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:27:50.477417 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb1c73-e812-4073-a301-c7586382f661 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:50.477700 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb1c73-e812-4073-a301-c7586382f661 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:50.477975 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb1c73-e812-4073-a301-c7586382f661 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:50.478712 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fb1c73-e812-4073-a301-c7586382f661 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:27:50.480306 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fb1c73-e812-4073-a301-c7586382f661 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:27:50.492436 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1128/2251] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:27:50 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:27:50.495537 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67afe75e-3fe1-4e69-a669-db246288c4b4 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:27:50.506552 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67afe75e-3fe1-4e69-a669-db246288c4b4 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:27:50.511390 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500ebd59-4a47-4247-8c4d-790c9195bf76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:27:50.512271 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ebd59-4a47-4247-8c4d-790c9195bf76 admin admin] REQUEST_METHOD: `PUT` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:50.512588 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ebd59-4a47-4247-8c4d-790c9195bf76 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:50.512859 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ebd59-4a47-4247-8c4d-790c9195bf76 admin admin] PATH_INFO: `/v3/projects/d1b808c36ccd4256858530aedc0a6f64/users/9a37985dd5034ceeabfa47797efba5a1/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:50.540883 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500ebd59-4a47-4247-8c4d-790c9195bf76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1b808c36ccd4256858530aedc0a6f64, user_id=9a37985dd5034ceeabfa47797efba5a1, role_id=33b8a5a8d1d643f2a98f598e6ab0a1cf)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:27:50.543863 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500ebd59-4a47-4247-8c4d-790c9195bf76 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:27:50.563580 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fb1c73-e812-4073-a301-c7586382f661 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:27:50.570384 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-54fb1c73-e812-4073-a301-c7586382f661 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:27:50.596617 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1124/2252] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:27:50 2021] PUT /identity/v3/projects/d1b808c36ccd4256858530aedc0a6f64/users/9a37985dd5034ceeabfa47797efba5a1/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:27:50.597758 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fb1c73-e812-4073-a301-c7586382f661 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:27:50.602459 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ebf4a1-c86b-4af7-84a8-7522c5245649 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:50.605618 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ebf4a1-c86b-4af7-84a8-7522c5245649 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:50.605618 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ebf4a1-c86b-4af7-84a8-7522c5245649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:50.642313 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-48ebf4a1-c86b-4af7-84a8-7522c5245649 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:27:50.643687 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-48ebf4a1-c86b-4af7-84a8-7522c5245649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:27:50.684676 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a6ad89-70e9-4761-81ab-e35e6e3b930e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:27:50.685976 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6ad89-70e9-4761-81ab-e35e6e3b930e admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:50.686192 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6ad89-70e9-4761-81ab-e35e6e3b930e admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:50.686469 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6ad89-70e9-4761-81ab-e35e6e3b930e admin admin] PATH_INFO: `/v3/projects/9d963ff698954272aef40203c8f54ec1` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:50.688144 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a6ad89-70e9-4761-81ab-e35e6e3b930e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d963ff698954272aef40203c8f54ec1)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:27:50.691060 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a6ad89-70e9-4761-81ab-e35e6e3b930e admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:27:50.708022 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1125/2253] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:27:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:27:50.717427 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ebf4a1-c86b-4af7-84a8-7522c5245649 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:27:50.718859 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-48ebf4a1-c86b-4af7-84a8-7522c5245649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:27:50.773853 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ebf4a1-c86b-4af7-84a8-7522c5245649 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:27:50.777787 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c43a8f-8ac1-4689-a58d-7dcbb4c798a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:27:50.778423 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c43a8f-8ac1-4689-a58d-7dcbb4c798a2 service neutron] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:50.778698 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c43a8f-8ac1-4689-a58d-7dcbb4c798a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:50.778973 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c43a8f-8ac1-4689-a58d-7dcbb4c798a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:50.788794 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c43a8f-8ac1-4689-a58d-7dcbb4c798a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:27:50.790184 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c43a8f-8ac1-4689-a58d-7dcbb4c798a2 service neutron] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:27:50.800656 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1126/2254] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:27:50 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 18:27:50.805863 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-c9a6ad89-70e9-4761-81ab-e35e6e3b930e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d963ff698954272aef40203c8f54ec1', 'request_id': 'req-c9a6ad89-70e9-4761-81ab-e35e6e3b930e'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:50.813536 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-c9a6ad89-70e9-4761-81ab-e35e6e3b930e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d963ff698954272aef40203c8f54ec1', 'request_id': 'req-c9a6ad89-70e9-4761-81ab-e35e6e3b930e'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:50.820292 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-c9a6ad89-70e9-4761-81ab-e35e6e3b930e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d963ff698954272aef40203c8f54ec1', 'request_id': 'req-c9a6ad89-70e9-4761-81ab-e35e6e3b930e'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:50.941175 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-c9a6ad89-70e9-4761-81ab-e35e6e3b930e admin admin] The token cache is being invalidate because project 9d963ff698954272aef40203c8f54ec1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74005) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:27:50.941585 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-c9a6ad89-70e9-4761-81ab-e35e6e3b930e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:50.942736 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-c9a6ad89-70e9-4761-81ab-e35e6e3b930e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:27:50.946238 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1129/2255] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:27:50 2021] DELETE /identity/v3/projects/9d963ff698954272aef40203c8f54ec1 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:27:50.953242 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a225b4-182c-4a4e-8ca9-e46fe3865d61 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:50.953524 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a225b4-182c-4a4e-8ca9-e46fe3865d61 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:50.953799 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a225b4-182c-4a4e-8ca9-e46fe3865d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:50.980010 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-55a225b4-182c-4a4e-8ca9-e46fe3865d61 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:27:50.981264 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-55a225b4-182c-4a4e-8ca9-e46fe3865d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:27:51.066825 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1127/2256] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:27:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:27:51.077401 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11771c19-8526-4ee6-94e0-73cf56645c24 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:51.078034 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11771c19-8526-4ee6-94e0-73cf56645c24 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:51.078558 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11771c19-8526-4ee6-94e0-73cf56645c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:51.103125 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-11771c19-8526-4ee6-94e0-73cf56645c24 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:27:51.104893 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-11771c19-8526-4ee6-94e0-73cf56645c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:27:51.120359 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1130/2257] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:27:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:27:51.121695 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a225b4-182c-4a4e-8ca9-e46fe3865d61 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:27:51.132184 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a225b4-182c-4a4e-8ca9-e46fe3865d61 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:27:51.137172 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b11d4d0-ddb3-4fda-82f8-bb59c5146a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:27:51.137835 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b11d4d0-ddb3-4fda-82f8-bb59c5146a62 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:51.138133 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b11d4d0-ddb3-4fda-82f8-bb59c5146a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:51.138364 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b11d4d0-ddb3-4fda-82f8-bb59c5146a62 admin admin] PATH_INFO: `/v3/domains` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:51.139220 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b11d4d0-ddb3-4fda-82f8-bb59c5146a62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:27:51.139445 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b11d4d0-ddb3-4fda-82f8-bb59c5146a62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:27:51.141081 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b11d4d0-ddb3-4fda-82f8-bb59c5146a62 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:27:51.158464 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1128/2258] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 12 18:27:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:27:51.163982 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11771c19-8526-4ee6-94e0-73cf56645c24 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:27:51.174074 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11771c19-8526-4ee6-94e0-73cf56645c24 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:27:51.179382 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ced5d0-3ef1-48cb-8fcc-7b875e17a4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:27:51.180064 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ced5d0-3ef1-48cb-8fcc-7b875e17a4b1 admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:51.183823 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ced5d0-3ef1-48cb-8fcc-7b875e17a4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:51.183823 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ced5d0-3ef1-48cb-8fcc-7b875e17a4b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:51.183823 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ced5d0-3ef1-48cb-8fcc-7b875e17a4b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:27:51.183823 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ced5d0-3ef1-48cb-8fcc-7b875e17a4b1 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:27:51.297964 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1131/2259] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:27:51 2021] POST /identity/v3/projects => generated 371 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:27:51.302492 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b11d4d0-ddb3-4fda-82f8-bb59c5146a62 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:27:51.312561 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b11d4d0-ddb3-4fda-82f8-bb59c5146a62 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:27:51.369336 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed62912b-352f-4bda-9020-ca379e240ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:27:51.370012 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62912b-352f-4bda-9020-ca379e240ad3 admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:51.370293 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62912b-352f-4bda-9020-ca379e240ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:51.370562 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62912b-352f-4bda-9020-ca379e240ad3 admin admin] PATH_INFO: `/v3/users` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:51.371271 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed62912b-352f-4bda-9020-ca379e240ad3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:27:51.373220 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed62912b-352f-4bda-9020-ca379e240ad3 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:27:51.457119 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1129/2260] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:27:51 2021] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:27:51.460878 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ced5d0-3ef1-48cb-8fcc-7b875e17a4b1 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:27:51.474032 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ced5d0-3ef1-48cb-8fcc-7b875e17a4b1 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:27:51.480061 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1f2a6e-299e-4b82-a419-254d8758e9c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:27:51.480792 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f2a6e-299e-4b82-a419-254d8758e9c7 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:51.481074 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f2a6e-299e-4b82-a419-254d8758e9c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:51.481380 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f2a6e-299e-4b82-a419-254d8758e9c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:51.482187 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1f2a6e-299e-4b82-a419-254d8758e9c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:27:51.483819 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1f2a6e-299e-4b82-a419-254d8758e9c7 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:27:51.505270 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1132/2261] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:27:51 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 18:27:51.509529 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed62912b-352f-4bda-9020-ca379e240ad3 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:27:51.520104 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed62912b-352f-4bda-9020-ca379e240ad3 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:27:51.524901 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60716ff0-6d3e-4c0e-93f3-f09452b1dc18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:27:51.525563 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60716ff0-6d3e-4c0e-93f3-f09452b1dc18 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:51.526102 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60716ff0-6d3e-4c0e-93f3-f09452b1dc18 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:51.526374 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60716ff0-6d3e-4c0e-93f3-f09452b1dc18 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:51.527112 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60716ff0-6d3e-4c0e-93f3-f09452b1dc18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:27:51.528737 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60716ff0-6d3e-4c0e-93f3-f09452b1dc18 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:27:51.539342 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1130/2262] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:27:51 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 18:27:51.543720 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1f2a6e-299e-4b82-a419-254d8758e9c7 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:27:51.554372 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1f2a6e-299e-4b82-a419-254d8758e9c7 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:27:51.559125 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2de127-821f-4f9d-852e-2a488217a300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:27:51.559994 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2de127-821f-4f9d-852e-2a488217a300 admin admin] REQUEST_METHOD: `PUT` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:51.560270 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2de127-821f-4f9d-852e-2a488217a300 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:51.560574 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2de127-821f-4f9d-852e-2a488217a300 admin admin] PATH_INFO: `/v3/projects/38a1ca7b8f55456eb3c6946099885e5e/users/d6959ea6a5c642258bc40a8fe0c2b3ce/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:51.578113 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2de127-821f-4f9d-852e-2a488217a300 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38a1ca7b8f55456eb3c6946099885e5e, user_id=d6959ea6a5c642258bc40a8fe0c2b3ce, role_id=33b8a5a8d1d643f2a98f598e6ab0a1cf)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:27:51.581016 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2de127-821f-4f9d-852e-2a488217a300 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:27:51.677225 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1133/2263] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:27:51 2021] PUT /identity/v3/projects/38a1ca7b8f55456eb3c6946099885e5e/users/d6959ea6a5c642258bc40a8fe0c2b3ce/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:27:51.677850 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa2b49-27c6-4877-b12a-33ad97f3f66b None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:51.677850 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa2b49-27c6-4877-b12a-33ad97f3f66b None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:51.678129 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa2b49-27c6-4877-b12a-33ad97f3f66b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:51.698907 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-49fa2b49-27c6-4877-b12a-33ad97f3f66b None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:27:51.700259 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-49fa2b49-27c6-4877-b12a-33ad97f3f66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:27:51.762258 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1131/2264] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:27:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:27:51.774249 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2de127-821f-4f9d-852e-2a488217a300 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:27:51.776593 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-6f2de127-821f-4f9d-852e-2a488217a300 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:27:51.838174 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2de127-821f-4f9d-852e-2a488217a300 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:27:51.841855 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb622b6-1000-4e8e-8b34-7b86f80bff8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:27:51.842584 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb622b6-1000-4e8e-8b34-7b86f80bff8c service neutron] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:51.842819 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb622b6-1000-4e8e-8b34-7b86f80bff8c service neutron] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:51.843104 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb622b6-1000-4e8e-8b34-7b86f80bff8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:51.852763 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb622b6-1000-4e8e-8b34-7b86f80bff8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:27:51.854212 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb622b6-1000-4e8e-8b34-7b86f80bff8c service neutron] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:27:51.865393 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1134/2265] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:27:51 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:27:58.736721 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92266fdc-dda3-412a-b037-cd045726f925 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:58.737246 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92266fdc-dda3-412a-b037-cd045726f925 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:58.737246 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92266fdc-dda3-412a-b037-cd045726f925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:58.772214 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-92266fdc-dda3-412a-b037-cd045726f925 None None] MFA Rules not processed for user `9a37985dd5034ceeabfa47797efba5a1`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:27:58.773839 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-92266fdc-dda3-412a-b037-cd045726f925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:27:58.887718 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1132/2266] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:27:58 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:27:58.892939 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb622b6-1000-4e8e-8b34-7b86f80bff8c service neutron] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:27:58.897148 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-eeb622b6-1000-4e8e-8b34-7b86f80bff8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:27:58.919115 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb622b6-1000-4e8e-8b34-7b86f80bff8c service neutron] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:27:58.933020 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ced67-c8d9-4ed5-8f4b-2cb159eedd45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:27:58.939310 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ced67-c8d9-4ed5-8f4b-2cb159eedd45 admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:58.939310 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ced67-c8d9-4ed5-8f4b-2cb159eedd45 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:58.939310 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ced67-c8d9-4ed5-8f4b-2cb159eedd45 admin admin] PATH_INFO: `/v3/projects` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:58.939310 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1ced67-c8d9-4ed5-8f4b-2cb159eedd45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:27:58.941706 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1ced67-c8d9-4ed5-8f4b-2cb159eedd45 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:27:59.124486 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1135/2267] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:27:58 2021] POST /identity/v3/projects => generated 379 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:27:59.125830 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92266fdc-dda3-412a-b037-cd045726f925 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:27:59.168681 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92266fdc-dda3-412a-b037-cd045726f925 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:27:59.250353 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519468aa-f78b-4154-97ce-9324006f7a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:27:59.252371 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519468aa-f78b-4154-97ce-9324006f7a9e admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:59.252986 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519468aa-f78b-4154-97ce-9324006f7a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:59.253450 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519468aa-f78b-4154-97ce-9324006f7a9e admin admin] PATH_INFO: `/v3/users` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:59.255426 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519468aa-f78b-4154-97ce-9324006f7a9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:27:59.258385 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519468aa-f78b-4154-97ce-9324006f7a9e admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:27:59.357472 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1133/2268] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:27:59 2021] POST /identity/v3/users => generated 296 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:27:59.361526 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ced67-c8d9-4ed5-8f4b-2cb159eedd45 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:27:59.375169 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ced67-c8d9-4ed5-8f4b-2cb159eedd45 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:27:59.383738 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0291a2-7840-4526-9c46-f25f24167237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:27:59.384484 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0291a2-7840-4526-9c46-f25f24167237 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:59.384788 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0291a2-7840-4526-9c46-f25f24167237 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:59.385061 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0291a2-7840-4526-9c46-f25f24167237 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:59.386124 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0291a2-7840-4526-9c46-f25f24167237 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:27:59.392338 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0291a2-7840-4526-9c46-f25f24167237 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:27:59.414185 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1136/2269] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:27:59 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 18:27:59.418653 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519468aa-f78b-4154-97ce-9324006f7a9e admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:27:59.435268 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519468aa-f78b-4154-97ce-9324006f7a9e admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:27:59.456472 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc8d3ff-4641-421b-856b-b0afa50d528d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:27:59.457657 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc8d3ff-4641-421b-856b-b0afa50d528d admin admin] REQUEST_METHOD: `PUT` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:59.458009 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc8d3ff-4641-421b-856b-b0afa50d528d admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:59.458352 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc8d3ff-4641-421b-856b-b0afa50d528d admin admin] PATH_INFO: `/v3/projects/013389300c86431d9fabe0d5bc4222b0/users/72f30704253948c187ba4a4b0747435c/roles/6c54f239944d46e3b027ccce97eb8b49` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:59.492298 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc8d3ff-4641-421b-856b-b0afa50d528d admin admin] RBAC: Authorizing `identity:create_grant(project_id=013389300c86431d9fabe0d5bc4222b0, user_id=72f30704253948c187ba4a4b0747435c, role_id=6c54f239944d46e3b027ccce97eb8b49)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:27:59.495690 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc8d3ff-4641-421b-856b-b0afa50d528d admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:27:59.622966 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1134/2270] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:27:59 2021] PUT /identity/v3/projects/013389300c86431d9fabe0d5bc4222b0/users/72f30704253948c187ba4a4b0747435c/roles/6c54f239944d46e3b027ccce97eb8b49 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:27:59.633987 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0291a2-7840-4526-9c46-f25f24167237 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:27:59.650683 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0291a2-7840-4526-9c46-f25f24167237 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:27:59.765252 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3d238b-748f-4b1c-95cd-bfde7a35be28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:27:59.775674 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d238b-748f-4b1c-95cd-bfde7a35be28 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:59.776239 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d238b-748f-4b1c-95cd-bfde7a35be28 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:59.776822 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d238b-748f-4b1c-95cd-bfde7a35be28 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:59.777626 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3d238b-748f-4b1c-95cd-bfde7a35be28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:27:59.779314 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3d238b-748f-4b1c-95cd-bfde7a35be28 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:27:59.793126 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1137/2271] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:27:59 2021] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:27:59.797014 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc8d3ff-4641-421b-856b-b0afa50d528d admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:27:59.816085 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc8d3ff-4641-421b-856b-b0afa50d528d admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:27:59.833950 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2f9333-3ff7-47ad-b1fb-0552b80a5c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:27:59.837999 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2f9333-3ff7-47ad-b1fb-0552b80a5c54 admin admin] REQUEST_METHOD: `PUT` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:27:59.838567 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2f9333-3ff7-47ad-b1fb-0552b80a5c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:27:59.839072 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2f9333-3ff7-47ad-b1fb-0552b80a5c54 admin admin] PATH_INFO: `/v3/projects/013389300c86431d9fabe0d5bc4222b0/users/72f30704253948c187ba4a4b0747435c/roles/6c54f239944d46e3b027ccce97eb8b49` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:27:59.847543 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2f9333-3ff7-47ad-b1fb-0552b80a5c54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=013389300c86431d9fabe0d5bc4222b0, user_id=72f30704253948c187ba4a4b0747435c, role_id=6c54f239944d46e3b027ccce97eb8b49)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:27:59.851200 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2f9333-3ff7-47ad-b1fb-0552b80a5c54 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:27:59.882679 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1135/2272] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:27:59 2021] PUT /identity/v3/projects/013389300c86431d9fabe0d5bc4222b0/users/72f30704253948c187ba4a4b0747435c/roles/6c54f239944d46e3b027ccce97eb8b49 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:28:00.417034 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f70d7e-bea6-4129-86ed-b3485b1ca394 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:28:00.417478 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f70d7e-bea6-4129-86ed-b3485b1ca394 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:28:00.417571 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f70d7e-bea6-4129-86ed-b3485b1ca394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:28:00.460216 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-33f70d7e-bea6-4129-86ed-b3485b1ca394 None None] MFA Rules not processed for user `d6959ea6a5c642258bc40a8fe0c2b3ce`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:28:00.461571 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-33f70d7e-bea6-4129-86ed-b3485b1ca394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:28:00.591484 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1138/2273] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:28:00 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:28:00.592992 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2f9333-3ff7-47ad-b1fb-0552b80a5c54 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:28:00.698050 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2f9333-3ff7-47ad-b1fb-0552b80a5c54 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:28:00.719543 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cefd210-dc15-41cb-a081-70a1e650b782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:28:00.721856 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cefd210-dc15-41cb-a081-70a1e650b782 admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:28:00.722144 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cefd210-dc15-41cb-a081-70a1e650b782 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:28:00.722421 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cefd210-dc15-41cb-a081-70a1e650b782 admin admin] PATH_INFO: `/v3/projects` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:28:00.723157 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cefd210-dc15-41cb-a081-70a1e650b782 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:28:00.734697 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cefd210-dc15-41cb-a081-70a1e650b782 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:28:00.821773 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f70d7e-bea6-4129-86ed-b3485b1ca394 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:28:00.828824 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1136/2274] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:28:00 2021] POST /identity/v3/projects => generated 373 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 18:28:00.834924 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f70d7e-bea6-4129-86ed-b3485b1ca394 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:28:00.976209 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4e3c68-0dc4-42df-a47c-dcc8c17cd8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:28:00.977629 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e3c68-0dc4-42df-a47c-dcc8c17cd8ad admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:28:00.979194 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e3c68-0dc4-42df-a47c-dcc8c17cd8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:28:00.979687 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e3c68-0dc4-42df-a47c-dcc8c17cd8ad admin admin] PATH_INFO: `/v3/users` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:28:00.981171 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4e3c68-0dc4-42df-a47c-dcc8c17cd8ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:28:00.985670 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4e3c68-0dc4-42df-a47c-dcc8c17cd8ad admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:28:01.168151 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cefd210-dc15-41cb-a081-70a1e650b782 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:28:01.189171 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1139/2275] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:28:00 2021] POST /identity/v3/users => generated 293 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:28:01.197909 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cefd210-dc15-41cb-a081-70a1e650b782 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:28:01.226252 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feaa053-e653-4038-aa90-d2149fe080e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:28:01.227332 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feaa053-e653-4038-aa90-d2149fe080e2 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:28:01.227826 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feaa053-e653-4038-aa90-d2149fe080e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:28:01.228328 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feaa053-e653-4038-aa90-d2149fe080e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:28:01.229745 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feaa053-e653-4038-aa90-d2149fe080e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:28:01.231603 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feaa053-e653-4038-aa90-d2149fe080e2 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:28:01.261132 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1137/2276] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:28:01 2021] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:28:01.263522 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4e3c68-0dc4-42df-a47c-dcc8c17cd8ad admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:28:01.285872 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4e3c68-0dc4-42df-a47c-dcc8c17cd8ad admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:28:01.304484 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16c7711-f21d-4beb-a15c-7d21aea53a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:28:01.316933 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c7711-f21d-4beb-a15c-7d21aea53a80 admin admin] REQUEST_METHOD: `PUT` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:28:01.319985 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c7711-f21d-4beb-a15c-7d21aea53a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:28:01.320557 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c7711-f21d-4beb-a15c-7d21aea53a80 admin admin] PATH_INFO: `/v3/projects/31e826e73cd747eba516dd786f63bc90/users/a5ab3098aa7a41698260180bf0ed0be4/roles/6c54f239944d46e3b027ccce97eb8b49` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:28:01.360542 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16c7711-f21d-4beb-a15c-7d21aea53a80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31e826e73cd747eba516dd786f63bc90, user_id=a5ab3098aa7a41698260180bf0ed0be4, role_id=6c54f239944d46e3b027ccce97eb8b49)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:28:01.377701 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16c7711-f21d-4beb-a15c-7d21aea53a80 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:28:01.482702 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1140/2277] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:28:01 2021] PUT /identity/v3/projects/31e826e73cd747eba516dd786f63bc90/users/a5ab3098aa7a41698260180bf0ed0be4/roles/6c54f239944d46e3b027ccce97eb8b49 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:28:01.483956 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feaa053-e653-4038-aa90-d2149fe080e2 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:28:01.494170 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feaa053-e653-4038-aa90-d2149fe080e2 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:28:01.568798 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16c7711-f21d-4beb-a15c-7d21aea53a80 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:28:01.571222 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-a16c7711-f21d-4beb-a15c-7d21aea53a80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:28:01.600059 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b519ceb4-4b50-4236-a275-9600a28395d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:28:01.607082 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519ceb4-4b50-4236-a275-9600a28395d9 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:28:01.607674 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519ceb4-4b50-4236-a275-9600a28395d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:28:01.608920 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519ceb4-4b50-4236-a275-9600a28395d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:28:01.609312 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b519ceb4-4b50-4236-a275-9600a28395d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:28:01.611219 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b519ceb4-4b50-4236-a275-9600a28395d9 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:28:01.629515 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1138/2278] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:28:01 2021] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:28:01.634873 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b519ceb4-4b50-4236-a275-9600a28395d9 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:28:01.649016 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b519ceb4-4b50-4236-a275-9600a28395d9 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:28:01.659030 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff91de9-260b-41a7-9ce7-154335302b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:28:01.659730 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff91de9-260b-41a7-9ce7-154335302b2b admin admin] REQUEST_METHOD: `PUT` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:28:01.660198 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff91de9-260b-41a7-9ce7-154335302b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:28:01.662405 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff91de9-260b-41a7-9ce7-154335302b2b admin admin] PATH_INFO: `/v3/projects/31e826e73cd747eba516dd786f63bc90/users/a5ab3098aa7a41698260180bf0ed0be4/roles/6c54f239944d46e3b027ccce97eb8b49` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:28:01.675882 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff91de9-260b-41a7-9ce7-154335302b2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=31e826e73cd747eba516dd786f63bc90, user_id=a5ab3098aa7a41698260180bf0ed0be4, role_id=6c54f239944d46e3b027ccce97eb8b49)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:28:01.682403 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff91de9-260b-41a7-9ce7-154335302b2b admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:28:01.687500 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16c7711-f21d-4beb-a15c-7d21aea53a80 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:28:01.693445 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77c0de-6b56-4177-bc5b-825d44f2bc76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:28:01.694759 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77c0de-6b56-4177-bc5b-825d44f2bc76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:28:01.695234 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77c0de-6b56-4177-bc5b-825d44f2bc76 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:28:01.695783 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77c0de-6b56-4177-bc5b-825d44f2bc76 admin admin] PATH_INFO: `/v3/users/385ca42ad77c4cafad79134fceb55779` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:28:01.697347 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a77c0de-6b56-4177-bc5b-825d44f2bc76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=385ca42ad77c4cafad79134fceb55779)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:28:01.700052 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a77c0de-6b56-4177-bc5b-825d44f2bc76 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:28:01.714618 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1139/2279] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:28:01 2021] PUT /identity/v3/projects/31e826e73cd747eba516dd786f63bc90/users/a5ab3098aa7a41698260180bf0ed0be4/roles/6c54f239944d46e3b027ccce97eb8b49 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 18:28:02.027015 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-9a77c0de-6b56-4177-bc5b-825d44f2bc76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '385ca42ad77c4cafad79134fceb55779'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:28:02.027776 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-9a77c0de-6b56-4177-bc5b-825d44f2bc76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '385ca42ad77c4cafad79134fceb55779'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:28:02.075167 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-9a77c0de-6b56-4177-bc5b-825d44f2bc76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '385ca42ad77c4cafad79134fceb55779'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:28:02.077105 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-9a77c0de-6b56-4177-bc5b-825d44f2bc76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '385ca42ad77c4cafad79134fceb55779'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:28:02.097417 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-9a77c0de-6b56-4177-bc5b-825d44f2bc76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '385ca42ad77c4cafad79134fceb55779'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:28:02.226897 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1141/2280] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:28:01 2021] DELETE /identity/v3/users/385ca42ad77c4cafad79134fceb55779 => generated 0 bytes in 656 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 18:28:02.228630 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f20bd-c641-47d3-8ba3-7829811141cc None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:28:02.229069 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f20bd-c641-47d3-8ba3-7829811141cc None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:28:02.229184 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f20bd-c641-47d3-8ba3-7829811141cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:28:02.257469 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-b96f20bd-c641-47d3-8ba3-7829811141cc None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:28:02.259036 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-b96f20bd-c641-47d3-8ba3-7829811141cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:28:02.392952 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1140/2281] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:28:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:28:02.403145 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77c0de-6b56-4177-bc5b-825d44f2bc76 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:28:02.406188 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-9a77c0de-6b56-4177-bc5b-825d44f2bc76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:28:02.524105 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77c0de-6b56-4177-bc5b-825d44f2bc76 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:28:02.529466 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c3489f-7da3-4fae-be21-2a55a4611489 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:28:02.530471 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c3489f-7da3-4fae-be21-2a55a4611489 service neutron] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:28:02.531103 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c3489f-7da3-4fae-be21-2a55a4611489 service neutron] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:28:02.531685 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c3489f-7da3-4fae-be21-2a55a4611489 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:28:02.544923 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c3489f-7da3-4fae-be21-2a55a4611489 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:28:02.549228 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c3489f-7da3-4fae-be21-2a55a4611489 service neutron] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:28:02.569615 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1142/2282] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:28:02 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:28:03.336743 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96f20bd-c641-47d3-8ba3-7829811141cc None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:28:03.339171 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-b96f20bd-c641-47d3-8ba3-7829811141cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:28:03.371768 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96f20bd-c641-47d3-8ba3-7829811141cc None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:28:03.379629 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691da0eb-f9cd-469d-883a-33f787c77d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:28:03.380578 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691da0eb-f9cd-469d-883a-33f787c77d84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:28:03.380866 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691da0eb-f9cd-469d-883a-33f787c77d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:28:03.381145 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691da0eb-f9cd-469d-883a-33f787c77d84 admin admin] PATH_INFO: `/v3/projects/e7dda566af7549639a88fae453164814` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:28:03.382894 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691da0eb-f9cd-469d-883a-33f787c77d84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7dda566af7549639a88fae453164814)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:28:03.386268 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691da0eb-f9cd-469d-883a-33f787c77d84 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:28:03.636064 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-691da0eb-f9cd-469d-883a-33f787c77d84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7dda566af7549639a88fae453164814', 'request_id': 'req-691da0eb-f9cd-469d-883a-33f787c77d84'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:28:03.770813 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-691da0eb-f9cd-469d-883a-33f787c77d84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7dda566af7549639a88fae453164814', 'request_id': 'req-691da0eb-f9cd-469d-883a-33f787c77d84'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:28:03.784325 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-691da0eb-f9cd-469d-883a-33f787c77d84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7dda566af7549639a88fae453164814', 'request_id': 'req-691da0eb-f9cd-469d-883a-33f787c77d84'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:28:03.806726 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-691da0eb-f9cd-469d-883a-33f787c77d84 admin admin] The token cache is being invalidate because project e7dda566af7549639a88fae453164814 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:28:03.807275 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-691da0eb-f9cd-469d-883a-33f787c77d84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:28:03.808282 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-691da0eb-f9cd-469d-883a-33f787c77d84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:28:03.813357 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1141/2283] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:28:03 2021] DELETE /identity/v3/projects/e7dda566af7549639a88fae453164814 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:28:03.819913 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4a8097-40df-40ec-966e-a08748cd7d21 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:28:03.820540 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4a8097-40df-40ec-966e-a08748cd7d21 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:28:03.820540 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4a8097-40df-40ec-966e-a08748cd7d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:28:03.867581 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-9e4a8097-40df-40ec-966e-a08748cd7d21 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:28:03.869313 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-9e4a8097-40df-40ec-966e-a08748cd7d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:28:03.962562 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1143/2284] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:28:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:28:03.978280 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f93bff2-624d-419a-a2b5-fa2689f54673 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:28:03.978777 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f93bff2-624d-419a-a2b5-fa2689f54673 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:28:03.979264 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f93bff2-624d-419a-a2b5-fa2689f54673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:28:04.015406 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-6f93bff2-624d-419a-a2b5-fa2689f54673 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:28:04.017578 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-6f93bff2-624d-419a-a2b5-fa2689f54673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:28:04.036545 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1142/2285] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:28:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:28:04.038423 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4a8097-40df-40ec-966e-a08748cd7d21 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:28:04.057222 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4a8097-40df-40ec-966e-a08748cd7d21 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:28:04.066608 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cbc343-cae8-4f86-90d4-9a15c0fd519f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:28:04.067954 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cbc343-cae8-4f86-90d4-9a15c0fd519f admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:28:04.068518 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cbc343-cae8-4f86-90d4-9a15c0fd519f admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:28:04.069088 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cbc343-cae8-4f86-90d4-9a15c0fd519f admin admin] PATH_INFO: `/v3/domains` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:28:04.070744 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cbc343-cae8-4f86-90d4-9a15c0fd519f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:28:04.071369 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cbc343-cae8-4f86-90d4-9a15c0fd519f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:28:04.074447 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cbc343-cae8-4f86-90d4-9a15c0fd519f admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:28:04.098535 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1144/2286] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 12 18:28:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:28:04.105886 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f93bff2-624d-419a-a2b5-fa2689f54673 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:28:04.124257 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f93bff2-624d-419a-a2b5-fa2689f54673 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:28:04.133306 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb24686f-6c55-4238-85d7-bdfa17bde80e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:28:04.134621 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb24686f-6c55-4238-85d7-bdfa17bde80e admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:28:04.135472 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb24686f-6c55-4238-85d7-bdfa17bde80e admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:28:04.136038 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb24686f-6c55-4238-85d7-bdfa17bde80e admin admin] PATH_INFO: `/v3/projects` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:28:04.137537 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb24686f-6c55-4238-85d7-bdfa17bde80e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:28:04.142140 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb24686f-6c55-4238-85d7-bdfa17bde80e admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:28:04.248467 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1143/2287] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:28:04 2021] POST /identity/v3/projects => generated 385 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 18:28:04.249963 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cbc343-cae8-4f86-90d4-9a15c0fd519f admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:28:04.260315 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cbc343-cae8-4f86-90d4-9a15c0fd519f admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:28:04.342945 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb6d3fa-0904-4037-9694-230de06dc230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:28:04.344383 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb6d3fa-0904-4037-9694-230de06dc230 admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:28:04.345671 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb6d3fa-0904-4037-9694-230de06dc230 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:28:04.346218 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb6d3fa-0904-4037-9694-230de06dc230 admin admin] PATH_INFO: `/v3/users` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:28:04.347720 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb6d3fa-0904-4037-9694-230de06dc230 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:28:04.351559 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb6d3fa-0904-4037-9694-230de06dc230 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:28:04.457261 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1145/2288] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:28:04 2021] POST /identity/v3/users => generated 293 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:28:04.458730 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb24686f-6c55-4238-85d7-bdfa17bde80e admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:28:04.474908 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb24686f-6c55-4238-85d7-bdfa17bde80e admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:28:04.486021 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf780b8-d70e-4810-a6e8-ab6c53be50a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:28:04.488357 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf780b8-d70e-4810-a6e8-ab6c53be50a9 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:28:04.489143 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf780b8-d70e-4810-a6e8-ab6c53be50a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:28:04.489633 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf780b8-d70e-4810-a6e8-ab6c53be50a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:28:04.490676 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf780b8-d70e-4810-a6e8-ab6c53be50a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:28:04.493017 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf780b8-d70e-4810-a6e8-ab6c53be50a9 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:28:04.509222 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1144/2289] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:28:04 2021] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:28:04.513900 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb6d3fa-0904-4037-9694-230de06dc230 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:28:04.535445 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb6d3fa-0904-4037-9694-230de06dc230 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:28:04.553896 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d4261c-4eed-418d-9f24-59201d9ec27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:28:04.555802 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d4261c-4eed-418d-9f24-59201d9ec27e admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:28:04.556096 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d4261c-4eed-418d-9f24-59201d9ec27e admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:28:04.556374 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d4261c-4eed-418d-9f24-59201d9ec27e admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:28:04.557280 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d4261c-4eed-418d-9f24-59201d9ec27e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:28:04.558998 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d4261c-4eed-418d-9f24-59201d9ec27e admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:28:04.576775 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1146/2290] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:28:04 2021] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:28:04.577518 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf780b8-d70e-4810-a6e8-ab6c53be50a9 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:28:04.600054 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf780b8-d70e-4810-a6e8-ab6c53be50a9 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:28:04.608197 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c927a-9e95-4150-8fb1-a30dec943716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:28:04.609280 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c927a-9e95-4150-8fb1-a30dec943716 admin admin] REQUEST_METHOD: `PUT` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:28:04.609761 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c927a-9e95-4150-8fb1-a30dec943716 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:28:04.610148 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c927a-9e95-4150-8fb1-a30dec943716 admin admin] PATH_INFO: `/v3/projects/32d30b7ccd2e42689bd0eaa03815b3b3/users/557c1bf6eab6402f98aa4fcd02606521/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:28:04.654978 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402c927a-9e95-4150-8fb1-a30dec943716 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32d30b7ccd2e42689bd0eaa03815b3b3, user_id=557c1bf6eab6402f98aa4fcd02606521, role_id=33b8a5a8d1d643f2a98f598e6ab0a1cf)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:28:04.658207 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402c927a-9e95-4150-8fb1-a30dec943716 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:28:04.731764 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1145/2291] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:28:04 2021] PUT /identity/v3/projects/32d30b7ccd2e42689bd0eaa03815b3b3/users/557c1bf6eab6402f98aa4fcd02606521/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:28:04.745156 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe3b8b-f081-4ff8-b65e-810d1c39c2cc None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:28:04.745506 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe3b8b-f081-4ff8-b65e-810d1c39c2cc None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:28:04.745712 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe3b8b-f081-4ff8-b65e-810d1c39c2cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:28:04.792113 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-dafe3b8b-f081-4ff8-b65e-810d1c39c2cc None None] MFA Rules not processed for user `557c1bf6eab6402f98aa4fcd02606521`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:28:04.793502 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-dafe3b8b-f081-4ff8-b65e-810d1c39c2cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:28:04.921539 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1147/2292] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:28:04 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:28:04.933756 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c927a-9e95-4150-8fb1-a30dec943716 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:28:04.936374 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-402c927a-9e95-4150-8fb1-a30dec943716 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:28:05.144468 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c927a-9e95-4150-8fb1-a30dec943716 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:28:05.156304 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e425903e-780c-4746-b44f-1613ad172e17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6966ce0774f4437a9b688494e9d0574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:28:05.157151 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425903e-780c-4746-b44f-1613ad172e17 service cinder] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:28:05.158650 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425903e-780c-4746-b44f-1613ad172e17 service cinder] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:28:05.158650 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425903e-780c-4746-b44f-1613ad172e17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:28:05.190619 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e425903e-780c-4746-b44f-1613ad172e17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:28:05.192525 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e425903e-780c-4746-b44f-1613ad172e17 service cinder] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:28:05.213325 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1146/2293] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:28:04 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:28:08.787800 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafe3b8b-f081-4ff8-b65e-810d1c39c2cc None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:28:08.976353 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafe3b8b-f081-4ff8-b65e-810d1c39c2cc None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:28:08.983196 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf62ab3d-74a1-4411-91ad-9059ed62d6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:28:08.984521 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62ab3d-74a1-4411-91ad-9059ed62d6d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:28:08.985025 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62ab3d-74a1-4411-91ad-9059ed62d6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:28:08.985547 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62ab3d-74a1-4411-91ad-9059ed62d6d1 admin admin] PATH_INFO: `/v3/users/557c1bf6eab6402f98aa4fcd02606521` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:28:08.987448 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf62ab3d-74a1-4411-91ad-9059ed62d6d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=557c1bf6eab6402f98aa4fcd02606521)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:28:08.989930 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf62ab3d-74a1-4411-91ad-9059ed62d6d1 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:28:09.251916 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-cf62ab3d-74a1-4411-91ad-9059ed62d6d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '557c1bf6eab6402f98aa4fcd02606521'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:28:09.253844 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-cf62ab3d-74a1-4411-91ad-9059ed62d6d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '557c1bf6eab6402f98aa4fcd02606521'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:28:09.297224 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-cf62ab3d-74a1-4411-91ad-9059ed62d6d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '557c1bf6eab6402f98aa4fcd02606521'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:28:09.301041 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-cf62ab3d-74a1-4411-91ad-9059ed62d6d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '557c1bf6eab6402f98aa4fcd02606521'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:28:09.322603 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-cf62ab3d-74a1-4411-91ad-9059ed62d6d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '557c1bf6eab6402f98aa4fcd02606521'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:28:09.449475 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1148/2294] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:28:08 2021] DELETE /identity/v3/users/557c1bf6eab6402f98aa4fcd02606521 => generated 0 bytes in 659 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:28:09.450872 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb95a77-8b9d-4691-9e13-4a4229f08452 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:28:09.451347 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb95a77-8b9d-4691-9e13-4a4229f08452 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:28:09.451429 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb95a77-8b9d-4691-9e13-4a4229f08452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:28:09.504949 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-edb95a77-8b9d-4691-9e13-4a4229f08452 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:28:09.506531 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-edb95a77-8b9d-4691-9e13-4a4229f08452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:28:09.680655 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1147/2295] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:28:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:28:09.702124 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf62ab3d-74a1-4411-91ad-9059ed62d6d1 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:28:09.703645 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-cf62ab3d-74a1-4411-91ad-9059ed62d6d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:28:09.823136 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf62ab3d-74a1-4411-91ad-9059ed62d6d1 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:28:09.843152 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59b5c63-3741-4d5b-859e-3f900e03d2b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:28:09.846549 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b5c63-3741-4d5b-859e-3f900e03d2b2 service neutron] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:28:09.847037 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b5c63-3741-4d5b-859e-3f900e03d2b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:28:09.847626 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b5c63-3741-4d5b-859e-3f900e03d2b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:28:09.861311 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59b5c63-3741-4d5b-859e-3f900e03d2b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:28:09.868313 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59b5c63-3741-4d5b-859e-3f900e03d2b2 service neutron] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:28:09.914872 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1149/2296] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:28:09 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:28:10.252718 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcdf382-6a05-435b-bf67-bc4cc60cc43d None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:28:10.253192 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcdf382-6a05-435b-bf67-bc4cc60cc43d None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:28:10.253629 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcdf382-6a05-435b-bf67-bc4cc60cc43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:28:10.301564 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-2dcdf382-6a05-435b-bf67-bc4cc60cc43d None None] MFA Rules not processed for user `72f30704253948c187ba4a4b0747435c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:28:10.302922 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-2dcdf382-6a05-435b-bf67-bc4cc60cc43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:28:10.458928 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1148/2297] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:28:10 2021] POST /identity/v3/auth/tokens => generated 3466 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:28:10.471066 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59b5c63-3741-4d5b-859e-3f900e03d2b2 service neutron] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:28:10.472816 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-f59b5c63-3741-4d5b-859e-3f900e03d2b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:28:10.581258 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59b5c63-3741-4d5b-859e-3f900e03d2b2 service neutron] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:28:10.595582 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcdf382-6a05-435b-bf67-bc4cc60cc43d None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:28:10.597052 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-2dcdf382-6a05-435b-bf67-bc4cc60cc43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:28:10.612956 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad27174-e32e-4b17-b6c3-d29dc3ea0f17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3417097a280b499086b36df9a2548239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:28:10.614776 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad27174-e32e-4b17-b6c3-d29dc3ea0f17 service nova] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:28:10.614776 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad27174-e32e-4b17-b6c3-d29dc3ea0f17 service nova] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:28:10.614776 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad27174-e32e-4b17-b6c3-d29dc3ea0f17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:28:10.620567 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-1ad27174-e32e-4b17-b6c3-d29dc3ea0f17 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:28:10.625214 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcdf382-6a05-435b-bf67-bc4cc60cc43d None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:28:10.647331 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3889af-89d6-4bc9-9bb1-18b68fa6b566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:28:10.648217 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3889af-89d6-4bc9-9bb1-18b68fa6b566 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:28:10.648615 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3889af-89d6-4bc9-9bb1-18b68fa6b566 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:28:10.648960 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3889af-89d6-4bc9-9bb1-18b68fa6b566 admin admin] PATH_INFO: `/v3/projects/32d30b7ccd2e42689bd0eaa03815b3b3` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:28:10.656004 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3889af-89d6-4bc9-9bb1-18b68fa6b566 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32d30b7ccd2e42689bd0eaa03815b3b3)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:28:10.666480 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3889af-89d6-4bc9-9bb1-18b68fa6b566 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:28:10.733845 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad27174-e32e-4b17-b6c3-d29dc3ea0f17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:28:10.736691 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad27174-e32e-4b17-b6c3-d29dc3ea0f17 service nova] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:28:10.761465 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1150/2298] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:28:10 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:28:10.839140 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-2b3889af-89d6-4bc9-9bb1-18b68fa6b566 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32d30b7ccd2e42689bd0eaa03815b3b3', 'request_id': 'req-2b3889af-89d6-4bc9-9bb1-18b68fa6b566'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:28:10.924621 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-2b3889af-89d6-4bc9-9bb1-18b68fa6b566 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32d30b7ccd2e42689bd0eaa03815b3b3', 'request_id': 'req-2b3889af-89d6-4bc9-9bb1-18b68fa6b566'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:28:10.943747 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-2b3889af-89d6-4bc9-9bb1-18b68fa6b566 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32d30b7ccd2e42689bd0eaa03815b3b3', 'request_id': 'req-2b3889af-89d6-4bc9-9bb1-18b68fa6b566'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:28:10.961791 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-2b3889af-89d6-4bc9-9bb1-18b68fa6b566 admin admin] The token cache is being invalidate because project 32d30b7ccd2e42689bd0eaa03815b3b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:28:10.962676 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-2b3889af-89d6-4bc9-9bb1-18b68fa6b566 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:28:10.966675 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-2b3889af-89d6-4bc9-9bb1-18b68fa6b566 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:28:10.970870 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1149/2299] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:28:10 2021] DELETE /identity/v3/projects/32d30b7ccd2e42689bd0eaa03815b3b3 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 18:28:11.825891 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55784ea0-8336-4212-b632-d399f0adfac2 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:28:11.826402 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55784ea0-8336-4212-b632-d399f0adfac2 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:28:11.826483 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55784ea0-8336-4212-b632-d399f0adfac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:28:11.864364 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-55784ea0-8336-4212-b632-d399f0adfac2 None None] MFA Rules not processed for user `a5ab3098aa7a41698260180bf0ed0be4`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:28:11.867365 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-55784ea0-8336-4212-b632-d399f0adfac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:28:11.980459 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1151/2300] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:28:11 2021] POST /identity/v3/auth/tokens => generated 3460 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:28:11.996387 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3889af-89d6-4bc9-9bb1-18b68fa6b566 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:28:11.998143 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-2b3889af-89d6-4bc9-9bb1-18b68fa6b566 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:28:12.083865 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3889af-89d6-4bc9-9bb1-18b68fa6b566 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:28:12.090836 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7522aec2-2c0a-4fe2-a781-a3a3e175f08f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3417097a280b499086b36df9a2548239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:28:12.091506 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7522aec2-2c0a-4fe2-a781-a3a3e175f08f service nova] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:28:12.091794 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7522aec2-2c0a-4fe2-a781-a3a3e175f08f service nova] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:28:12.092062 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7522aec2-2c0a-4fe2-a781-a3a3e175f08f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:28:12.094215 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-7522aec2-2c0a-4fe2-a781-a3a3e175f08f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:28:12.191874 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7522aec2-2c0a-4fe2-a781-a3a3e175f08f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:28:12.194034 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7522aec2-2c0a-4fe2-a781-a3a3e175f08f service nova] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:28:12.216786 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1150/2301] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:28:11 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:28:16.071132 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f784d9-d30e-4434-a642-ee18267c2a6b None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:28:16.071600 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f784d9-d30e-4434-a642-ee18267c2a6b None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:28:16.071757 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f784d9-d30e-4434-a642-ee18267c2a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:28:16.090990 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-79f784d9-d30e-4434-a642-ee18267c2a6b None None] MFA Rules not processed for user `d6959ea6a5c642258bc40a8fe0c2b3ce`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:28:16.092583 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-79f784d9-d30e-4434-a642-ee18267c2a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:28:16.101665 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1152/2302] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:28:16 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:28:44.748073 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7522aec2-2c0a-4fe2-a781-a3a3e175f08f service nova] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:28:44.749874 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-7522aec2-2c0a-4fe2-a781-a3a3e175f08f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:28:44.839541 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7522aec2-2c0a-4fe2-a781-a3a3e175f08f service nova] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:28:44.844899 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970071d-5de9-4417-8538-bbe797026ec5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bd99e4f2d444a388ecde7ea3cb61089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:28:44.845494 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970071d-5de9-4417-8538-bbe797026ec5 service placement] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:28:44.845780 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970071d-5de9-4417-8538-bbe797026ec5 service placement] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:28:44.846060 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970071d-5de9-4417-8538-bbe797026ec5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:28:44.848306 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-4970071d-5de9-4417-8538-bbe797026ec5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:28:44.861106 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4970071d-5de9-4417-8538-bbe797026ec5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:28:44.863314 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4970071d-5de9-4417-8538-bbe797026ec5 service placement] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:28:44.880252 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1151/2303] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:28:44 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:28:45.746054 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8aeab-12a6-4a8a-8258-cb3d0061a204 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:28:45.746613 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8aeab-12a6-4a8a-8258-cb3d0061a204 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:28:45.746613 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8aeab-12a6-4a8a-8258-cb3d0061a204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:28:45.807010 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-b5c8aeab-12a6-4a8a-8258-cb3d0061a204 None None] MFA Rules not processed for user `8f6a3a7064754fb79a0a06b3ad4a7d05`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:28:45.808232 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-b5c8aeab-12a6-4a8a-8258-cb3d0061a204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:28:45.877123 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1153/2304] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Oct 12 18:28:45 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:28:45.921539 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970071d-5de9-4417-8538-bbe797026ec5 service placement] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:28:45.922853 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-4970071d-5de9-4417-8538-bbe797026ec5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:28:46.034900 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970071d-5de9-4417-8538-bbe797026ec5 service placement] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:28:46.040675 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fbc330-9916-4bc7-955d-358c91de4233 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f527f925af24eba8cabffe457fceb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:28:46.041358 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fbc330-9916-4bc7-955d-358c91de4233 service swift] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:28:46.041639 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fbc330-9916-4bc7-955d-358c91de4233 service swift] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:28:46.041912 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fbc330-9916-4bc7-955d-358c91de4233 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:28:46.052430 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fbc330-9916-4bc7-955d-358c91de4233 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:28:46.054105 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fbc330-9916-4bc7-955d-358c91de4233 service swift] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:28:46.066151 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1152/2305] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Oct 12 18:28:45 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 18:29:02.283270 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c052f-7d4a-43a1-b634-6bcbcda5f606 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:29:02.284529 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c052f-7d4a-43a1-b634-6bcbcda5f606 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:29:02.284636 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c052f-7d4a-43a1-b634-6bcbcda5f606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:29:02.304057 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-a81c052f-7d4a-43a1-b634-6bcbcda5f606 None None] MFA Rules not processed for user `9a37985dd5034ceeabfa47797efba5a1`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:29:02.305814 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-a81c052f-7d4a-43a1-b634-6bcbcda5f606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:29:02.374665 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1154/2306] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:29:02 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:29:06.027139 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488524ef-09c2-4b35-afbf-75392fc218da None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:29:06.027839 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488524ef-09c2-4b35-afbf-75392fc218da None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:29:06.027839 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488524ef-09c2-4b35-afbf-75392fc218da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:29:06.049718 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-488524ef-09c2-4b35-afbf-75392fc218da None None] MFA Rules not processed for user `8f6a3a7064754fb79a0a06b3ad4a7d05`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:29:06.050963 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-488524ef-09c2-4b35-afbf-75392fc218da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:29:06.058364 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1153/2307] 10.222.0.18 () {58 vars in 967 bytes} [Tue Oct 12 18:29:06 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:29:06.072504 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81c052f-7d4a-43a1-b634-6bcbcda5f606 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:29:06.084512 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81c052f-7d4a-43a1-b634-6bcbcda5f606 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:29:06.089816 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5922d2-fafe-49da-9f43-b8f692dc3cef service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f527f925af24eba8cabffe457fceb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:29:06.090473 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5922d2-fafe-49da-9f43-b8f692dc3cef service swift] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:29:06.090754 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5922d2-fafe-49da-9f43-b8f692dc3cef service swift] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:29:06.091022 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5922d2-fafe-49da-9f43-b8f692dc3cef service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:29:06.100988 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5922d2-fafe-49da-9f43-b8f692dc3cef service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:29:06.102607 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5922d2-fafe-49da-9f43-b8f692dc3cef service swift] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:29:06.112124 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1155/2308] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Oct 12 18:29:06 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 18:29:10.469591 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488524ef-09c2-4b35-afbf-75392fc218da None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:29:10.473629 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-488524ef-09c2-4b35-afbf-75392fc218da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:29:10.571246 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488524ef-09c2-4b35-afbf-75392fc218da None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:29:10.576805 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709cc1ab-c9e0-43a8-803b-5a072e2d4df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:29:10.577902 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709cc1ab-c9e0-43a8-803b-5a072e2d4df6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:29:10.578241 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709cc1ab-c9e0-43a8-803b-5a072e2d4df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:29:10.578466 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709cc1ab-c9e0-43a8-803b-5a072e2d4df6 admin admin] PATH_INFO: `/v3/users/ac7aaed40f314bf397c414162affa8ad` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:29:10.579800 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709cc1ab-c9e0-43a8-803b-5a072e2d4df6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac7aaed40f314bf397c414162affa8ad)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:29:10.581860 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709cc1ab-c9e0-43a8-803b-5a072e2d4df6 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:29:10.824240 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-709cc1ab-c9e0-43a8-803b-5a072e2d4df6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac7aaed40f314bf397c414162affa8ad'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:29:10.837488 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-709cc1ab-c9e0-43a8-803b-5a072e2d4df6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac7aaed40f314bf397c414162affa8ad'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:29:10.896306 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-709cc1ab-c9e0-43a8-803b-5a072e2d4df6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac7aaed40f314bf397c414162affa8ad'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:29:11.028046 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-709cc1ab-c9e0-43a8-803b-5a072e2d4df6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac7aaed40f314bf397c414162affa8ad'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:29:11.028723 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-709cc1ab-c9e0-43a8-803b-5a072e2d4df6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac7aaed40f314bf397c414162affa8ad'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:29:11.038363 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1154/2309] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:29:10 2021] DELETE /identity/v3/users/ac7aaed40f314bf397c414162affa8ad => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:29:11.332707 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5922d2-fafe-49da-9f43-b8f692dc3cef service swift] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:29:11.350728 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5922d2-fafe-49da-9f43-b8f692dc3cef service swift] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:29:11.441005 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b0c2e3-cd67-4eed-a05d-c2c30be1cae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:29:11.441901 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b0c2e3-cd67-4eed-a05d-c2c30be1cae1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:29:11.442392 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b0c2e3-cd67-4eed-a05d-c2c30be1cae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:29:11.443523 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b0c2e3-cd67-4eed-a05d-c2c30be1cae1 admin admin] PATH_INFO: `/v3/projects/ec6b4ea245ba455cb3a788ef7907c669` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:29:11.445060 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b0c2e3-cd67-4eed-a05d-c2c30be1cae1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec6b4ea245ba455cb3a788ef7907c669)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:29:11.447051 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b0c2e3-cd67-4eed-a05d-c2c30be1cae1 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:29:11.596263 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-83b0c2e3-cd67-4eed-a05d-c2c30be1cae1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec6b4ea245ba455cb3a788ef7907c669', 'request_id': 'req-83b0c2e3-cd67-4eed-a05d-c2c30be1cae1'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:29:11.603984 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-83b0c2e3-cd67-4eed-a05d-c2c30be1cae1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec6b4ea245ba455cb3a788ef7907c669', 'request_id': 'req-83b0c2e3-cd67-4eed-a05d-c2c30be1cae1'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:29:11.610327 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-83b0c2e3-cd67-4eed-a05d-c2c30be1cae1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec6b4ea245ba455cb3a788ef7907c669', 'request_id': 'req-83b0c2e3-cd67-4eed-a05d-c2c30be1cae1'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:29:11.716143 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-83b0c2e3-cd67-4eed-a05d-c2c30be1cae1 admin admin] The token cache is being invalidate because project ec6b4ea245ba455cb3a788ef7907c669 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74005) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:29:11.716575 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-83b0c2e3-cd67-4eed-a05d-c2c30be1cae1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:29:11.717221 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-83b0c2e3-cd67-4eed-a05d-c2c30be1cae1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:29:11.718876 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1156/2310] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:29:11 2021] DELETE /identity/v3/projects/ec6b4ea245ba455cb3a788ef7907c669 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:29:11.727296 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd065c88-c869-4a67-af7f-014617cdb1f6 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:29:11.727868 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd065c88-c869-4a67-af7f-014617cdb1f6 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:29:11.728258 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd065c88-c869-4a67-af7f-014617cdb1f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:29:11.749211 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-dd065c88-c869-4a67-af7f-014617cdb1f6 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:29:11.750578 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-dd065c88-c869-4a67-af7f-014617cdb1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:29:11.810663 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1155/2311] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:29:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:29:11.818793 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e7dd60-08e0-4d63-b2c5-da475beb3fe4 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:29:11.819156 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e7dd60-08e0-4d63-b2c5-da475beb3fe4 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:29:11.819503 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e7dd60-08e0-4d63-b2c5-da475beb3fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:29:11.838211 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-96e7dd60-08e0-4d63-b2c5-da475beb3fe4 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:29:11.839495 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-96e7dd60-08e0-4d63-b2c5-da475beb3fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:29:11.848106 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1157/2312] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:29:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:29:11.852491 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd065c88-c869-4a67-af7f-014617cdb1f6 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:29:11.862491 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd065c88-c869-4a67-af7f-014617cdb1f6 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:29:11.867475 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c26d77-c69f-4929-80bd-b5d6d15967f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:29:11.868140 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c26d77-c69f-4929-80bd-b5d6d15967f7 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:29:11.868438 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c26d77-c69f-4929-80bd-b5d6d15967f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:29:11.868722 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c26d77-c69f-4929-80bd-b5d6d15967f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:29:11.869525 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c26d77-c69f-4929-80bd-b5d6d15967f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:29:11.869830 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c26d77-c69f-4929-80bd-b5d6d15967f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:29:11.871434 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c26d77-c69f-4929-80bd-b5d6d15967f7 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:29:11.885106 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1156/2313] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 12 18:29:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:29:11.890167 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e7dd60-08e0-4d63-b2c5-da475beb3fe4 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:29:11.903368 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e7dd60-08e0-4d63-b2c5-da475beb3fe4 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:29:11.908538 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fdb3d5-5834-483b-bdb7-976e04966d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:29:11.909221 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fdb3d5-5834-483b-bdb7-976e04966d9a admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:29:11.909505 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fdb3d5-5834-483b-bdb7-976e04966d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:29:11.909781 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fdb3d5-5834-483b-bdb7-976e04966d9a admin admin] PATH_INFO: `/v3/projects` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:29:11.910491 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fdb3d5-5834-483b-bdb7-976e04966d9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:29:11.912466 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fdb3d5-5834-483b-bdb7-976e04966d9a admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:29:12.067676 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1158/2314] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:29:11 2021] POST /identity/v3/projects => generated 389 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:29:12.071925 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c26d77-c69f-4929-80bd-b5d6d15967f7 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:29:12.082735 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c26d77-c69f-4929-80bd-b5d6d15967f7 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:29:12.157823 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667ea5b1-d4a0-4bdb-b842-2e44ee24d3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:29:12.158520 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ea5b1-d4a0-4bdb-b842-2e44ee24d3e5 admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:29:12.158777 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ea5b1-d4a0-4bdb-b842-2e44ee24d3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:29:12.159093 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ea5b1-d4a0-4bdb-b842-2e44ee24d3e5 admin admin] PATH_INFO: `/v3/users` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:29:12.159810 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667ea5b1-d4a0-4bdb-b842-2e44ee24d3e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:29:12.161768 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667ea5b1-d4a0-4bdb-b842-2e44ee24d3e5 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:29:12.281995 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1157/2315] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:29:12 2021] POST /identity/v3/users => generated 295 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:29:12.283586 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fdb3d5-5834-483b-bdb7-976e04966d9a admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:29:12.294191 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fdb3d5-5834-483b-bdb7-976e04966d9a admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:29:12.308202 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dd5469-18db-4fcd-8fc7-bb19b7ce1434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:29:12.308911 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd5469-18db-4fcd-8fc7-bb19b7ce1434 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:29:12.309195 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd5469-18db-4fcd-8fc7-bb19b7ce1434 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:29:12.309468 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd5469-18db-4fcd-8fc7-bb19b7ce1434 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:29:12.310208 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dd5469-18db-4fcd-8fc7-bb19b7ce1434 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:29:12.311929 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dd5469-18db-4fcd-8fc7-bb19b7ce1434 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:29:12.323801 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1159/2316] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:29:12 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:29:12.328074 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667ea5b1-d4a0-4bdb-b842-2e44ee24d3e5 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:29:12.338260 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667ea5b1-d4a0-4bdb-b842-2e44ee24d3e5 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:29:12.342937 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e32220-6049-4f78-8a30-4f24bdefeab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:29:12.343603 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e32220-6049-4f78-8a30-4f24bdefeab1 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:29:12.348533 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e32220-6049-4f78-8a30-4f24bdefeab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:29:12.348533 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e32220-6049-4f78-8a30-4f24bdefeab1 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:29:12.348533 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e32220-6049-4f78-8a30-4f24bdefeab1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:29:12.348533 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e32220-6049-4f78-8a30-4f24bdefeab1 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:29:12.357307 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1158/2317] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:29:12 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:29:12.362825 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dd5469-18db-4fcd-8fc7-bb19b7ce1434 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:29:12.375506 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dd5469-18db-4fcd-8fc7-bb19b7ce1434 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:29:12.383213 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39c73bb-c672-4a55-a15e-df32ec4062fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:29:12.384246 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c73bb-c672-4a55-a15e-df32ec4062fd admin admin] REQUEST_METHOD: `PUT` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:29:12.384680 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c73bb-c672-4a55-a15e-df32ec4062fd admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:29:12.385017 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c73bb-c672-4a55-a15e-df32ec4062fd admin admin] PATH_INFO: `/v3/projects/169ed8cee4c14d179d94930ca51c29a7/users/914fda9addba40e89e392eddd404a2ca/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:29:12.401393 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39c73bb-c672-4a55-a15e-df32ec4062fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=169ed8cee4c14d179d94930ca51c29a7, user_id=914fda9addba40e89e392eddd404a2ca, role_id=33b8a5a8d1d643f2a98f598e6ab0a1cf)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:29:12.404413 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39c73bb-c672-4a55-a15e-df32ec4062fd admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:29:12.496654 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1160/2318] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:29:12 2021] PUT /identity/v3/projects/169ed8cee4c14d179d94930ca51c29a7/users/914fda9addba40e89e392eddd404a2ca/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 18:29:12.507352 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab36b9-3234-427a-8ba7-2617a2a4aff2 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:29:12.507639 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab36b9-3234-427a-8ba7-2617a2a4aff2 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:29:12.508086 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab36b9-3234-427a-8ba7-2617a2a4aff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:29:12.538099 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-82ab36b9-3234-427a-8ba7-2617a2a4aff2 None None] MFA Rules not processed for user `914fda9addba40e89e392eddd404a2ca`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:29:12.539334 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-82ab36b9-3234-427a-8ba7-2617a2a4aff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:29:12.623119 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1159/2319] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:29:12 2021] POST /identity/v3/auth/tokens => generated 3409 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:29:12.633952 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39c73bb-c672-4a55-a15e-df32ec4062fd admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:29:12.636034 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-e39c73bb-c672-4a55-a15e-df32ec4062fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:29:12.759170 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39c73bb-c672-4a55-a15e-df32ec4062fd admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:29:12.765102 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d0eb51-2138-42f8-b1b7-5ef84b3995b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6966ce0774f4437a9b688494e9d0574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:29:12.766204 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d0eb51-2138-42f8-b1b7-5ef84b3995b0 service cinder] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:29:12.766495 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d0eb51-2138-42f8-b1b7-5ef84b3995b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:29:12.766925 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d0eb51-2138-42f8-b1b7-5ef84b3995b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:29:12.776519 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d0eb51-2138-42f8-b1b7-5ef84b3995b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:29:12.778400 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d0eb51-2138-42f8-b1b7-5ef84b3995b0 service cinder] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:29:12.789036 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1161/2320] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:29:12 2021] GET /identity/v3/auth/tokens => generated 3409 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:29:12.895449 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d821f82-c506-4829-824d-69dc46e3b7e0 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:29:12.896615 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d821f82-c506-4829-824d-69dc46e3b7e0 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:29:12.896874 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d821f82-c506-4829-824d-69dc46e3b7e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:29:12.929752 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-3d821f82-c506-4829-824d-69dc46e3b7e0 None None] MFA Rules not processed for user `8f6a3a7064754fb79a0a06b3ad4a7d05`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:29:12.929752 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-3d821f82-c506-4829-824d-69dc46e3b7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:29:12.991320 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1160/2321] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Oct 12 18:29:12 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:29:13.005331 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d0eb51-2138-42f8-b1b7-5ef84b3995b0 service cinder] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:29:13.006939 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-33d0eb51-2138-42f8-b1b7-5ef84b3995b0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:29:13.084669 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d0eb51-2138-42f8-b1b7-5ef84b3995b0 service cinder] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:29:13.090056 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4116c1d-3839-40fe-9a6f-97f994fa07b1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f527f925af24eba8cabffe457fceb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:29:13.091618 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4116c1d-3839-40fe-9a6f-97f994fa07b1 service swift] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:29:13.091618 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4116c1d-3839-40fe-9a6f-97f994fa07b1 service swift] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:29:13.091618 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4116c1d-3839-40fe-9a6f-97f994fa07b1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:29:13.100761 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4116c1d-3839-40fe-9a6f-97f994fa07b1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:29:13.102458 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4116c1d-3839-40fe-9a6f-97f994fa07b1 service swift] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:29:13.113224 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1162/2322] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Oct 12 18:29:13 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 18:29:37.669336 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d821f82-c506-4829-824d-69dc46e3b7e0 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:29:37.672676 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-3d821f82-c506-4829-824d-69dc46e3b7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:29:37.735039 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d821f82-c506-4829-824d-69dc46e3b7e0 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:29:37.739426 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bf9dac-a480-4abe-98f7-8b8f353d8632 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:29:37.740084 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf9dac-a480-4abe-98f7-8b8f353d8632 service neutron] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:29:37.740379 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf9dac-a480-4abe-98f7-8b8f353d8632 service neutron] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:29:37.740682 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf9dac-a480-4abe-98f7-8b8f353d8632 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:29:37.743377 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-38bf9dac-a480-4abe-98f7-8b8f353d8632 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:29:37.812511 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bf9dac-a480-4abe-98f7-8b8f353d8632 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:29:37.814013 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bf9dac-a480-4abe-98f7-8b8f353d8632 service neutron] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:29:37.825860 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1161/2323] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:29:37 2021] GET /identity/v3/auth/tokens => generated 3466 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:29:42.085871 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493aa8b4-279d-4be6-8837-9446273d5c6f None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:29:42.088600 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493aa8b4-279d-4be6-8837-9446273d5c6f None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:29:42.088600 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493aa8b4-279d-4be6-8837-9446273d5c6f None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:29:42.088600 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1163/2324] 10.222.0.18 () {54 vars in 921 bytes} [Tue Oct 12 18:29:42 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:29:42.094490 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4159653-95c1-4bee-8163-ee1104d6441b None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:29:42.094986 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4159653-95c1-4bee-8163-ee1104d6441b None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:29:42.095083 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4159653-95c1-4bee-8163-ee1104d6441b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:29:42.143592 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-b4159653-95c1-4bee-8163-ee1104d6441b None None] MFA Rules not processed for user `3417097a280b499086b36df9a2548239`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:29:42.145407 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-b4159653-95c1-4bee-8163-ee1104d6441b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:29:42.218758 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1162/2325] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Oct 12 18:29:42 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:29:42.231876 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493aa8b4-279d-4be6-8837-9446273d5c6f None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:29:42.233926 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-493aa8b4-279d-4be6-8837-9446273d5c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:29:42.335410 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493aa8b4-279d-4be6-8837-9446273d5c6f None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:29:42.339111 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44268a88-45e8-4953-a1e2-2a5494d2bc45 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a3d3e5a5cfc4ac3afcece4e55f23552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:29:42.339761 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44268a88-45e8-4953-a1e2-2a5494d2bc45 service glance] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:29:42.340044 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44268a88-45e8-4953-a1e2-2a5494d2bc45 service glance] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:29:42.340320 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44268a88-45e8-4953-a1e2-2a5494d2bc45 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:29:42.355279 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44268a88-45e8-4953-a1e2-2a5494d2bc45 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:29:42.361322 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44268a88-45e8-4953-a1e2-2a5494d2bc45 service glance] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:29:42.368921 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1164/2326] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:29:42 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:29:42.560339 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de148387-c161-4f35-afec-ea51f0288454 None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:29:42.560668 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de148387-c161-4f35-afec-ea51f0288454 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:29:42.560946 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de148387-c161-4f35-afec-ea51f0288454 None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:29:42.562738 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1163/2327] 10.222.0.18 () {54 vars in 921 bytes} [Tue Oct 12 18:29:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:29:42.568445 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff37a0-5e2e-4a53-a9be-e7cec491c601 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:29:42.568714 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff37a0-5e2e-4a53-a9be-e7cec491c601 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:29:42.568990 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff37a0-5e2e-4a53-a9be-e7cec491c601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:29:42.587753 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-fcff37a0-5e2e-4a53-a9be-e7cec491c601 None None] MFA Rules not processed for user `9a1ea6f47a7c41aba102ad481f5ad5c8`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:29:42.589016 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-fcff37a0-5e2e-4a53-a9be-e7cec491c601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:29:42.595802 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1165/2328] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Oct 12 18:29:42 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:29:42.609045 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de148387-c161-4f35-afec-ea51f0288454 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:29:42.610778 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-de148387-c161-4f35-afec-ea51f0288454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:29:42.631887 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de148387-c161-4f35-afec-ea51f0288454 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:29:42.635583 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ad5f27-7591-4380-ad80-25027f85ba06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:29:42.642393 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ad5f27-7591-4380-ad80-25027f85ba06 service neutron] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:29:42.642393 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ad5f27-7591-4380-ad80-25027f85ba06 service neutron] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:29:42.642393 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ad5f27-7591-4380-ad80-25027f85ba06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:29:42.646467 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ad5f27-7591-4380-ad80-25027f85ba06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:29:42.648182 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ad5f27-7591-4380-ad80-25027f85ba06 service neutron] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:29:42.658886 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1164/2329] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:29:42 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 18:29:42.976974 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcff37a0-5e2e-4a53-a9be-e7cec491c601 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:29:42.989403 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcff37a0-5e2e-4a53-a9be-e7cec491c601 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:29:42.993344 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef465afc-5170-4f82-9cf0-0b107a5f8a63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:29:42.993989 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef465afc-5170-4f82-9cf0-0b107a5f8a63 service neutron] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:29:42.994267 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef465afc-5170-4f82-9cf0-0b107a5f8a63 service neutron] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:29:42.994540 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef465afc-5170-4f82-9cf0-0b107a5f8a63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:29:42.996343 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-ef465afc-5170-4f82-9cf0-0b107a5f8a63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:29:43.069162 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef465afc-5170-4f82-9cf0-0b107a5f8a63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:29:43.070526 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef465afc-5170-4f82-9cf0-0b107a5f8a63 service neutron] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:29:43.080437 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1166/2330] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:29:42 2021] GET /identity/v3/auth/tokens => generated 3460 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:29:43.353648 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ad5f27-7591-4380-ad80-25027f85ba06 service neutron] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:29:43.448336 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ad5f27-7591-4380-ad80-25027f85ba06 service neutron] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:29:43.453590 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d58b0-75f8-4b8d-9a42-8b5b1488021f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:29:43.454464 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d58b0-75f8-4b8d-9a42-8b5b1488021f admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:29:43.454771 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d58b0-75f8-4b8d-9a42-8b5b1488021f admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:29:43.455042 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d58b0-75f8-4b8d-9a42-8b5b1488021f admin admin] PATH_INFO: `/v3/users/914fda9addba40e89e392eddd404a2ca` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:29:43.456883 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54d58b0-75f8-4b8d-9a42-8b5b1488021f admin admin] RBAC: Authorizing `identity:delete_user(user_id=914fda9addba40e89e392eddd404a2ca)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:29:43.458956 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54d58b0-75f8-4b8d-9a42-8b5b1488021f admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:29:43.646707 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-c54d58b0-75f8-4b8d-9a42-8b5b1488021f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '914fda9addba40e89e392eddd404a2ca'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:29:43.654092 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-c54d58b0-75f8-4b8d-9a42-8b5b1488021f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '914fda9addba40e89e392eddd404a2ca'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:29:43.667577 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-c54d58b0-75f8-4b8d-9a42-8b5b1488021f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '914fda9addba40e89e392eddd404a2ca'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:29:43.824918 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-c54d58b0-75f8-4b8d-9a42-8b5b1488021f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '914fda9addba40e89e392eddd404a2ca'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:29:43.826433 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-c54d58b0-75f8-4b8d-9a42-8b5b1488021f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '914fda9addba40e89e392eddd404a2ca'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:29:43.834645 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1165/2331] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:29:43 2021] DELETE /identity/v3/users/914fda9addba40e89e392eddd404a2ca => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:29:43.840749 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80594f26-4c1e-4cac-b64a-0242439954ce None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:29:43.841217 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80594f26-4c1e-4cac-b64a-0242439954ce None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:29:43.841434 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80594f26-4c1e-4cac-b64a-0242439954ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:29:43.864725 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-80594f26-4c1e-4cac-b64a-0242439954ce None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:29:43.865948 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-80594f26-4c1e-4cac-b64a-0242439954ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:29:43.929910 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1167/2332] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:29:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:29:43.940088 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d58b0-75f8-4b8d-9a42-8b5b1488021f admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:29:43.942025 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-c54d58b0-75f8-4b8d-9a42-8b5b1488021f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:29:43.999794 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d58b0-75f8-4b8d-9a42-8b5b1488021f admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:29:44.004019 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080497e9-e918-482a-bec2-38bd68450cc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:29:44.004730 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080497e9-e918-482a-bec2-38bd68450cc9 service neutron] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:29:44.005011 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080497e9-e918-482a-bec2-38bd68450cc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:29:44.005290 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080497e9-e918-482a-bec2-38bd68450cc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:29:44.014829 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080497e9-e918-482a-bec2-38bd68450cc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:29:44.016265 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080497e9-e918-482a-bec2-38bd68450cc9 service neutron] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:29:44.026722 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1166/2333] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:29:43 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:29:44.445927 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80594f26-4c1e-4cac-b64a-0242439954ce None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:29:44.448193 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-80594f26-4c1e-4cac-b64a-0242439954ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:29:44.465871 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80594f26-4c1e-4cac-b64a-0242439954ce None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:29:44.470633 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47845751-44a6-4033-99da-57da19106d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:29:44.471493 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47845751-44a6-4033-99da-57da19106d31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:29:44.471874 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47845751-44a6-4033-99da-57da19106d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:29:44.472150 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47845751-44a6-4033-99da-57da19106d31 admin admin] PATH_INFO: `/v3/projects/169ed8cee4c14d179d94930ca51c29a7` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:29:44.473495 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47845751-44a6-4033-99da-57da19106d31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=169ed8cee4c14d179d94930ca51c29a7)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:29:44.475641 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47845751-44a6-4033-99da-57da19106d31 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:29:44.590478 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-47845751-44a6-4033-99da-57da19106d31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '169ed8cee4c14d179d94930ca51c29a7', 'request_id': 'req-47845751-44a6-4033-99da-57da19106d31'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:29:44.597983 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-47845751-44a6-4033-99da-57da19106d31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '169ed8cee4c14d179d94930ca51c29a7', 'request_id': 'req-47845751-44a6-4033-99da-57da19106d31'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:29:44.605278 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-47845751-44a6-4033-99da-57da19106d31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '169ed8cee4c14d179d94930ca51c29a7', 'request_id': 'req-47845751-44a6-4033-99da-57da19106d31'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:29:44.687279 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-47845751-44a6-4033-99da-57da19106d31 admin admin] The token cache is being invalidate because project 169ed8cee4c14d179d94930ca51c29a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74005) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:29:44.687568 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-47845751-44a6-4033-99da-57da19106d31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:29:44.688229 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-47845751-44a6-4033-99da-57da19106d31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:29:44.690166 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1168/2334] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:29:44 2021] DELETE /identity/v3/projects/169ed8cee4c14d179d94930ca51c29a7 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:29:47.048986 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a154a2-a7c9-4385-a7b1-1de9c4c603ba None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:29:47.049579 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a154a2-a7c9-4385-a7b1-1de9c4c603ba None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:29:47.049579 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a154a2-a7c9-4385-a7b1-1de9c4c603ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:29:47.082318 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-b8a154a2-a7c9-4385-a7b1-1de9c4c603ba None None] MFA Rules not processed for user `8f6a3a7064754fb79a0a06b3ad4a7d05`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:29:47.083540 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-b8a154a2-a7c9-4385-a7b1-1de9c4c603ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:29:47.244280 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1167/2335] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Oct 12 18:29:47 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:29:47.244486 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47845751-44a6-4033-99da-57da19106d31 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:29:47.244486 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-47845751-44a6-4033-99da-57da19106d31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:29:47.244486 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47845751-44a6-4033-99da-57da19106d31 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:29:47.245096 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3304d07c-1711-4712-b6bf-247520126adf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f527f925af24eba8cabffe457fceb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:29:47.245096 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3304d07c-1711-4712-b6bf-247520126adf service swift] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:29:47.245096 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3304d07c-1711-4712-b6bf-247520126adf service swift] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:29:47.245096 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3304d07c-1711-4712-b6bf-247520126adf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:29:47.248622 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3304d07c-1711-4712-b6bf-247520126adf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:29:47.250204 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3304d07c-1711-4712-b6bf-247520126adf service swift] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:29:47.280614 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1169/2336] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Oct 12 18:29:47 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 18:30:21.570510 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11932edf-a5c3-4bf9-b486-3509bc515d76 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:30:21.571046 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11932edf-a5c3-4bf9-b486-3509bc515d76 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:30:21.571046 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11932edf-a5c3-4bf9-b486-3509bc515d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:30:21.589118 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-11932edf-a5c3-4bf9-b486-3509bc515d76 None None] MFA Rules not processed for user `8f6a3a7064754fb79a0a06b3ad4a7d05`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:30:21.590326 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-11932edf-a5c3-4bf9-b486-3509bc515d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:30:21.598187 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1168/2337] 10.222.0.18 () {58 vars in 967 bytes} [Tue Oct 12 18:30:21 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:30:21.610677 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3304d07c-1711-4712-b6bf-247520126adf service swift] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:30:21.622001 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3304d07c-1711-4712-b6bf-247520126adf service swift] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:30:21.627065 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ecb02c-aa9b-4cc9-af66-83d34a3202e5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f527f925af24eba8cabffe457fceb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:30:21.631882 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ecb02c-aa9b-4cc9-af66-83d34a3202e5 service swift] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:30:21.631882 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ecb02c-aa9b-4cc9-af66-83d34a3202e5 service swift] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:30:21.631882 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ecb02c-aa9b-4cc9-af66-83d34a3202e5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:30:21.636296 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ecb02c-aa9b-4cc9-af66-83d34a3202e5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:30:21.637903 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ecb02c-aa9b-4cc9-af66-83d34a3202e5 service swift] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:30:21.646478 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1170/2338] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Oct 12 18:30:21 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 18:30:33.981354 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11932edf-a5c3-4bf9-b486-3509bc515d76 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:30:33.991910 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-11932edf-a5c3-4bf9-b486-3509bc515d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:30:34.053535 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11932edf-a5c3-4bf9-b486-3509bc515d76 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:30:34.058156 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf995605-4127-4428-9d88-3cde5c57a3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:30:34.059029 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf995605-4127-4428-9d88-3cde5c57a3c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:30:34.059310 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf995605-4127-4428-9d88-3cde5c57a3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:30:34.059582 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf995605-4127-4428-9d88-3cde5c57a3c0 admin admin] PATH_INFO: `/v3/users/adee358392264c9cad3d3ee92c9aadd2` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:30:34.060843 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf995605-4127-4428-9d88-3cde5c57a3c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=adee358392264c9cad3d3ee92c9aadd2)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:30:34.062790 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf995605-4127-4428-9d88-3cde5c57a3c0 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:30:34.271298 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-cf995605-4127-4428-9d88-3cde5c57a3c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adee358392264c9cad3d3ee92c9aadd2'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:30:34.278332 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-cf995605-4127-4428-9d88-3cde5c57a3c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adee358392264c9cad3d3ee92c9aadd2'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:30:34.290452 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-cf995605-4127-4428-9d88-3cde5c57a3c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adee358392264c9cad3d3ee92c9aadd2'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:30:34.412263 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-cf995605-4127-4428-9d88-3cde5c57a3c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adee358392264c9cad3d3ee92c9aadd2'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:30:34.412949 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-cf995605-4127-4428-9d88-3cde5c57a3c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adee358392264c9cad3d3ee92c9aadd2'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:30:34.419680 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1169/2339] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:30:33 2021] DELETE /identity/v3/users/adee358392264c9cad3d3ee92c9aadd2 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:30:34.719062 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ecb02c-aa9b-4cc9-af66-83d34a3202e5 service swift] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:30:34.731349 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ecb02c-aa9b-4cc9-af66-83d34a3202e5 service swift] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:30:34.791654 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83420de5-92d1-43cc-8ea0-555e8d2b9e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:30:34.792543 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83420de5-92d1-43cc-8ea0-555e8d2b9e2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:30:34.792834 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83420de5-92d1-43cc-8ea0-555e8d2b9e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:30:34.793107 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83420de5-92d1-43cc-8ea0-555e8d2b9e2f admin admin] PATH_INFO: `/v3/projects/7f9fb6543096402dbf4351b0e6639431` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:30:34.794314 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83420de5-92d1-43cc-8ea0-555e8d2b9e2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f9fb6543096402dbf4351b0e6639431)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:30:34.796216 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83420de5-92d1-43cc-8ea0-555e8d2b9e2f admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:30:34.946133 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-83420de5-92d1-43cc-8ea0-555e8d2b9e2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f9fb6543096402dbf4351b0e6639431', 'request_id': 'req-83420de5-92d1-43cc-8ea0-555e8d2b9e2f'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:30:34.952586 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-83420de5-92d1-43cc-8ea0-555e8d2b9e2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f9fb6543096402dbf4351b0e6639431', 'request_id': 'req-83420de5-92d1-43cc-8ea0-555e8d2b9e2f'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:30:34.959051 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-83420de5-92d1-43cc-8ea0-555e8d2b9e2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f9fb6543096402dbf4351b0e6639431', 'request_id': 'req-83420de5-92d1-43cc-8ea0-555e8d2b9e2f'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:30:35.042211 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-83420de5-92d1-43cc-8ea0-555e8d2b9e2f admin admin] The token cache is being invalidate because project 7f9fb6543096402dbf4351b0e6639431 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74005) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:30:35.042508 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-83420de5-92d1-43cc-8ea0-555e8d2b9e2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:30:35.043097 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-83420de5-92d1-43cc-8ea0-555e8d2b9e2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:30:35.044713 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1171/2340] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:30:34 2021] DELETE /identity/v3/projects/7f9fb6543096402dbf4351b0e6639431 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:30:35.051140 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2958f8-4a6c-429c-8477-4287983be21b None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:30:35.051633 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2958f8-4a6c-429c-8477-4287983be21b None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:30:35.052045 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2958f8-4a6c-429c-8477-4287983be21b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:30:35.070396 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-eb2958f8-4a6c-429c-8477-4287983be21b None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:30:35.071617 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-eb2958f8-4a6c-429c-8477-4287983be21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:30:35.134075 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1170/2341] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:30:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:30:35.142618 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb35757-f551-488a-98c9-0c0e483ba968 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:30:35.142902 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb35757-f551-488a-98c9-0c0e483ba968 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:30:35.143174 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb35757-f551-488a-98c9-0c0e483ba968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:30:35.162341 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-1cb35757-f551-488a-98c9-0c0e483ba968 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:30:35.163553 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-1cb35757-f551-488a-98c9-0c0e483ba968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:30:35.173323 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1172/2342] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:30:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:30:35.177750 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2958f8-4a6c-429c-8477-4287983be21b None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:30:35.188529 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2958f8-4a6c-429c-8477-4287983be21b None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:30:35.193980 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56efe2c4-310f-48bd-a94e-9e6e2357cf39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:30:35.194651 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56efe2c4-310f-48bd-a94e-9e6e2357cf39 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:30:35.194935 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56efe2c4-310f-48bd-a94e-9e6e2357cf39 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:30:35.195214 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56efe2c4-310f-48bd-a94e-9e6e2357cf39 admin admin] PATH_INFO: `/v3/domains` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:30:35.195960 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56efe2c4-310f-48bd-a94e-9e6e2357cf39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:30:35.196318 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56efe2c4-310f-48bd-a94e-9e6e2357cf39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:30:35.197907 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56efe2c4-310f-48bd-a94e-9e6e2357cf39 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:30:35.210532 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1171/2343] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 12 18:30:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:30:35.215039 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb35757-f551-488a-98c9-0c0e483ba968 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:30:35.225135 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb35757-f551-488a-98c9-0c0e483ba968 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:30:35.230207 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ff737-0403-463e-9e1e-40d79cab3c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:30:35.230907 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ff737-0403-463e-9e1e-40d79cab3c0f admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:30:35.231216 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ff737-0403-463e-9e1e-40d79cab3c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:30:35.231543 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ff737-0403-463e-9e1e-40d79cab3c0f admin admin] PATH_INFO: `/v3/projects` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:30:35.232238 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995ff737-0403-463e-9e1e-40d79cab3c0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:30:35.234208 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995ff737-0403-463e-9e1e-40d79cab3c0f admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:30:35.353643 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1173/2344] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:30:35 2021] POST /identity/v3/projects => generated 375 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:30:35.357888 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56efe2c4-310f-48bd-a94e-9e6e2357cf39 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:30:35.368300 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56efe2c4-310f-48bd-a94e-9e6e2357cf39 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:30:35.436877 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cb04b0-34f2-4bf1-b406-95212c82dbac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:30:35.437549 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb04b0-34f2-4bf1-b406-95212c82dbac admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:30:35.437830 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb04b0-34f2-4bf1-b406-95212c82dbac admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:30:35.438100 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb04b0-34f2-4bf1-b406-95212c82dbac admin admin] PATH_INFO: `/v3/users` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:30:35.438873 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cb04b0-34f2-4bf1-b406-95212c82dbac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:30:35.440816 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cb04b0-34f2-4bf1-b406-95212c82dbac admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:30:35.544184 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1172/2345] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:30:35 2021] POST /identity/v3/users => generated 288 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:30:35.548644 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ff737-0403-463e-9e1e-40d79cab3c0f admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:30:35.559433 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ff737-0403-463e-9e1e-40d79cab3c0f admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:30:35.564761 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ce6c3b-76ca-4b5d-970d-4db52b75228e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:30:35.565423 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce6c3b-76ca-4b5d-970d-4db52b75228e admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:30:35.565702 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce6c3b-76ca-4b5d-970d-4db52b75228e admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:30:35.565976 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce6c3b-76ca-4b5d-970d-4db52b75228e admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:30:35.566711 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ce6c3b-76ca-4b5d-970d-4db52b75228e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:30:35.568333 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ce6c3b-76ca-4b5d-970d-4db52b75228e admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:30:35.581039 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1174/2346] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:30:35 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 18:30:35.585158 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cb04b0-34f2-4bf1-b406-95212c82dbac admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:30:35.595710 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cb04b0-34f2-4bf1-b406-95212c82dbac admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:30:35.600667 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec74b01-f092-42b6-8132-09fa380474a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:30:35.601340 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec74b01-f092-42b6-8132-09fa380474a6 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:30:35.601646 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec74b01-f092-42b6-8132-09fa380474a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:30:35.601899 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec74b01-f092-42b6-8132-09fa380474a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:30:35.602650 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec74b01-f092-42b6-8132-09fa380474a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:30:35.604246 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec74b01-f092-42b6-8132-09fa380474a6 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:30:35.614890 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1173/2347] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:30:35 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 18:30:35.619254 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ce6c3b-76ca-4b5d-970d-4db52b75228e admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:30:35.629809 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ce6c3b-76ca-4b5d-970d-4db52b75228e admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:30:35.634526 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925cbda0-9171-4e62-a323-1630e4564b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:30:35.635417 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925cbda0-9171-4e62-a323-1630e4564b51 admin admin] REQUEST_METHOD: `PUT` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:30:35.635696 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925cbda0-9171-4e62-a323-1630e4564b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:30:35.635968 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925cbda0-9171-4e62-a323-1630e4564b51 admin admin] PATH_INFO: `/v3/projects/1f75e0811a384e8595ee3cba8d0f4636/users/8cb06017d8844629853c5c086469f3c3/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:30:35.652713 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925cbda0-9171-4e62-a323-1630e4564b51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f75e0811a384e8595ee3cba8d0f4636, user_id=8cb06017d8844629853c5c086469f3c3, role_id=33b8a5a8d1d643f2a98f598e6ab0a1cf)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:30:35.655384 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925cbda0-9171-4e62-a323-1630e4564b51 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:30:35.768068 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1175/2348] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:30:35 2021] PUT /identity/v3/projects/1f75e0811a384e8595ee3cba8d0f4636/users/8cb06017d8844629853c5c086469f3c3/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:30:35.779146 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4532bf8-859b-434e-9ada-23d7128b677d None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:30:35.779470 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4532bf8-859b-434e-9ada-23d7128b677d None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:30:35.779712 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4532bf8-859b-434e-9ada-23d7128b677d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:30:35.809161 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-d4532bf8-859b-434e-9ada-23d7128b677d None None] MFA Rules not processed for user `8cb06017d8844629853c5c086469f3c3`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:30:35.810554 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-d4532bf8-859b-434e-9ada-23d7128b677d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:30:35.877915 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1174/2349] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:30:35 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:30:35.889058 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925cbda0-9171-4e62-a323-1630e4564b51 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:30:35.890818 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-925cbda0-9171-4e62-a323-1630e4564b51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:30:35.966239 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925cbda0-9171-4e62-a323-1630e4564b51 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:30:35.971985 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecea7bda-a729-45a1-a087-e0e8d6c3396e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3417097a280b499086b36df9a2548239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:30:35.972686 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea7bda-a729-45a1-a087-e0e8d6c3396e service nova] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:30:35.972968 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea7bda-a729-45a1-a087-e0e8d6c3396e service nova] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:30:35.973243 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea7bda-a729-45a1-a087-e0e8d6c3396e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:30:35.981639 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecea7bda-a729-45a1-a087-e0e8d6c3396e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:30:35.983249 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecea7bda-a729-45a1-a087-e0e8d6c3396e service nova] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:30:35.994069 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1176/2350] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:30:35 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:30:36.052208 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4532bf8-859b-434e-9ada-23d7128b677d None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:30:36.054911 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-d4532bf8-859b-434e-9ada-23d7128b677d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:30:36.113608 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4532bf8-859b-434e-9ada-23d7128b677d None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:30:36.117697 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7ab4e5-8d32-473d-803f-77ae57d8cad7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6966ce0774f4437a9b688494e9d0574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:30:36.118448 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ab4e5-8d32-473d-803f-77ae57d8cad7 service cinder] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:30:36.118732 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ab4e5-8d32-473d-803f-77ae57d8cad7 service cinder] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:30:36.119027 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ab4e5-8d32-473d-803f-77ae57d8cad7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:30:36.121946 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-9c7ab4e5-8d32-473d-803f-77ae57d8cad7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:30:36.143203 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7ab4e5-8d32-473d-803f-77ae57d8cad7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:30:36.144707 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7ab4e5-8d32-473d-803f-77ae57d8cad7 service cinder] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:30:36.156338 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1175/2351] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:30:36 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:30:36.222498 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecea7bda-a729-45a1-a087-e0e8d6c3396e service nova] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:30:36.223959 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-ecea7bda-a729-45a1-a087-e0e8d6c3396e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:30:36.236362 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecea7bda-a729-45a1-a087-e0e8d6c3396e service nova] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:30:36.240122 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9f8007-9938-4a9d-b460-1f422bb2fd82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6966ce0774f4437a9b688494e9d0574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:30:36.240808 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f8007-9938-4a9d-b460-1f422bb2fd82 service cinder] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:30:36.241250 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f8007-9938-4a9d-b460-1f422bb2fd82 service cinder] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:30:36.241529 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f8007-9938-4a9d-b460-1f422bb2fd82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:30:36.243298 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-3e9f8007-9938-4a9d-b460-1f422bb2fd82 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:30:36.257645 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9f8007-9938-4a9d-b460-1f422bb2fd82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:30:36.259089 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9f8007-9938-4a9d-b460-1f422bb2fd82 service cinder] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:30:36.270239 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1177/2352] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:30:36 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:30:36.353550 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7ab4e5-8d32-473d-803f-77ae57d8cad7 service cinder] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:30:36.417594 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7ab4e5-8d32-473d-803f-77ae57d8cad7 service cinder] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:30:36.422400 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f33533-28c7-413e-bd13-e8e045cac530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:30:36.423966 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f33533-28c7-413e-bd13-e8e045cac530 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:30:36.424245 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f33533-28c7-413e-bd13-e8e045cac530 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:30:36.424553 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f33533-28c7-413e-bd13-e8e045cac530 admin admin] PATH_INFO: `/v3/users/8cb06017d8844629853c5c086469f3c3` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:30:36.432359 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f33533-28c7-413e-bd13-e8e045cac530 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cb06017d8844629853c5c086469f3c3)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:30:36.432359 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f33533-28c7-413e-bd13-e8e045cac530 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:30:36.650683 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-c8f33533-28c7-413e-bd13-e8e045cac530 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cb06017d8844629853c5c086469f3c3'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:30:36.657485 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-c8f33533-28c7-413e-bd13-e8e045cac530 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cb06017d8844629853c5c086469f3c3'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:30:36.668980 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-c8f33533-28c7-413e-bd13-e8e045cac530 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cb06017d8844629853c5c086469f3c3'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:30:36.751349 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-c8f33533-28c7-413e-bd13-e8e045cac530 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cb06017d8844629853c5c086469f3c3'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:30:36.752602 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-c8f33533-28c7-413e-bd13-e8e045cac530 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cb06017d8844629853c5c086469f3c3'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:30:36.758928 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1176/2353] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:30:36 2021] DELETE /identity/v3/users/8cb06017d8844629853c5c086469f3c3 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 18:30:36.763652 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561465a2-f260-41d5-a28e-14639b4856d3 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:30:36.763940 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561465a2-f260-41d5-a28e-14639b4856d3 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:30:36.764214 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561465a2-f260-41d5-a28e-14639b4856d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:30:36.783275 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-561465a2-f260-41d5-a28e-14639b4856d3 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:30:36.784543 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-561465a2-f260-41d5-a28e-14639b4856d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:30:36.843982 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1178/2354] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:30:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:30:36.854038 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f33533-28c7-413e-bd13-e8e045cac530 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:30:36.855510 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-c8f33533-28c7-413e-bd13-e8e045cac530 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:30:36.913741 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f33533-28c7-413e-bd13-e8e045cac530 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:30:36.917449 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3401bef-6b18-4945-9e07-e96778d89b7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:30:36.918115 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3401bef-6b18-4945-9e07-e96778d89b7c service neutron] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:30:36.918392 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3401bef-6b18-4945-9e07-e96778d89b7c service neutron] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:30:36.918787 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3401bef-6b18-4945-9e07-e96778d89b7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:30:36.928442 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3401bef-6b18-4945-9e07-e96778d89b7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:30:36.929807 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3401bef-6b18-4945-9e07-e96778d89b7c service neutron] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:30:36.939759 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1177/2355] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:30:36 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:30:37.354246 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561465a2-f260-41d5-a28e-14639b4856d3 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:30:37.356534 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-561465a2-f260-41d5-a28e-14639b4856d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:30:37.379055 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561465a2-f260-41d5-a28e-14639b4856d3 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:30:37.386590 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca497f-fcbb-44f3-a898-3bbbdfb8a2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:30:37.387626 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca497f-fcbb-44f3-a898-3bbbdfb8a2b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:30:37.388029 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca497f-fcbb-44f3-a898-3bbbdfb8a2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:30:37.388345 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca497f-fcbb-44f3-a898-3bbbdfb8a2b5 admin admin] PATH_INFO: `/v3/projects/1f75e0811a384e8595ee3cba8d0f4636` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:30:37.389504 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cca497f-fcbb-44f3-a898-3bbbdfb8a2b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f75e0811a384e8595ee3cba8d0f4636)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:30:37.392038 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cca497f-fcbb-44f3-a898-3bbbdfb8a2b5 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:30:37.493838 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-3cca497f-fcbb-44f3-a898-3bbbdfb8a2b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f75e0811a384e8595ee3cba8d0f4636', 'request_id': 'req-3cca497f-fcbb-44f3-a898-3bbbdfb8a2b5'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:30:37.500272 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-3cca497f-fcbb-44f3-a898-3bbbdfb8a2b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f75e0811a384e8595ee3cba8d0f4636', 'request_id': 'req-3cca497f-fcbb-44f3-a898-3bbbdfb8a2b5'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:30:37.505805 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-3cca497f-fcbb-44f3-a898-3bbbdfb8a2b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f75e0811a384e8595ee3cba8d0f4636', 'request_id': 'req-3cca497f-fcbb-44f3-a898-3bbbdfb8a2b5'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:30:37.618620 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-3cca497f-fcbb-44f3-a898-3bbbdfb8a2b5 admin admin] The token cache is being invalidate because project 1f75e0811a384e8595ee3cba8d0f4636 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74005) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:30:37.618794 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-3cca497f-fcbb-44f3-a898-3bbbdfb8a2b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:30:37.619431 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-3cca497f-fcbb-44f3-a898-3bbbdfb8a2b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:30:37.621015 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1179/2356] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:30:37 2021] DELETE /identity/v3/projects/1f75e0811a384e8595ee3cba8d0f4636 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 18:30:37.626940 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa203de-592f-4fa3-9b5b-cfad1ec6c07e None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:30:37.627454 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa203de-592f-4fa3-9b5b-cfad1ec6c07e None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:30:37.627454 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa203de-592f-4fa3-9b5b-cfad1ec6c07e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:30:37.646394 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-4aa203de-592f-4fa3-9b5b-cfad1ec6c07e None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:30:37.647725 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-4aa203de-592f-4fa3-9b5b-cfad1ec6c07e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:30:37.706176 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1178/2357] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:30:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:30:37.714152 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff30d9b-9e40-4f82-895f-1fe4ea2a9e63 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:30:37.714436 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff30d9b-9e40-4f82-895f-1fe4ea2a9e63 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:30:37.714710 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff30d9b-9e40-4f82-895f-1fe4ea2a9e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:30:37.735153 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-7ff30d9b-9e40-4f82-895f-1fe4ea2a9e63 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:30:37.736424 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-7ff30d9b-9e40-4f82-895f-1fe4ea2a9e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:30:37.744800 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1180/2358] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:30:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:30:37.749317 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa203de-592f-4fa3-9b5b-cfad1ec6c07e None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:30:37.760751 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa203de-592f-4fa3-9b5b-cfad1ec6c07e None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:30:37.768002 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d4c714-0fe7-4fcd-b3cd-b528faca09cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:30:37.768709 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d4c714-0fe7-4fcd-b3cd-b528faca09cc admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:30:37.768988 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d4c714-0fe7-4fcd-b3cd-b528faca09cc admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:30:37.769285 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d4c714-0fe7-4fcd-b3cd-b528faca09cc admin admin] PATH_INFO: `/v3/domains` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:30:37.770027 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d4c714-0fe7-4fcd-b3cd-b528faca09cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:30:37.770325 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d4c714-0fe7-4fcd-b3cd-b528faca09cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:30:37.771932 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d4c714-0fe7-4fcd-b3cd-b528faca09cc admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:30:37.784229 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1179/2359] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 12 18:30:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:30:37.790358 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff30d9b-9e40-4f82-895f-1fe4ea2a9e63 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:30:37.799549 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff30d9b-9e40-4f82-895f-1fe4ea2a9e63 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:30:37.804209 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf7770a-237f-4c39-bb7b-1df2a391806f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:30:37.804887 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7770a-237f-4c39-bb7b-1df2a391806f admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:30:37.805173 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7770a-237f-4c39-bb7b-1df2a391806f admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:30:37.805508 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7770a-237f-4c39-bb7b-1df2a391806f admin admin] PATH_INFO: `/v3/projects` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:30:37.806208 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf7770a-237f-4c39-bb7b-1df2a391806f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:30:37.808171 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf7770a-237f-4c39-bb7b-1df2a391806f admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:30:37.952787 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1181/2360] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:30:37 2021] POST /identity/v3/projects => generated 377 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:30:37.952993 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d4c714-0fe7-4fcd-b3cd-b528faca09cc admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:30:37.966395 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d4c714-0fe7-4fcd-b3cd-b528faca09cc admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:30:38.026388 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4293003c-a5cc-4e10-b498-61172c818837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:30:38.027084 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4293003c-a5cc-4e10-b498-61172c818837 admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:30:38.027631 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4293003c-a5cc-4e10-b498-61172c818837 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:30:38.027901 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4293003c-a5cc-4e10-b498-61172c818837 admin admin] PATH_INFO: `/v3/users` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:30:38.028628 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4293003c-a5cc-4e10-b498-61172c818837 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:30:38.030535 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4293003c-a5cc-4e10-b498-61172c818837 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:30:38.117576 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1180/2361] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:30:37 2021] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:30:38.122087 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf7770a-237f-4c39-bb7b-1df2a391806f admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:30:38.133469 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf7770a-237f-4c39-bb7b-1df2a391806f admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:30:38.141025 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dda2285-37ff-4df3-a362-731b28520a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:30:38.142802 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda2285-37ff-4df3-a362-731b28520a6f admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:30:38.143322 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda2285-37ff-4df3-a362-731b28520a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:30:38.143828 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda2285-37ff-4df3-a362-731b28520a6f admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:30:38.145292 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dda2285-37ff-4df3-a362-731b28520a6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:30:38.148114 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dda2285-37ff-4df3-a362-731b28520a6f admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:30:38.160670 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1182/2362] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:30:38 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:30:38.164978 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4293003c-a5cc-4e10-b498-61172c818837 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:30:38.175927 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4293003c-a5cc-4e10-b498-61172c818837 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:30:38.181020 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b6a2af-569b-4105-9bad-4c1debb53aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:30:38.181682 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6a2af-569b-4105-9bad-4c1debb53aa1 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:30:38.181964 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6a2af-569b-4105-9bad-4c1debb53aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:30:38.182241 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6a2af-569b-4105-9bad-4c1debb53aa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:30:38.182979 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b6a2af-569b-4105-9bad-4c1debb53aa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:30:38.184701 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b6a2af-569b-4105-9bad-4c1debb53aa1 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:30:38.198362 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1181/2363] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:30:38 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:30:38.204324 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dda2285-37ff-4df3-a362-731b28520a6f admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:30:38.214878 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dda2285-37ff-4df3-a362-731b28520a6f admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:30:38.219714 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61183c2-2e5e-447d-96ed-0cf599953310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:30:38.220684 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61183c2-2e5e-447d-96ed-0cf599953310 admin admin] REQUEST_METHOD: `PUT` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:30:38.220986 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61183c2-2e5e-447d-96ed-0cf599953310 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:30:38.221255 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61183c2-2e5e-447d-96ed-0cf599953310 admin admin] PATH_INFO: `/v3/projects/4f17acf6c1ed4f499a3d4fdee5c9dddf/users/bbc8687954614dfb9b5bbef2835e4ac0/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:30:38.236019 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61183c2-2e5e-447d-96ed-0cf599953310 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f17acf6c1ed4f499a3d4fdee5c9dddf, user_id=bbc8687954614dfb9b5bbef2835e4ac0, role_id=33b8a5a8d1d643f2a98f598e6ab0a1cf)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:30:38.238718 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61183c2-2e5e-447d-96ed-0cf599953310 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:30:38.344036 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1183/2364] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:30:38 2021] PUT /identity/v3/projects/4f17acf6c1ed4f499a3d4fdee5c9dddf/users/bbc8687954614dfb9b5bbef2835e4ac0/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:30:38.360097 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d9d7d-74b9-4b67-a236-4ac46b4f26da None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:30:38.360992 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d9d7d-74b9-4b67-a236-4ac46b4f26da None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:30:38.361530 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d9d7d-74b9-4b67-a236-4ac46b4f26da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:30:38.391172 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-010d9d7d-74b9-4b67-a236-4ac46b4f26da None None] MFA Rules not processed for user `bbc8687954614dfb9b5bbef2835e4ac0`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:30:38.392559 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-010d9d7d-74b9-4b67-a236-4ac46b4f26da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:30:38.466247 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1182/2365] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:30:38 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:30:38.470930 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61183c2-2e5e-447d-96ed-0cf599953310 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:30:38.534441 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61183c2-2e5e-447d-96ed-0cf599953310 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:30:38.540572 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ae4f9-5f16-4912-88e6-ce8e3360b3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:30:38.541242 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ae4f9-5f16-4912-88e6-ce8e3360b3f5 admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:30:38.541524 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ae4f9-5f16-4912-88e6-ce8e3360b3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:30:38.541800 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ae4f9-5f16-4912-88e6-ce8e3360b3f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:30:38.542515 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08ae4f9-5f16-4912-88e6-ce8e3360b3f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:30:38.544516 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08ae4f9-5f16-4912-88e6-ce8e3360b3f5 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:30:38.633516 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1184/2366] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:30:38 2021] POST /identity/v3/projects => generated 375 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:30:38.637762 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d9d7d-74b9-4b67-a236-4ac46b4f26da None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:30:38.672023 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d9d7d-74b9-4b67-a236-4ac46b4f26da None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:30:38.706469 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326c4b8d-c197-43c6-af99-59fdfdd00f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:30:38.707147 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c4b8d-c197-43c6-af99-59fdfdd00f8d admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:30:38.707435 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c4b8d-c197-43c6-af99-59fdfdd00f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:30:38.707707 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c4b8d-c197-43c6-af99-59fdfdd00f8d admin admin] PATH_INFO: `/v3/users` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:30:38.708457 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326c4b8d-c197-43c6-af99-59fdfdd00f8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:30:38.710431 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326c4b8d-c197-43c6-af99-59fdfdd00f8d admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:30:38.804489 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1183/2367] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:30:38 2021] POST /identity/v3/users => generated 294 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:30:38.806340 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ae4f9-5f16-4912-88e6-ce8e3360b3f5 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:30:38.818286 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ae4f9-5f16-4912-88e6-ce8e3360b3f5 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:30:38.823320 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed240528-3655-4deb-809a-1035b9508547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:30:38.829999 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed240528-3655-4deb-809a-1035b9508547 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:30:38.829999 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed240528-3655-4deb-809a-1035b9508547 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:30:38.829999 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed240528-3655-4deb-809a-1035b9508547 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:30:38.829999 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed240528-3655-4deb-809a-1035b9508547 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:30:38.829999 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed240528-3655-4deb-809a-1035b9508547 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:30:38.837940 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1185/2368] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:30:38 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:30:38.842290 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326c4b8d-c197-43c6-af99-59fdfdd00f8d admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:30:38.852546 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326c4b8d-c197-43c6-af99-59fdfdd00f8d admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:30:38.857148 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecaee44-5fa7-49ac-8681-7027f9519ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:30:38.858015 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecaee44-5fa7-49ac-8681-7027f9519ac5 admin admin] REQUEST_METHOD: `PUT` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:30:38.858297 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecaee44-5fa7-49ac-8681-7027f9519ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:30:38.858569 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecaee44-5fa7-49ac-8681-7027f9519ac5 admin admin] PATH_INFO: `/v3/projects/0fc89677775641e682e78d255570eddf/users/a2c7f816a6ed416b9315d79ec95a002b/roles/6c54f239944d46e3b027ccce97eb8b49` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:30:38.873560 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecaee44-5fa7-49ac-8681-7027f9519ac5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fc89677775641e682e78d255570eddf, user_id=a2c7f816a6ed416b9315d79ec95a002b, role_id=6c54f239944d46e3b027ccce97eb8b49)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:30:38.876147 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecaee44-5fa7-49ac-8681-7027f9519ac5 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:30:38.969046 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1184/2369] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:30:38 2021] PUT /identity/v3/projects/0fc89677775641e682e78d255570eddf/users/a2c7f816a6ed416b9315d79ec95a002b/roles/6c54f239944d46e3b027ccce97eb8b49 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:30:38.973788 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed240528-3655-4deb-809a-1035b9508547 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:30:38.983883 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed240528-3655-4deb-809a-1035b9508547 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:30:39.039820 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c3defe-c94b-4601-a5e6-e1e32441eb0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:30:39.040551 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c3defe-c94b-4601-a5e6-e1e32441eb0b admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:30:39.040837 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c3defe-c94b-4601-a5e6-e1e32441eb0b admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:30:39.041251 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c3defe-c94b-4601-a5e6-e1e32441eb0b admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:30:39.041856 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c3defe-c94b-4601-a5e6-e1e32441eb0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:30:39.043457 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c3defe-c94b-4601-a5e6-e1e32441eb0b admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:30:39.053504 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1186/2370] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:30:38 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 18:30:39.057957 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecaee44-5fa7-49ac-8681-7027f9519ac5 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:30:39.068439 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecaee44-5fa7-49ac-8681-7027f9519ac5 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:30:39.073233 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3da90c1-3b1e-48db-b7a3-b8fb21ace8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:30:39.074189 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da90c1-3b1e-48db-b7a3-b8fb21ace8f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:30:39.074490 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da90c1-3b1e-48db-b7a3-b8fb21ace8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:30:39.074758 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da90c1-3b1e-48db-b7a3-b8fb21ace8f9 admin admin] PATH_INFO: `/v3/projects/0fc89677775641e682e78d255570eddf/users/a2c7f816a6ed416b9315d79ec95a002b/roles/6c54f239944d46e3b027ccce97eb8b49` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:30:39.076728 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3da90c1-3b1e-48db-b7a3-b8fb21ace8f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fc89677775641e682e78d255570eddf, user_id=a2c7f816a6ed416b9315d79ec95a002b, role_id=6c54f239944d46e3b027ccce97eb8b49)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:30:39.079967 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3da90c1-3b1e-48db-b7a3-b8fb21ace8f9 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:30:39.090432 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1185/2371] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:30:39 2021] PUT /identity/v3/projects/0fc89677775641e682e78d255570eddf/users/a2c7f816a6ed416b9315d79ec95a002b/roles/6c54f239944d46e3b027ccce97eb8b49 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:30:39.101192 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dae1db-e71d-4346-9c0c-97595ef6cb3a None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:30:39.101479 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dae1db-e71d-4346-9c0c-97595ef6cb3a None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:30:39.101755 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dae1db-e71d-4346-9c0c-97595ef6cb3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:30:39.127963 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-a7dae1db-e71d-4346-9c0c-97595ef6cb3a None None] MFA Rules not processed for user `a2c7f816a6ed416b9315d79ec95a002b`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:30:39.129104 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-a7dae1db-e71d-4346-9c0c-97595ef6cb3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:30:39.195457 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1187/2372] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:30:39 2021] POST /identity/v3/auth/tokens => generated 3462 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:30:39.205762 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3da90c1-3b1e-48db-b7a3-b8fb21ace8f9 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:30:39.207737 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-c3da90c1-3b1e-48db-b7a3-b8fb21ace8f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:30:39.270739 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3da90c1-3b1e-48db-b7a3-b8fb21ace8f9 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:30:39.274726 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebad1b9e-4fba-4e8b-b8a0-ad5a653a1e0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6966ce0774f4437a9b688494e9d0574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:30:39.275586 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebad1b9e-4fba-4e8b-b8a0-ad5a653a1e0b service cinder] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:30:39.275935 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebad1b9e-4fba-4e8b-b8a0-ad5a653a1e0b service cinder] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:30:39.276308 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebad1b9e-4fba-4e8b-b8a0-ad5a653a1e0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:30:39.335490 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebad1b9e-4fba-4e8b-b8a0-ad5a653a1e0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:30:39.336990 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebad1b9e-4fba-4e8b-b8a0-ad5a653a1e0b service cinder] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:30:39.346844 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1186/2373] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:30:39 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 18:30:42.455233 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dae1db-e71d-4346-9c0c-97595ef6cb3a None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:30:42.457138 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-a7dae1db-e71d-4346-9c0c-97595ef6cb3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:30:42.540334 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dae1db-e71d-4346-9c0c-97595ef6cb3a None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:30:42.546822 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2397dae5-ba5a-40f8-a743-fe45869c39a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3417097a280b499086b36df9a2548239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:30:42.547478 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2397dae5-ba5a-40f8-a743-fe45869c39a3 service nova] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:30:42.547755 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2397dae5-ba5a-40f8-a743-fe45869c39a3 service nova] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:30:42.548026 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2397dae5-ba5a-40f8-a743-fe45869c39a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:30:42.550780 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-2397dae5-ba5a-40f8-a743-fe45869c39a3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:30:42.612162 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2397dae5-ba5a-40f8-a743-fe45869c39a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:30:42.613934 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2397dae5-ba5a-40f8-a743-fe45869c39a3 service nova] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:30:42.623887 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1188/2374] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:30:42 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:30:46.886657 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebad1b9e-4fba-4e8b-b8a0-ad5a653a1e0b service cinder] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:30:46.897238 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebad1b9e-4fba-4e8b-b8a0-ad5a653a1e0b service cinder] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:30:46.901457 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184291a6-5e4f-4351-b3be-04818da9d5e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6966ce0774f4437a9b688494e9d0574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:30:46.902119 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184291a6-5e4f-4351-b3be-04818da9d5e8 service cinder] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:30:46.902401 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184291a6-5e4f-4351-b3be-04818da9d5e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:30:46.903033 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184291a6-5e4f-4351-b3be-04818da9d5e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:30:46.913946 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184291a6-5e4f-4351-b3be-04818da9d5e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:30:46.915635 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184291a6-5e4f-4351-b3be-04818da9d5e8 service cinder] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:30:46.927305 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1187/2375] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:30:46 2021] GET /identity/v3/auth/tokens => generated 3462 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:31:05.847724 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2397dae5-ba5a-40f8-a743-fe45869c39a3 service nova] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:31:05.850032 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-2397dae5-ba5a-40f8-a743-fe45869c39a3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:31:05.905347 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2397dae5-ba5a-40f8-a743-fe45869c39a3 service nova] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:31:05.909111 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faca5ea-8747-4928-baec-8bc55531ddb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:31:05.909754 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faca5ea-8747-4928-baec-8bc55531ddb0 service neutron] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:31:05.910076 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faca5ea-8747-4928-baec-8bc55531ddb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:31:05.910301 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faca5ea-8747-4928-baec-8bc55531ddb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:31:05.912729 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-5faca5ea-8747-4928-baec-8bc55531ddb0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:31:05.922890 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faca5ea-8747-4928-baec-8bc55531ddb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:31:05.924316 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faca5ea-8747-4928-baec-8bc55531ddb0 service neutron] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:31:05.932391 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1189/2376] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:31:05 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:31:20.383344 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184291a6-5e4f-4351-b3be-04818da9d5e8 service cinder] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:31:20.453850 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184291a6-5e4f-4351-b3be-04818da9d5e8 service cinder] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:31:20.457462 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b1465-a214-42ba-9a24-a951154c483d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:31:20.458336 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b1465-a214-42ba-9a24-a951154c483d admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:31:20.458617 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b1465-a214-42ba-9a24-a951154c483d admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:31:20.458895 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b1465-a214-42ba-9a24-a951154c483d admin admin] PATH_INFO: `/v3/users/bbc8687954614dfb9b5bbef2835e4ac0` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:31:20.460136 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73b1465-a214-42ba-9a24-a951154c483d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbc8687954614dfb9b5bbef2835e4ac0)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:31:20.464671 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73b1465-a214-42ba-9a24-a951154c483d admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:31:20.784743 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-b73b1465-a214-42ba-9a24-a951154c483d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbc8687954614dfb9b5bbef2835e4ac0'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:31:20.791490 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-b73b1465-a214-42ba-9a24-a951154c483d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbc8687954614dfb9b5bbef2835e4ac0'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:31:20.802796 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-b73b1465-a214-42ba-9a24-a951154c483d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbc8687954614dfb9b5bbef2835e4ac0'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:31:20.902553 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-b73b1465-a214-42ba-9a24-a951154c483d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbc8687954614dfb9b5bbef2835e4ac0'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:31:20.903446 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-b73b1465-a214-42ba-9a24-a951154c483d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbc8687954614dfb9b5bbef2835e4ac0'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:31:20.910014 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1188/2377] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:31:20 2021] DELETE /identity/v3/users/bbc8687954614dfb9b5bbef2835e4ac0 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:31:20.914761 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3562e6eb-aed3-4c44-a991-f2d0593388a5 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:31:20.915285 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3562e6eb-aed3-4c44-a991-f2d0593388a5 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:31:20.915391 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3562e6eb-aed3-4c44-a991-f2d0593388a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:31:20.935119 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-3562e6eb-aed3-4c44-a991-f2d0593388a5 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:31:20.936324 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-3562e6eb-aed3-4c44-a991-f2d0593388a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:31:21.001887 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1190/2378] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:31:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:31:21.012812 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b1465-a214-42ba-9a24-a951154c483d admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:31:21.014227 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-b73b1465-a214-42ba-9a24-a951154c483d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:31:21.069154 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b1465-a214-42ba-9a24-a951154c483d admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:31:21.073534 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e11c65e-d766-466c-8ff1-06c5861f97b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:31:21.074184 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e11c65e-d766-466c-8ff1-06c5861f97b2 service neutron] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:31:21.074463 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e11c65e-d766-466c-8ff1-06c5861f97b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:31:21.074738 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e11c65e-d766-466c-8ff1-06c5861f97b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:31:21.083995 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e11c65e-d766-466c-8ff1-06c5861f97b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:31:21.085520 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e11c65e-d766-466c-8ff1-06c5861f97b2 service neutron] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:31:21.095148 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1189/2379] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:31:21 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:31:21.575076 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3562e6eb-aed3-4c44-a991-f2d0593388a5 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:31:21.576506 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-3562e6eb-aed3-4c44-a991-f2d0593388a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:31:21.590421 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3562e6eb-aed3-4c44-a991-f2d0593388a5 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:31:21.596470 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d4553f-d278-419b-8d07-07752c42f537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:31:21.597949 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d4553f-d278-419b-8d07-07752c42f537 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:31:21.598397 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d4553f-d278-419b-8d07-07752c42f537 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:31:21.598834 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d4553f-d278-419b-8d07-07752c42f537 admin admin] PATH_INFO: `/v3/projects/4f17acf6c1ed4f499a3d4fdee5c9dddf` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:31:21.602121 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d4553f-d278-419b-8d07-07752c42f537 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f17acf6c1ed4f499a3d4fdee5c9dddf)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:31:21.606237 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d4553f-d278-419b-8d07-07752c42f537 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:31:21.874683 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-28d4553f-d278-419b-8d07-07752c42f537 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f17acf6c1ed4f499a3d4fdee5c9dddf', 'request_id': 'req-28d4553f-d278-419b-8d07-07752c42f537'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:31:21.881008 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-28d4553f-d278-419b-8d07-07752c42f537 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f17acf6c1ed4f499a3d4fdee5c9dddf', 'request_id': 'req-28d4553f-d278-419b-8d07-07752c42f537'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:31:21.887804 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-28d4553f-d278-419b-8d07-07752c42f537 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f17acf6c1ed4f499a3d4fdee5c9dddf', 'request_id': 'req-28d4553f-d278-419b-8d07-07752c42f537'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:31:21.999889 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-28d4553f-d278-419b-8d07-07752c42f537 admin admin] The token cache is being invalidate because project 4f17acf6c1ed4f499a3d4fdee5c9dddf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74005) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:31:22.000651 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-28d4553f-d278-419b-8d07-07752c42f537 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:31:22.000986 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-28d4553f-d278-419b-8d07-07752c42f537 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:31:22.002540 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1191/2380] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:31:21 2021] DELETE /identity/v3/projects/4f17acf6c1ed4f499a3d4fdee5c9dddf => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:31:22.006607 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e11c65e-d766-466c-8ff1-06c5861f97b2 service neutron] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:31:22.016878 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e11c65e-d766-466c-8ff1-06c5861f97b2 service neutron] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:31:22.075562 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335824a7-7447-45f8-8619-6e4da93844b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:31:22.076466 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335824a7-7447-45f8-8619-6e4da93844b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:31:22.076753 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335824a7-7447-45f8-8619-6e4da93844b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:31:22.077031 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335824a7-7447-45f8-8619-6e4da93844b6 admin admin] PATH_INFO: `/v3/users/a2c7f816a6ed416b9315d79ec95a002b` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:31:22.078280 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335824a7-7447-45f8-8619-6e4da93844b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2c7f816a6ed416b9315d79ec95a002b)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:31:22.080223 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335824a7-7447-45f8-8619-6e4da93844b6 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:31:22.300819 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-335824a7-7447-45f8-8619-6e4da93844b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2c7f816a6ed416b9315d79ec95a002b'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:31:22.308382 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-335824a7-7447-45f8-8619-6e4da93844b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2c7f816a6ed416b9315d79ec95a002b'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:31:22.321496 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-335824a7-7447-45f8-8619-6e4da93844b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2c7f816a6ed416b9315d79ec95a002b'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:31:22.405282 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-335824a7-7447-45f8-8619-6e4da93844b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2c7f816a6ed416b9315d79ec95a002b'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:31:22.405914 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-335824a7-7447-45f8-8619-6e4da93844b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2c7f816a6ed416b9315d79ec95a002b'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:31:22.412370 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1190/2381] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:31:22 2021] DELETE /identity/v3/users/a2c7f816a6ed416b9315d79ec95a002b => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:31:22.836391 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d4553f-d278-419b-8d07-07752c42f537 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:31:22.840595 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-28d4553f-d278-419b-8d07-07752c42f537 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:31:22.853749 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d4553f-d278-419b-8d07-07752c42f537 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:31:22.916300 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c80c479-4b09-4744-bc28-78e585d34094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:31:22.917178 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c80c479-4b09-4744-bc28-78e585d34094 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:31:22.917458 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c80c479-4b09-4744-bc28-78e585d34094 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:31:22.917730 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c80c479-4b09-4744-bc28-78e585d34094 admin admin] PATH_INFO: `/v3/projects/0fc89677775641e682e78d255570eddf` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:31:22.919094 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c80c479-4b09-4744-bc28-78e585d34094 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fc89677775641e682e78d255570eddf)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:31:22.921063 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c80c479-4b09-4744-bc28-78e585d34094 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:31:23.052222 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-3c80c479-4b09-4744-bc28-78e585d34094 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fc89677775641e682e78d255570eddf', 'request_id': 'req-3c80c479-4b09-4744-bc28-78e585d34094'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:31:23.058172 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-3c80c479-4b09-4744-bc28-78e585d34094 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fc89677775641e682e78d255570eddf', 'request_id': 'req-3c80c479-4b09-4744-bc28-78e585d34094'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:31:23.063346 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-3c80c479-4b09-4744-bc28-78e585d34094 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fc89677775641e682e78d255570eddf', 'request_id': 'req-3c80c479-4b09-4744-bc28-78e585d34094'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:31:23.205563 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-3c80c479-4b09-4744-bc28-78e585d34094 admin admin] The token cache is being invalidate because project 0fc89677775641e682e78d255570eddf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74005) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:31:23.205784 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-3c80c479-4b09-4744-bc28-78e585d34094 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:31:23.206439 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-3c80c479-4b09-4744-bc28-78e585d34094 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:31:23.208029 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1192/2382] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:31:22 2021] DELETE /identity/v3/projects/0fc89677775641e682e78d255570eddf => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:31:23.214827 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f432608-18b0-4039-bfbc-4ee6715e9f2a None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:31:23.215382 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f432608-18b0-4039-bfbc-4ee6715e9f2a None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:31:23.215495 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f432608-18b0-4039-bfbc-4ee6715e9f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:31:23.235454 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-2f432608-18b0-4039-bfbc-4ee6715e9f2a None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:31:23.236696 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-2f432608-18b0-4039-bfbc-4ee6715e9f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:31:23.297820 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1191/2383] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:31:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:31:23.307125 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca0a84-8640-432e-885f-333ffdc73530 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:31:23.307412 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca0a84-8640-432e-885f-333ffdc73530 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:31:23.307688 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca0a84-8640-432e-885f-333ffdc73530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:31:23.328592 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-f4ca0a84-8640-432e-885f-333ffdc73530 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:31:23.329844 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-f4ca0a84-8640-432e-885f-333ffdc73530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:31:23.338504 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1193/2384] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:31:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:31:23.342969 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f432608-18b0-4039-bfbc-4ee6715e9f2a None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:31:23.353143 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f432608-18b0-4039-bfbc-4ee6715e9f2a None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:31:23.357891 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e8e304-6411-4d10-a946-84b78842f1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:31:23.358549 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e8e304-6411-4d10-a946-84b78842f1e1 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:31:23.358895 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e8e304-6411-4d10-a946-84b78842f1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:31:23.359165 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e8e304-6411-4d10-a946-84b78842f1e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:31:23.359883 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e8e304-6411-4d10-a946-84b78842f1e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:31:23.360195 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e8e304-6411-4d10-a946-84b78842f1e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:31:23.361827 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e8e304-6411-4d10-a946-84b78842f1e1 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:31:23.376968 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1192/2385] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 12 18:31:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:31:23.381537 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ca0a84-8640-432e-885f-333ffdc73530 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:31:23.392064 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ca0a84-8640-432e-885f-333ffdc73530 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:31:23.397084 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b35fe2a-8c81-40cd-a6f1-8de0660f830c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:31:23.397742 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b35fe2a-8c81-40cd-a6f1-8de0660f830c admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:31:23.398022 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b35fe2a-8c81-40cd-a6f1-8de0660f830c admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:31:23.398297 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b35fe2a-8c81-40cd-a6f1-8de0660f830c admin admin] PATH_INFO: `/v3/projects` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:31:23.399606 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b35fe2a-8c81-40cd-a6f1-8de0660f830c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:31:23.401581 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b35fe2a-8c81-40cd-a6f1-8de0660f830c admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:31:23.510976 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1194/2386] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:31:23 2021] POST /identity/v3/projects => generated 373 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:31:23.515687 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e8e304-6411-4d10-a946-84b78842f1e1 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:31:23.526350 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e8e304-6411-4d10-a946-84b78842f1e1 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:31:23.585247 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2f45c3-583e-4e3e-b275-54593c76e087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:31:23.585913 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2f45c3-583e-4e3e-b275-54593c76e087 admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:31:23.586762 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2f45c3-583e-4e3e-b275-54593c76e087 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:31:23.587118 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2f45c3-583e-4e3e-b275-54593c76e087 admin admin] PATH_INFO: `/v3/users` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:31:23.587906 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2f45c3-583e-4e3e-b275-54593c76e087 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:31:23.589867 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2f45c3-583e-4e3e-b275-54593c76e087 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:31:23.710832 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1193/2387] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:31:23 2021] POST /identity/v3/users => generated 287 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:31:23.715185 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b35fe2a-8c81-40cd-a6f1-8de0660f830c admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:31:23.726033 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b35fe2a-8c81-40cd-a6f1-8de0660f830c admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:31:23.731019 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c71e465-9a60-4bc7-a545-086f9a7ede57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:31:23.731408 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71e465-9a60-4bc7-a545-086f9a7ede57 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:31:23.731690 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71e465-9a60-4bc7-a545-086f9a7ede57 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:31:23.731962 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71e465-9a60-4bc7-a545-086f9a7ede57 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:31:23.732729 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c71e465-9a60-4bc7-a545-086f9a7ede57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:31:23.734327 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c71e465-9a60-4bc7-a545-086f9a7ede57 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:31:23.745505 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1195/2388] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:31:23 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:31:23.749827 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2f45c3-583e-4e3e-b275-54593c76e087 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:31:23.760720 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2f45c3-583e-4e3e-b275-54593c76e087 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:31:23.765637 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a0efde-bda6-4bce-ae81-ef694b43f7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:31:23.766248 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0efde-bda6-4bce-ae81-ef694b43f7ee admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:31:23.766528 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0efde-bda6-4bce-ae81-ef694b43f7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:31:23.766803 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0efde-bda6-4bce-ae81-ef694b43f7ee admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:31:23.767542 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a0efde-bda6-4bce-ae81-ef694b43f7ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:31:23.769209 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a0efde-bda6-4bce-ae81-ef694b43f7ee admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:31:23.780327 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1194/2389] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:31:23 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:31:23.791854 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c71e465-9a60-4bc7-a545-086f9a7ede57 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:31:23.802532 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c71e465-9a60-4bc7-a545-086f9a7ede57 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:31:23.808355 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00111a48-e1cc-4756-a42a-e3f83339af9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:31:23.809306 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00111a48-e1cc-4756-a42a-e3f83339af9c admin admin] REQUEST_METHOD: `PUT` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:31:23.809592 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00111a48-e1cc-4756-a42a-e3f83339af9c admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:31:23.809872 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00111a48-e1cc-4756-a42a-e3f83339af9c admin admin] PATH_INFO: `/v3/projects/ebbbe2b63cc947baa05f21e24ba313a8/users/ca83ecf69a2f4cbd8516f53440f0965b/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:31:23.825187 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00111a48-e1cc-4756-a42a-e3f83339af9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebbbe2b63cc947baa05f21e24ba313a8, user_id=ca83ecf69a2f4cbd8516f53440f0965b, role_id=33b8a5a8d1d643f2a98f598e6ab0a1cf)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:31:23.827877 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00111a48-e1cc-4756-a42a-e3f83339af9c admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:31:23.962640 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1196/2390] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:31:23 2021] PUT /identity/v3/projects/ebbbe2b63cc947baa05f21e24ba313a8/users/ca83ecf69a2f4cbd8516f53440f0965b/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:31:23.968192 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b805f3-3312-4ec0-b4b1-27c3ecb19047 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:31:23.968516 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b805f3-3312-4ec0-b4b1-27c3ecb19047 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:31:23.968798 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b805f3-3312-4ec0-b4b1-27c3ecb19047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:31:23.986806 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-a1b805f3-3312-4ec0-b4b1-27c3ecb19047 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:31:23.988015 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-a1b805f3-3312-4ec0-b4b1-27c3ecb19047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:31:24.049321 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1195/2391] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:31:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:31:24.059645 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00111a48-e1cc-4756-a42a-e3f83339af9c admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:31:24.061435 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-00111a48-e1cc-4756-a42a-e3f83339af9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:31:24.116633 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00111a48-e1cc-4756-a42a-e3f83339af9c admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:31:24.121090 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75684939-2cfa-463a-aef9-848a8302945d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:31:24.121732 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75684939-2cfa-463a-aef9-848a8302945d service neutron] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:31:24.122004 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75684939-2cfa-463a-aef9-848a8302945d service neutron] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:31:24.122273 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75684939-2cfa-463a-aef9-848a8302945d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:31:24.132066 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75684939-2cfa-463a-aef9-848a8302945d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:31:24.133614 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75684939-2cfa-463a-aef9-848a8302945d service neutron] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:31:24.143849 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1197/2392] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:31:24 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:31:25.450095 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cdaf29-207e-43ca-a500-b3f9a67d978a None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:31:25.450663 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cdaf29-207e-43ca-a500-b3f9a67d978a None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:31:25.450663 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cdaf29-207e-43ca-a500-b3f9a67d978a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:31:25.485137 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-c5cdaf29-207e-43ca-a500-b3f9a67d978a None None] MFA Rules not processed for user `ca83ecf69a2f4cbd8516f53440f0965b`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:31:25.486445 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-c5cdaf29-207e-43ca-a500-b3f9a67d978a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:31:25.559536 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1196/2393] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:31:25 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:31:25.564350 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75684939-2cfa-463a-aef9-848a8302945d service neutron] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:31:25.574281 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75684939-2cfa-463a-aef9-848a8302945d service neutron] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:31:25.578962 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3be6e6-7897-4502-854b-9ced12744bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:31:25.579711 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3be6e6-7897-4502-854b-9ced12744bf8 admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:31:25.580190 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3be6e6-7897-4502-854b-9ced12744bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:31:25.580506 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3be6e6-7897-4502-854b-9ced12744bf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:31:25.581212 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3be6e6-7897-4502-854b-9ced12744bf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:31:25.583138 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3be6e6-7897-4502-854b-9ced12744bf8 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:31:25.715779 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1198/2394] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:31:25 2021] POST /identity/v3/projects => generated 371 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:31:25.719866 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cdaf29-207e-43ca-a500-b3f9a67d978a None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:31:25.731767 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cdaf29-207e-43ca-a500-b3f9a67d978a None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:31:25.790438 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4bbc07-85b6-49f5-b691-93ae4c279a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:31:25.791108 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4bbc07-85b6-49f5-b691-93ae4c279a09 admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:31:25.791384 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4bbc07-85b6-49f5-b691-93ae4c279a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:31:25.791658 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4bbc07-85b6-49f5-b691-93ae4c279a09 admin admin] PATH_INFO: `/v3/users` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:31:25.792358 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4bbc07-85b6-49f5-b691-93ae4c279a09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:31:25.794362 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4bbc07-85b6-49f5-b691-93ae4c279a09 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:31:25.942806 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1197/2395] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:31:25 2021] POST /identity/v3/users => generated 292 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:31:25.946969 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3be6e6-7897-4502-854b-9ced12744bf8 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:31:25.957603 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3be6e6-7897-4502-854b-9ced12744bf8 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:31:25.962876 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763354eb-492a-4120-88ad-e42c3908fe25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:31:25.963546 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763354eb-492a-4120-88ad-e42c3908fe25 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:31:25.963873 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763354eb-492a-4120-88ad-e42c3908fe25 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:31:25.964154 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763354eb-492a-4120-88ad-e42c3908fe25 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:31:25.965008 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763354eb-492a-4120-88ad-e42c3908fe25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:31:25.966682 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763354eb-492a-4120-88ad-e42c3908fe25 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:31:25.978952 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1199/2396] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:31:25 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:31:25.983179 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4bbc07-85b6-49f5-b691-93ae4c279a09 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:31:25.993122 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4bbc07-85b6-49f5-b691-93ae4c279a09 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:31:25.997921 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13ed02f-7350-498c-9217-8b35c52b36a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:31:25.998810 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ed02f-7350-498c-9217-8b35c52b36a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:31:25.999084 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ed02f-7350-498c-9217-8b35c52b36a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:31:25.999354 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ed02f-7350-498c-9217-8b35c52b36a2 admin admin] PATH_INFO: `/v3/projects/11aa5e3aa9dc4e1da0883847ab8afa84/users/1f29a4cfa42b4cc0a9e4b246515da9b6/roles/6c54f239944d46e3b027ccce97eb8b49` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:31:26.014766 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13ed02f-7350-498c-9217-8b35c52b36a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11aa5e3aa9dc4e1da0883847ab8afa84, user_id=1f29a4cfa42b4cc0a9e4b246515da9b6, role_id=6c54f239944d46e3b027ccce97eb8b49)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:31:26.017469 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13ed02f-7350-498c-9217-8b35c52b36a2 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:31:26.119899 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1198/2397] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:31:25 2021] PUT /identity/v3/projects/11aa5e3aa9dc4e1da0883847ab8afa84/users/1f29a4cfa42b4cc0a9e4b246515da9b6/roles/6c54f239944d46e3b027ccce97eb8b49 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:31:26.124040 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763354eb-492a-4120-88ad-e42c3908fe25 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:31:26.134037 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763354eb-492a-4120-88ad-e42c3908fe25 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:31:26.190324 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e17ce59-59e5-4add-92c0-c197b350517a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:31:26.191002 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17ce59-59e5-4add-92c0-c197b350517a admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:31:26.191285 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17ce59-59e5-4add-92c0-c197b350517a admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:31:26.191562 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17ce59-59e5-4add-92c0-c197b350517a admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:31:26.192309 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e17ce59-59e5-4add-92c0-c197b350517a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:31:26.193969 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e17ce59-59e5-4add-92c0-c197b350517a admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:31:26.204699 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1200/2398] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:31:26 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:31:26.210831 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13ed02f-7350-498c-9217-8b35c52b36a2 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:31:26.226372 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13ed02f-7350-498c-9217-8b35c52b36a2 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:31:26.231903 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c55555b-66b0-46b3-9a0c-569f2b65e6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:31:26.233227 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55555b-66b0-46b3-9a0c-569f2b65e6cb admin admin] REQUEST_METHOD: `PUT` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:31:26.233227 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55555b-66b0-46b3-9a0c-569f2b65e6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:31:26.233423 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55555b-66b0-46b3-9a0c-569f2b65e6cb admin admin] PATH_INFO: `/v3/projects/11aa5e3aa9dc4e1da0883847ab8afa84/users/1f29a4cfa42b4cc0a9e4b246515da9b6/roles/6c54f239944d46e3b027ccce97eb8b49` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:31:26.235454 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c55555b-66b0-46b3-9a0c-569f2b65e6cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=11aa5e3aa9dc4e1da0883847ab8afa84, user_id=1f29a4cfa42b4cc0a9e4b246515da9b6, role_id=6c54f239944d46e3b027ccce97eb8b49)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:31:26.238188 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c55555b-66b0-46b3-9a0c-569f2b65e6cb admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:31:26.249540 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1199/2399] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:31:26 2021] PUT /identity/v3/projects/11aa5e3aa9dc4e1da0883847ab8afa84/users/1f29a4cfa42b4cc0a9e4b246515da9b6/roles/6c54f239944d46e3b027ccce97eb8b49 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:31:27.658159 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89edb846-bae0-4b2a-822e-371abc96eb9f None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:31:27.658763 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89edb846-bae0-4b2a-822e-371abc96eb9f None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:31:27.658987 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89edb846-bae0-4b2a-822e-371abc96eb9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:31:27.702501 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-89edb846-bae0-4b2a-822e-371abc96eb9f None None] MFA Rules not processed for user `1f29a4cfa42b4cc0a9e4b246515da9b6`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:31:27.704685 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-89edb846-bae0-4b2a-822e-371abc96eb9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:31:27.804297 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1201/2400] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:31:27 2021] POST /identity/v3/auth/tokens => generated 3458 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:31:27.816502 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c55555b-66b0-46b3-9a0c-569f2b65e6cb admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:31:27.818291 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-7c55555b-66b0-46b3-9a0c-569f2b65e6cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:31:27.878359 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c55555b-66b0-46b3-9a0c-569f2b65e6cb admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:31:27.882307 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbc74fb-5e37-4593-a3a3-2c32fd73bada service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6966ce0774f4437a9b688494e9d0574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:31:27.886457 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc74fb-5e37-4593-a3a3-2c32fd73bada service cinder] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:31:27.886457 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc74fb-5e37-4593-a3a3-2c32fd73bada service cinder] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:31:27.886457 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc74fb-5e37-4593-a3a3-2c32fd73bada service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:31:27.941380 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbc74fb-5e37-4593-a3a3-2c32fd73bada service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:31:27.942820 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbc74fb-5e37-4593-a3a3-2c32fd73bada service cinder] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:31:27.952768 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1200/2401] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:31:27 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:31:29.686514 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89edb846-bae0-4b2a-822e-371abc96eb9f None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:31:29.688122 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-89edb846-bae0-4b2a-822e-371abc96eb9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:31:29.701203 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89edb846-bae0-4b2a-822e-371abc96eb9f None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:31:29.705078 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fec32a-8adc-4459-99dd-39915cd22dbd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6966ce0774f4437a9b688494e9d0574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:31:29.705767 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fec32a-8adc-4459-99dd-39915cd22dbd service cinder] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:31:29.706045 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fec32a-8adc-4459-99dd-39915cd22dbd service cinder] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:31:29.706316 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fec32a-8adc-4459-99dd-39915cd22dbd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:31:29.716467 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fec32a-8adc-4459-99dd-39915cd22dbd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:31:29.717923 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fec32a-8adc-4459-99dd-39915cd22dbd service cinder] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:31:29.727807 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1202/2402] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:31:29 2021] GET /identity/v3/auth/tokens => generated 3458 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:31:46.102670 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbc74fb-5e37-4593-a3a3-2c32fd73bada service cinder] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:31:46.164449 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbc74fb-5e37-4593-a3a3-2c32fd73bada service cinder] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:31:46.169282 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1493266-7166-4794-bcda-0c801dde0974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:31:46.170174 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1493266-7166-4794-bcda-0c801dde0974 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:31:46.170514 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1493266-7166-4794-bcda-0c801dde0974 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:31:46.174799 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1493266-7166-4794-bcda-0c801dde0974 admin admin] PATH_INFO: `/v3/users/ca83ecf69a2f4cbd8516f53440f0965b` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:31:46.174799 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1493266-7166-4794-bcda-0c801dde0974 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca83ecf69a2f4cbd8516f53440f0965b)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:31:46.174799 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1493266-7166-4794-bcda-0c801dde0974 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:31:46.357152 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-f1493266-7166-4794-bcda-0c801dde0974 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca83ecf69a2f4cbd8516f53440f0965b'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:31:46.363762 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-f1493266-7166-4794-bcda-0c801dde0974 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca83ecf69a2f4cbd8516f53440f0965b'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:31:46.375821 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-f1493266-7166-4794-bcda-0c801dde0974 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca83ecf69a2f4cbd8516f53440f0965b'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:31:46.421149 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fec32a-8adc-4459-99dd-39915cd22dbd service cinder] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:31:46.422630 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-f3fec32a-8adc-4459-99dd-39915cd22dbd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:31:46.450780 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-f1493266-7166-4794-bcda-0c801dde0974 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca83ecf69a2f4cbd8516f53440f0965b'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:31:46.451685 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-f1493266-7166-4794-bcda-0c801dde0974 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca83ecf69a2f4cbd8516f53440f0965b'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:31:46.462158 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1201/2403] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:31:46 2021] DELETE /identity/v3/users/ca83ecf69a2f4cbd8516f53440f0965b => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:31:46.503502 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fec32a-8adc-4459-99dd-39915cd22dbd service cinder] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:31:46.581620 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f373b-3924-4074-8775-3d9b80cc0948 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3417097a280b499086b36df9a2548239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:31:46.582280 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f373b-3924-4074-8775-3d9b80cc0948 service nova] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:31:46.582563 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f373b-3924-4074-8775-3d9b80cc0948 service nova] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:31:46.582837 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f373b-3924-4074-8775-3d9b80cc0948 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:31:46.584879 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-5b2f373b-3924-4074-8775-3d9b80cc0948 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:31:46.652287 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2f373b-3924-4074-8775-3d9b80cc0948 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:31:46.654197 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2f373b-3924-4074-8775-3d9b80cc0948 service nova] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:31:46.663126 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1203/2404] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:31:46 2021] GET /identity/v3/auth/tokens => generated 3409 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 18:31:46.759309 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1493266-7166-4794-bcda-0c801dde0974 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:31:46.763835 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-f1493266-7166-4794-bcda-0c801dde0974 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:31:46.848221 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1493266-7166-4794-bcda-0c801dde0974 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:31:46.853581 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a24367-b804-4246-b818-0efba18367b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:31:46.859907 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a24367-b804-4246-b818-0efba18367b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:31:46.859907 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a24367-b804-4246-b818-0efba18367b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:31:46.859907 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a24367-b804-4246-b818-0efba18367b8 admin admin] PATH_INFO: `/v3/projects/ebbbe2b63cc947baa05f21e24ba313a8` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:31:46.859907 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a24367-b804-4246-b818-0efba18367b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebbbe2b63cc947baa05f21e24ba313a8)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:31:46.860838 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a24367-b804-4246-b818-0efba18367b8 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:31:47.002078 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-17a24367-b804-4246-b818-0efba18367b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebbbe2b63cc947baa05f21e24ba313a8', 'request_id': 'req-17a24367-b804-4246-b818-0efba18367b8'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:31:47.104414 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-17a24367-b804-4246-b818-0efba18367b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebbbe2b63cc947baa05f21e24ba313a8', 'request_id': 'req-17a24367-b804-4246-b818-0efba18367b8'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:31:47.111994 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-17a24367-b804-4246-b818-0efba18367b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebbbe2b63cc947baa05f21e24ba313a8', 'request_id': 'req-17a24367-b804-4246-b818-0efba18367b8'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:31:47.122262 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-17a24367-b804-4246-b818-0efba18367b8 admin admin] The token cache is being invalidate because project ebbbe2b63cc947baa05f21e24ba313a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:31:47.122544 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-17a24367-b804-4246-b818-0efba18367b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:31:47.123189 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-17a24367-b804-4246-b818-0efba18367b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:31:47.125085 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1202/2405] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:31:46 2021] DELETE /identity/v3/projects/ebbbe2b63cc947baa05f21e24ba313a8 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:31:47.129171 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f373b-3924-4074-8775-3d9b80cc0948 service nova] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:31:47.142102 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f373b-3924-4074-8775-3d9b80cc0948 service nova] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:31:47.202727 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79661277-2b3f-4196-8e52-130936192b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:31:47.203635 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79661277-2b3f-4196-8e52-130936192b11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:31:47.203946 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79661277-2b3f-4196-8e52-130936192b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:31:47.204217 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79661277-2b3f-4196-8e52-130936192b11 admin admin] PATH_INFO: `/v3/users/1f29a4cfa42b4cc0a9e4b246515da9b6` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:31:47.205475 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79661277-2b3f-4196-8e52-130936192b11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f29a4cfa42b4cc0a9e4b246515da9b6)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:31:47.207427 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79661277-2b3f-4196-8e52-130936192b11 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:31:47.415855 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-79661277-2b3f-4196-8e52-130936192b11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f29a4cfa42b4cc0a9e4b246515da9b6'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:31:47.416461 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-79661277-2b3f-4196-8e52-130936192b11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f29a4cfa42b4cc0a9e4b246515da9b6'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:31:47.428308 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-79661277-2b3f-4196-8e52-130936192b11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f29a4cfa42b4cc0a9e4b246515da9b6'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:31:47.429003 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-79661277-2b3f-4196-8e52-130936192b11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f29a4cfa42b4cc0a9e4b246515da9b6'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:31:47.435902 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-79661277-2b3f-4196-8e52-130936192b11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f29a4cfa42b4cc0a9e4b246515da9b6'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:31:47.533718 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1204/2406] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:31:47 2021] DELETE /identity/v3/users/1f29a4cfa42b4cc0a9e4b246515da9b6 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:31:47.779132 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a24367-b804-4246-b818-0efba18367b8 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:31:47.780770 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-17a24367-b804-4246-b818-0efba18367b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:31:47.795070 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a24367-b804-4246-b818-0efba18367b8 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:31:47.855692 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f687bd1-6971-4a32-a4ce-ddd4693145a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:31:47.856605 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f687bd1-6971-4a32-a4ce-ddd4693145a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:31:47.856908 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f687bd1-6971-4a32-a4ce-ddd4693145a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:31:47.857213 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f687bd1-6971-4a32-a4ce-ddd4693145a8 admin admin] PATH_INFO: `/v3/projects/11aa5e3aa9dc4e1da0883847ab8afa84` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:31:47.858571 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f687bd1-6971-4a32-a4ce-ddd4693145a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11aa5e3aa9dc4e1da0883847ab8afa84)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:31:47.860617 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f687bd1-6971-4a32-a4ce-ddd4693145a8 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:31:48.017890 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-5f687bd1-6971-4a32-a4ce-ddd4693145a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11aa5e3aa9dc4e1da0883847ab8afa84', 'request_id': 'req-5f687bd1-6971-4a32-a4ce-ddd4693145a8'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:31:48.116098 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-5f687bd1-6971-4a32-a4ce-ddd4693145a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11aa5e3aa9dc4e1da0883847ab8afa84', 'request_id': 'req-5f687bd1-6971-4a32-a4ce-ddd4693145a8'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:31:48.123215 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-5f687bd1-6971-4a32-a4ce-ddd4693145a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11aa5e3aa9dc4e1da0883847ab8afa84', 'request_id': 'req-5f687bd1-6971-4a32-a4ce-ddd4693145a8'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:31:48.134647 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-5f687bd1-6971-4a32-a4ce-ddd4693145a8 admin admin] The token cache is being invalidate because project 11aa5e3aa9dc4e1da0883847ab8afa84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:31:48.135207 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-5f687bd1-6971-4a32-a4ce-ddd4693145a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:31:48.136553 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-5f687bd1-6971-4a32-a4ce-ddd4693145a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:31:48.138172 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1203/2407] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:31:47 2021] DELETE /identity/v3/projects/11aa5e3aa9dc4e1da0883847ab8afa84 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:31:48.144279 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247aabae-f7b9-4bff-b292-8598244c3a92 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:31:48.144599 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247aabae-f7b9-4bff-b292-8598244c3a92 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:31:48.144905 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247aabae-f7b9-4bff-b292-8598244c3a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:31:48.163778 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-247aabae-f7b9-4bff-b292-8598244c3a92 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:31:48.165052 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-247aabae-f7b9-4bff-b292-8598244c3a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:31:48.231083 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1205/2408] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:31:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:31:48.239353 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba043895-3c9b-489b-a751-d1bb337a6ead None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:31:48.239735 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba043895-3c9b-489b-a751-d1bb337a6ead None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:31:48.239950 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba043895-3c9b-489b-a751-d1bb337a6ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:31:48.262600 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-ba043895-3c9b-489b-a751-d1bb337a6ead None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:31:48.263785 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-ba043895-3c9b-489b-a751-d1bb337a6ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:31:48.272073 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1204/2409] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:31:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:31:48.277167 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247aabae-f7b9-4bff-b292-8598244c3a92 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:31:48.287042 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247aabae-f7b9-4bff-b292-8598244c3a92 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:31:48.291913 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a0f776-3c16-4b36-928c-2250b268cde3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:31:48.292776 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0f776-3c16-4b36-928c-2250b268cde3 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:31:48.301883 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0f776-3c16-4b36-928c-2250b268cde3 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:31:48.301883 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0f776-3c16-4b36-928c-2250b268cde3 admin admin] PATH_INFO: `/v3/domains` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:31:48.301883 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a0f776-3c16-4b36-928c-2250b268cde3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:31:48.301883 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a0f776-3c16-4b36-928c-2250b268cde3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:31:48.301883 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a0f776-3c16-4b36-928c-2250b268cde3 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:31:48.308056 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1206/2410] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 12 18:31:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:31:48.312703 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba043895-3c9b-489b-a751-d1bb337a6ead None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:31:48.323196 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba043895-3c9b-489b-a751-d1bb337a6ead None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:31:48.328640 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44ed608-dff2-4834-9c58-b0b82340f131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:31:48.329314 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ed608-dff2-4834-9c58-b0b82340f131 admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:31:48.329590 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ed608-dff2-4834-9c58-b0b82340f131 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:31:48.329862 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ed608-dff2-4834-9c58-b0b82340f131 admin admin] PATH_INFO: `/v3/projects` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:31:48.330573 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44ed608-dff2-4834-9c58-b0b82340f131 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:31:48.332508 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44ed608-dff2-4834-9c58-b0b82340f131 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:31:48.501737 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1205/2411] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:31:48 2021] POST /identity/v3/projects => generated 375 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:31:48.506158 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a0f776-3c16-4b36-928c-2250b268cde3 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:31:48.516863 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a0f776-3c16-4b36-928c-2250b268cde3 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:31:48.589983 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fad613d-3038-4ce2-b9f3-87e9b68ee552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:31:48.590650 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad613d-3038-4ce2-b9f3-87e9b68ee552 admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:31:48.590932 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad613d-3038-4ce2-b9f3-87e9b68ee552 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:31:48.591207 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad613d-3038-4ce2-b9f3-87e9b68ee552 admin admin] PATH_INFO: `/v3/users` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:31:48.591906 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fad613d-3038-4ce2-b9f3-87e9b68ee552 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:31:48.593886 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fad613d-3038-4ce2-b9f3-87e9b68ee552 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:31:48.716693 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1207/2412] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:31:48 2021] POST /identity/v3/users => generated 288 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:31:48.720867 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44ed608-dff2-4834-9c58-b0b82340f131 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:31:48.731820 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44ed608-dff2-4834-9c58-b0b82340f131 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:31:48.736652 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f0e6af-bb22-4f2f-8de2-46b3433e9327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:31:48.737659 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f0e6af-bb22-4f2f-8de2-46b3433e9327 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:31:48.737936 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f0e6af-bb22-4f2f-8de2-46b3433e9327 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:31:48.738398 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f0e6af-bb22-4f2f-8de2-46b3433e9327 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:31:48.738998 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f0e6af-bb22-4f2f-8de2-46b3433e9327 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:31:48.740712 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f0e6af-bb22-4f2f-8de2-46b3433e9327 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:31:48.752679 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1206/2413] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:31:48 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:31:48.756635 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fad613d-3038-4ce2-b9f3-87e9b68ee552 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:31:48.767067 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fad613d-3038-4ce2-b9f3-87e9b68ee552 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:31:48.771703 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c5b0bd-af67-42ef-a394-c4d6e5665df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:31:48.772357 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c5b0bd-af67-42ef-a394-c4d6e5665df2 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:31:48.772671 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c5b0bd-af67-42ef-a394-c4d6e5665df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:31:48.772942 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c5b0bd-af67-42ef-a394-c4d6e5665df2 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:31:48.773667 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c5b0bd-af67-42ef-a394-c4d6e5665df2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:31:48.775257 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c5b0bd-af67-42ef-a394-c4d6e5665df2 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:31:48.790362 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1208/2414] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:31:48 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:31:48.795262 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f0e6af-bb22-4f2f-8de2-46b3433e9327 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:31:48.805307 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f0e6af-bb22-4f2f-8de2-46b3433e9327 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:31:48.813284 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d537e63-f5ce-4669-9c08-b915be69f161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:31:48.814182 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d537e63-f5ce-4669-9c08-b915be69f161 admin admin] REQUEST_METHOD: `PUT` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:31:48.814462 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d537e63-f5ce-4669-9c08-b915be69f161 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:31:48.814732 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d537e63-f5ce-4669-9c08-b915be69f161 admin admin] PATH_INFO: `/v3/projects/8482d94ba0c64bf49ef0fbf1812bb4a7/users/8258163eb1884238a8897b18005f54ff/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:31:48.830249 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d537e63-f5ce-4669-9c08-b915be69f161 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8482d94ba0c64bf49ef0fbf1812bb4a7, user_id=8258163eb1884238a8897b18005f54ff, role_id=33b8a5a8d1d643f2a98f598e6ab0a1cf)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:31:48.832960 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d537e63-f5ce-4669-9c08-b915be69f161 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:31:48.965759 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1207/2415] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:31:48 2021] PUT /identity/v3/projects/8482d94ba0c64bf49ef0fbf1812bb4a7/users/8258163eb1884238a8897b18005f54ff/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 18:31:48.976344 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455a626-35f5-44d8-a025-9bbe8b38ee77 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:31:48.976591 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455a626-35f5-44d8-a025-9bbe8b38ee77 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:31:48.976869 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455a626-35f5-44d8-a025-9bbe8b38ee77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:31:49.005851 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-2455a626-35f5-44d8-a025-9bbe8b38ee77 None None] MFA Rules not processed for user `8258163eb1884238a8897b18005f54ff`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:31:49.007095 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-2455a626-35f5-44d8-a025-9bbe8b38ee77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:31:49.070404 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1209/2416] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:31:48 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:31:49.075568 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d537e63-f5ce-4669-9c08-b915be69f161 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:31:49.140665 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d537e63-f5ce-4669-9c08-b915be69f161 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:31:49.146186 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f63f48-b53e-4408-a5f6-fdd7d2a82c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:31:49.146876 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f63f48-b53e-4408-a5f6-fdd7d2a82c74 admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:31:49.147155 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f63f48-b53e-4408-a5f6-fdd7d2a82c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:31:49.147427 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f63f48-b53e-4408-a5f6-fdd7d2a82c74 admin admin] PATH_INFO: `/v3/projects` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:31:49.148137 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f63f48-b53e-4408-a5f6-fdd7d2a82c74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:31:49.150123 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f63f48-b53e-4408-a5f6-fdd7d2a82c74 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:31:49.269736 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1208/2417] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:31:49 2021] POST /identity/v3/projects => generated 373 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:31:49.271176 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2455a626-35f5-44d8-a025-9bbe8b38ee77 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:31:49.282209 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2455a626-35f5-44d8-a025-9bbe8b38ee77 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:31:49.343776 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615042bc-2d8d-41ab-8fcc-a449530fc409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:31:49.344516 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615042bc-2d8d-41ab-8fcc-a449530fc409 admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:31:49.344774 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615042bc-2d8d-41ab-8fcc-a449530fc409 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:31:49.345198 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615042bc-2d8d-41ab-8fcc-a449530fc409 admin admin] PATH_INFO: `/v3/users` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:31:49.345929 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615042bc-2d8d-41ab-8fcc-a449530fc409 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:31:49.347871 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615042bc-2d8d-41ab-8fcc-a449530fc409 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:31:49.464376 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1210/2418] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:31:49 2021] POST /identity/v3/users => generated 293 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 18:31:49.468673 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f63f48-b53e-4408-a5f6-fdd7d2a82c74 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:31:49.478679 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f63f48-b53e-4408-a5f6-fdd7d2a82c74 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:31:49.483768 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafbd12d-9f7b-46a1-96a8-168bbcdde7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:31:49.484459 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafbd12d-9f7b-46a1-96a8-168bbcdde7ad admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:31:49.484740 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafbd12d-9f7b-46a1-96a8-168bbcdde7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:31:49.485010 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafbd12d-9f7b-46a1-96a8-168bbcdde7ad admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:31:49.485770 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafbd12d-9f7b-46a1-96a8-168bbcdde7ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:31:49.487352 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafbd12d-9f7b-46a1-96a8-168bbcdde7ad admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:31:49.500041 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1209/2419] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:31:49 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:31:49.504363 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615042bc-2d8d-41ab-8fcc-a449530fc409 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:31:49.514989 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615042bc-2d8d-41ab-8fcc-a449530fc409 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:31:49.519921 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409a159c-b95f-46a2-8309-b81c38ca87c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:31:49.520890 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409a159c-b95f-46a2-8309-b81c38ca87c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:31:49.521174 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409a159c-b95f-46a2-8309-b81c38ca87c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:31:49.521447 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409a159c-b95f-46a2-8309-b81c38ca87c6 admin admin] PATH_INFO: `/v3/projects/a6ad70142d7f4965b108209e24f3ec05/users/babe1ae8c4154c52b681582fb901dca2/roles/6c54f239944d46e3b027ccce97eb8b49` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:31:49.538659 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409a159c-b95f-46a2-8309-b81c38ca87c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6ad70142d7f4965b108209e24f3ec05, user_id=babe1ae8c4154c52b681582fb901dca2, role_id=6c54f239944d46e3b027ccce97eb8b49)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:31:49.541490 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409a159c-b95f-46a2-8309-b81c38ca87c6 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:31:49.647350 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1211/2420] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:31:49 2021] PUT /identity/v3/projects/a6ad70142d7f4965b108209e24f3ec05/users/babe1ae8c4154c52b681582fb901dca2/roles/6c54f239944d46e3b027ccce97eb8b49 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:31:49.651450 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafbd12d-9f7b-46a1-96a8-168bbcdde7ad admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:31:49.662517 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafbd12d-9f7b-46a1-96a8-168bbcdde7ad admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:31:49.723408 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38de730d-aa3f-4704-a9dd-e8633e5d6811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:31:49.724085 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de730d-aa3f-4704-a9dd-e8633e5d6811 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:31:49.724369 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de730d-aa3f-4704-a9dd-e8633e5d6811 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:31:49.724685 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de730d-aa3f-4704-a9dd-e8633e5d6811 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:31:49.725495 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38de730d-aa3f-4704-a9dd-e8633e5d6811 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:31:49.727096 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38de730d-aa3f-4704-a9dd-e8633e5d6811 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:31:49.737953 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1210/2421] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:31:49 2021] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:31:49.742375 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409a159c-b95f-46a2-8309-b81c38ca87c6 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:31:49.753352 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409a159c-b95f-46a2-8309-b81c38ca87c6 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:31:49.758132 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ab7010-10e2-4390-92ff-9667317ad803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:31:49.759015 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ab7010-10e2-4390-92ff-9667317ad803 admin admin] REQUEST_METHOD: `PUT` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:31:49.759290 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ab7010-10e2-4390-92ff-9667317ad803 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:31:49.759562 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ab7010-10e2-4390-92ff-9667317ad803 admin admin] PATH_INFO: `/v3/projects/a6ad70142d7f4965b108209e24f3ec05/users/babe1ae8c4154c52b681582fb901dca2/roles/6c54f239944d46e3b027ccce97eb8b49` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:31:49.761581 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ab7010-10e2-4390-92ff-9667317ad803 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6ad70142d7f4965b108209e24f3ec05, user_id=babe1ae8c4154c52b681582fb901dca2, role_id=6c54f239944d46e3b027ccce97eb8b49)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:31:49.764296 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ab7010-10e2-4390-92ff-9667317ad803 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:31:49.774956 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1212/2422] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:31:49 2021] PUT /identity/v3/projects/a6ad70142d7f4965b108209e24f3ec05/users/babe1ae8c4154c52b681582fb901dca2/roles/6c54f239944d46e3b027ccce97eb8b49 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:31:49.789587 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f8f97-5f28-4589-bba6-0e842cfd724b None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:31:49.789878 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f8f97-5f28-4589-bba6-0e842cfd724b None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:31:49.793912 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f8f97-5f28-4589-bba6-0e842cfd724b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:31:49.821444 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-6c3f8f97-5f28-4589-bba6-0e842cfd724b None None] MFA Rules not processed for user `babe1ae8c4154c52b681582fb901dca2`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:31:49.822659 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-6c3f8f97-5f28-4589-bba6-0e842cfd724b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:31:49.900038 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1211/2423] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:31:49 2021] POST /identity/v3/auth/tokens => generated 3460 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:31:49.908157 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ab7010-10e2-4390-92ff-9667317ad803 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:31:49.910045 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-b3ab7010-10e2-4390-92ff-9667317ad803 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:31:49.974797 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ab7010-10e2-4390-92ff-9667317ad803 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:31:49.978737 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab11a6e-8d97-4ed9-8219-17524e6b3b2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6966ce0774f4437a9b688494e9d0574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:31:49.979391 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab11a6e-8d97-4ed9-8219-17524e6b3b2d service cinder] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:31:49.979821 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab11a6e-8d97-4ed9-8219-17524e6b3b2d service cinder] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:31:49.980061 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab11a6e-8d97-4ed9-8219-17524e6b3b2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:31:50.064776 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab11a6e-8d97-4ed9-8219-17524e6b3b2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:31:50.066236 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab11a6e-8d97-4ed9-8219-17524e6b3b2d service cinder] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:31:50.076886 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1213/2424] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:31:49 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:31:52.795638 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3f8f97-5f28-4589-bba6-0e842cfd724b None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:31:52.797203 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-6c3f8f97-5f28-4589-bba6-0e842cfd724b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:31:52.885344 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3f8f97-5f28-4589-bba6-0e842cfd724b None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:31:52.895791 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f571b1-0e6b-433a-986c-a4afc8190684 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3417097a280b499086b36df9a2548239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:31:52.896839 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f571b1-0e6b-433a-986c-a4afc8190684 service nova] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:31:52.897311 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f571b1-0e6b-433a-986c-a4afc8190684 service nova] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:31:52.897790 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f571b1-0e6b-433a-986c-a4afc8190684 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:31:52.900719 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-81f571b1-0e6b-433a-986c-a4afc8190684 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:31:52.916541 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f571b1-0e6b-433a-986c-a4afc8190684 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:31:52.917990 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f571b1-0e6b-433a-986c-a4afc8190684 service nova] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:31:52.929381 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1212/2425] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:31:52 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:31:53.166104 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab11a6e-8d97-4ed9-8219-17524e6b3b2d service cinder] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:31:53.240905 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab11a6e-8d97-4ed9-8219-17524e6b3b2d service cinder] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:31:53.246335 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85c0e74-ebae-4569-837a-07c8d5a58637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:31:53.247521 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c0e74-ebae-4569-837a-07c8d5a58637 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:31:53.247938 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c0e74-ebae-4569-837a-07c8d5a58637 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:31:53.247938 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c0e74-ebae-4569-837a-07c8d5a58637 admin admin] PATH_INFO: `/v3/users/8258163eb1884238a8897b18005f54ff` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:31:53.250841 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85c0e74-ebae-4569-837a-07c8d5a58637 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8258163eb1884238a8897b18005f54ff)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:31:53.252931 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85c0e74-ebae-4569-837a-07c8d5a58637 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:31:53.464725 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-d85c0e74-ebae-4569-837a-07c8d5a58637 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8258163eb1884238a8897b18005f54ff'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:31:53.464725 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-d85c0e74-ebae-4569-837a-07c8d5a58637 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8258163eb1884238a8897b18005f54ff'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:31:53.477721 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-d85c0e74-ebae-4569-837a-07c8d5a58637 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8258163eb1884238a8897b18005f54ff'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:31:53.478687 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-d85c0e74-ebae-4569-837a-07c8d5a58637 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8258163eb1884238a8897b18005f54ff'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:31:53.486904 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-d85c0e74-ebae-4569-837a-07c8d5a58637 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8258163eb1884238a8897b18005f54ff'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:31:53.579512 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1214/2426] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:31:53 2021] DELETE /identity/v3/users/8258163eb1884238a8897b18005f54ff => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:31:53.588238 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1417608-c605-44f4-897b-bb6bedadabe1 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:31:53.588881 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1417608-c605-44f4-897b-bb6bedadabe1 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:31:53.590031 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1417608-c605-44f4-897b-bb6bedadabe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:31:53.610577 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-d1417608-c605-44f4-897b-bb6bedadabe1 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:31:53.611860 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-d1417608-c605-44f4-897b-bb6bedadabe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:31:53.740420 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1213/2427] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:31:53 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:31:53.754904 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85c0e74-ebae-4569-837a-07c8d5a58637 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:31:53.756649 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-d85c0e74-ebae-4569-837a-07c8d5a58637 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:31:53.856822 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85c0e74-ebae-4569-837a-07c8d5a58637 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:31:53.861124 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3fc781-fe6d-4abb-8c14-cd8f2a60480b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:31:53.865855 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3fc781-fe6d-4abb-8c14-cd8f2a60480b service neutron] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:31:53.865855 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3fc781-fe6d-4abb-8c14-cd8f2a60480b service neutron] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:31:53.865855 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3fc781-fe6d-4abb-8c14-cd8f2a60480b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:31:53.874278 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3fc781-fe6d-4abb-8c14-cd8f2a60480b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:31:53.876069 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3fc781-fe6d-4abb-8c14-cd8f2a60480b service neutron] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:31:53.897062 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1215/2428] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:31:53 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 18:31:54.415169 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1417608-c605-44f4-897b-bb6bedadabe1 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:31:54.418318 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-d1417608-c605-44f4-897b-bb6bedadabe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:31:54.429744 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1417608-c605-44f4-897b-bb6bedadabe1 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:31:54.435380 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e76c21-3d62-44e4-bf4b-330ce5311420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:31:54.436375 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e76c21-3d62-44e4-bf4b-330ce5311420 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:31:54.436739 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e76c21-3d62-44e4-bf4b-330ce5311420 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:31:54.437085 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e76c21-3d62-44e4-bf4b-330ce5311420 admin admin] PATH_INFO: `/v3/projects/8482d94ba0c64bf49ef0fbf1812bb4a7` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:31:54.438368 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e76c21-3d62-44e4-bf4b-330ce5311420 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8482d94ba0c64bf49ef0fbf1812bb4a7)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:31:54.440558 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e76c21-3d62-44e4-bf4b-330ce5311420 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:31:54.567539 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-c7e76c21-3d62-44e4-bf4b-330ce5311420 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8482d94ba0c64bf49ef0fbf1812bb4a7', 'request_id': 'req-c7e76c21-3d62-44e4-bf4b-330ce5311420'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:31:54.647467 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-c7e76c21-3d62-44e4-bf4b-330ce5311420 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8482d94ba0c64bf49ef0fbf1812bb4a7', 'request_id': 'req-c7e76c21-3d62-44e4-bf4b-330ce5311420'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:31:54.655169 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-c7e76c21-3d62-44e4-bf4b-330ce5311420 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8482d94ba0c64bf49ef0fbf1812bb4a7', 'request_id': 'req-c7e76c21-3d62-44e4-bf4b-330ce5311420'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:31:54.665634 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-c7e76c21-3d62-44e4-bf4b-330ce5311420 admin admin] The token cache is being invalidate because project 8482d94ba0c64bf49ef0fbf1812bb4a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:31:54.665856 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-c7e76c21-3d62-44e4-bf4b-330ce5311420 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:31:54.666509 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-c7e76c21-3d62-44e4-bf4b-330ce5311420 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:31:54.668773 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1214/2429] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:31:54 2021] DELETE /identity/v3/projects/8482d94ba0c64bf49ef0fbf1812bb4a7 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:31:54.672842 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3fc781-fe6d-4abb-8c14-cd8f2a60480b service neutron] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:31:54.683036 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3fc781-fe6d-4abb-8c14-cd8f2a60480b service neutron] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:31:54.743107 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada82c50-ed29-44cb-9442-4e85568c80fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:31:54.743996 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada82c50-ed29-44cb-9442-4e85568c80fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:31:54.744273 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada82c50-ed29-44cb-9442-4e85568c80fe admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:31:54.744578 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada82c50-ed29-44cb-9442-4e85568c80fe admin admin] PATH_INFO: `/v3/users/babe1ae8c4154c52b681582fb901dca2` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:31:54.745907 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada82c50-ed29-44cb-9442-4e85568c80fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=babe1ae8c4154c52b681582fb901dca2)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:31:54.747873 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada82c50-ed29-44cb-9442-4e85568c80fe admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:31:55.002876 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-ada82c50-ed29-44cb-9442-4e85568c80fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'babe1ae8c4154c52b681582fb901dca2'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:31:55.003660 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-ada82c50-ed29-44cb-9442-4e85568c80fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'babe1ae8c4154c52b681582fb901dca2'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:31:55.017764 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-ada82c50-ed29-44cb-9442-4e85568c80fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'babe1ae8c4154c52b681582fb901dca2'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:31:55.018967 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-ada82c50-ed29-44cb-9442-4e85568c80fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'babe1ae8c4154c52b681582fb901dca2'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:31:55.027203 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-ada82c50-ed29-44cb-9442-4e85568c80fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'babe1ae8c4154c52b681582fb901dca2'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:31:55.121630 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1216/2430] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:31:54 2021] DELETE /identity/v3/users/babe1ae8c4154c52b681582fb901dca2 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:31:55.569958 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e76c21-3d62-44e4-bf4b-330ce5311420 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:31:55.574430 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-c7e76c21-3d62-44e4-bf4b-330ce5311420 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:31:55.585976 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e76c21-3d62-44e4-bf4b-330ce5311420 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:31:55.654747 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697e222c-2082-49f0-aa38-6fa95d530b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:31:55.655606 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e222c-2082-49f0-aa38-6fa95d530b36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:31:55.655883 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e222c-2082-49f0-aa38-6fa95d530b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:31:55.656158 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e222c-2082-49f0-aa38-6fa95d530b36 admin admin] PATH_INFO: `/v3/projects/a6ad70142d7f4965b108209e24f3ec05` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:31:55.657413 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697e222c-2082-49f0-aa38-6fa95d530b36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6ad70142d7f4965b108209e24f3ec05)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:31:55.659320 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697e222c-2082-49f0-aa38-6fa95d530b36 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:31:55.774725 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-697e222c-2082-49f0-aa38-6fa95d530b36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6ad70142d7f4965b108209e24f3ec05', 'request_id': 'req-697e222c-2082-49f0-aa38-6fa95d530b36'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:31:55.898590 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-697e222c-2082-49f0-aa38-6fa95d530b36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6ad70142d7f4965b108209e24f3ec05', 'request_id': 'req-697e222c-2082-49f0-aa38-6fa95d530b36'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:31:55.906747 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-697e222c-2082-49f0-aa38-6fa95d530b36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6ad70142d7f4965b108209e24f3ec05', 'request_id': 'req-697e222c-2082-49f0-aa38-6fa95d530b36'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:31:55.917855 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-697e222c-2082-49f0-aa38-6fa95d530b36 admin admin] The token cache is being invalidate because project a6ad70142d7f4965b108209e24f3ec05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:31:55.918221 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-697e222c-2082-49f0-aa38-6fa95d530b36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:31:55.918889 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-697e222c-2082-49f0-aa38-6fa95d530b36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:31:55.920315 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1215/2431] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:31:55 2021] DELETE /identity/v3/projects/a6ad70142d7f4965b108209e24f3ec05 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:31:55.926013 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93172de2-4869-421f-ac42-286f02f81857 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:31:55.926514 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93172de2-4869-421f-ac42-286f02f81857 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:31:55.926625 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93172de2-4869-421f-ac42-286f02f81857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:31:55.945148 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-93172de2-4869-421f-ac42-286f02f81857 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:31:55.946369 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-93172de2-4869-421f-ac42-286f02f81857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:31:56.007835 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1217/2432] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:31:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:31:56.016282 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bec5b8-56da-45ba-9684-67acd096e169 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:31:56.017125 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bec5b8-56da-45ba-9684-67acd096e169 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:31:56.017410 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bec5b8-56da-45ba-9684-67acd096e169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:31:56.037208 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-68bec5b8-56da-45ba-9684-67acd096e169 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:31:56.038450 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-68bec5b8-56da-45ba-9684-67acd096e169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:31:56.048504 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1216/2433] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:31:56 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:31:56.052577 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93172de2-4869-421f-ac42-286f02f81857 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:31:56.062698 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93172de2-4869-421f-ac42-286f02f81857 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:31:56.067373 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c12262-ffcc-466a-a93b-282a4493f084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:31:56.068077 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c12262-ffcc-466a-a93b-282a4493f084 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:31:56.068364 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c12262-ffcc-466a-a93b-282a4493f084 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:31:56.068672 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c12262-ffcc-466a-a93b-282a4493f084 admin admin] PATH_INFO: `/v3/domains` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:31:56.069416 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c12262-ffcc-466a-a93b-282a4493f084 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:31:56.069721 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c12262-ffcc-466a-a93b-282a4493f084 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:31:56.071327 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c12262-ffcc-466a-a93b-282a4493f084 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:31:56.088345 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1218/2434] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 12 18:31:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:31:56.090701 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bec5b8-56da-45ba-9684-67acd096e169 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:31:56.100339 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bec5b8-56da-45ba-9684-67acd096e169 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:31:56.106453 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7971b1-64f7-4f88-9a5c-d7ddab7efd18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:31:56.107080 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7971b1-64f7-4f88-9a5c-d7ddab7efd18 admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:31:56.107403 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7971b1-64f7-4f88-9a5c-d7ddab7efd18 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:31:56.107669 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7971b1-64f7-4f88-9a5c-d7ddab7efd18 admin admin] PATH_INFO: `/v3/projects` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:31:56.108449 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7971b1-64f7-4f88-9a5c-d7ddab7efd18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:31:56.110348 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7971b1-64f7-4f88-9a5c-d7ddab7efd18 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:31:56.222222 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1217/2435] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:31:56 2021] POST /identity/v3/projects => generated 365 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:31:56.226842 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c12262-ffcc-466a-a93b-282a4493f084 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:31:56.237828 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c12262-ffcc-466a-a93b-282a4493f084 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:31:56.293672 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedf0c9d-aa5d-4ba9-96ed-00d4f043e635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:31:56.294260 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf0c9d-aa5d-4ba9-96ed-00d4f043e635 admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:31:56.294595 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf0c9d-aa5d-4ba9-96ed-00d4f043e635 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:31:56.294874 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf0c9d-aa5d-4ba9-96ed-00d4f043e635 admin admin] PATH_INFO: `/v3/users` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:31:56.295576 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedf0c9d-aa5d-4ba9-96ed-00d4f043e635 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:31:56.297546 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedf0c9d-aa5d-4ba9-96ed-00d4f043e635 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:31:56.419442 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1219/2436] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:31:56 2021] POST /identity/v3/users => generated 283 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 18:31:56.423540 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7971b1-64f7-4f88-9a5c-d7ddab7efd18 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:31:56.433962 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7971b1-64f7-4f88-9a5c-d7ddab7efd18 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:31:56.438783 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a5808a-bab1-4743-bcce-4a01b743f7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:31:56.439453 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5808a-bab1-4743-bcce-4a01b743f7bd admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:31:56.439716 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5808a-bab1-4743-bcce-4a01b743f7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:31:56.439993 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5808a-bab1-4743-bcce-4a01b743f7bd admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:31:56.440777 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a5808a-bab1-4743-bcce-4a01b743f7bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:31:56.442521 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a5808a-bab1-4743-bcce-4a01b743f7bd admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:31:56.453787 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1218/2437] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:31:56 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:31:56.459835 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedf0c9d-aa5d-4ba9-96ed-00d4f043e635 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:31:56.471118 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedf0c9d-aa5d-4ba9-96ed-00d4f043e635 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:31:56.477169 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89634cf3-fe7e-450c-af63-97f2bcee3a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:31:56.477855 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89634cf3-fe7e-450c-af63-97f2bcee3a3e admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:31:56.478136 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89634cf3-fe7e-450c-af63-97f2bcee3a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:31:56.478438 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89634cf3-fe7e-450c-af63-97f2bcee3a3e admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:31:56.479202 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89634cf3-fe7e-450c-af63-97f2bcee3a3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:31:56.481216 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89634cf3-fe7e-450c-af63-97f2bcee3a3e admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:31:56.494711 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1220/2438] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:31:56 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 18:31:56.500071 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a5808a-bab1-4743-bcce-4a01b743f7bd admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:31:56.510041 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a5808a-bab1-4743-bcce-4a01b743f7bd admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:31:56.515293 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b47334-6cbd-4b62-a1ab-6a530d1fd5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:31:56.516171 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b47334-6cbd-4b62-a1ab-6a530d1fd5ee admin admin] REQUEST_METHOD: `PUT` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:31:56.516474 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b47334-6cbd-4b62-a1ab-6a530d1fd5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:31:56.516747 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b47334-6cbd-4b62-a1ab-6a530d1fd5ee admin admin] PATH_INFO: `/v3/projects/64aad5d8fff24802806797ab9c0eb9fb/users/0b592066a4944a95bc0044fa35f43331/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:31:56.534224 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b47334-6cbd-4b62-a1ab-6a530d1fd5ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=64aad5d8fff24802806797ab9c0eb9fb, user_id=0b592066a4944a95bc0044fa35f43331, role_id=33b8a5a8d1d643f2a98f598e6ab0a1cf)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:31:56.540357 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b47334-6cbd-4b62-a1ab-6a530d1fd5ee admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:31:56.657200 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1219/2439] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:31:56 2021] PUT /identity/v3/projects/64aad5d8fff24802806797ab9c0eb9fb/users/0b592066a4944a95bc0044fa35f43331/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:31:56.668289 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf0c72b-9360-4a56-bcbb-c5cbddbd1acd None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:31:56.668664 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf0c72b-9360-4a56-bcbb-c5cbddbd1acd None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:31:56.668868 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf0c72b-9360-4a56-bcbb-c5cbddbd1acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:31:56.698767 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-8cf0c72b-9360-4a56-bcbb-c5cbddbd1acd None None] MFA Rules not processed for user `0b592066a4944a95bc0044fa35f43331`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:31:56.700009 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-8cf0c72b-9360-4a56-bcbb-c5cbddbd1acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:31:56.770176 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1221/2440] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:31:56 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:31:56.781094 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b47334-6cbd-4b62-a1ab-6a530d1fd5ee admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:31:56.782837 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-37b47334-6cbd-4b62-a1ab-6a530d1fd5ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:31:56.851266 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b47334-6cbd-4b62-a1ab-6a530d1fd5ee admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:31:56.855065 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175a3b1e-c670-49fa-a7f8-f50915cdef0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6966ce0774f4437a9b688494e9d0574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:31:56.855710 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a3b1e-c670-49fa-a7f8-f50915cdef0e service cinder] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:31:56.856000 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a3b1e-c670-49fa-a7f8-f50915cdef0e service cinder] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:31:56.856267 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a3b1e-c670-49fa-a7f8-f50915cdef0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:31:56.865202 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175a3b1e-c670-49fa-a7f8-f50915cdef0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:31:56.866634 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175a3b1e-c670-49fa-a7f8-f50915cdef0e service cinder] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:31:56.877259 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1220/2441] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:31:56 2021] GET /identity/v3/auth/tokens => generated 3385 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:31:58.930968 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d6e66-93c1-430a-8c65-bfa736b0e38a None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:31:58.931475 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d6e66-93c1-430a-8c65-bfa736b0e38a None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:31:58.931599 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d6e66-93c1-430a-8c65-bfa736b0e38a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:31:58.950476 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-566d6e66-93c1-430a-8c65-bfa736b0e38a None None] MFA Rules not processed for user `74acf90c734149808a501de7754b5943`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:31:58.951808 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-566d6e66-93c1-430a-8c65-bfa736b0e38a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:31:59.011467 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1222/2442] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:31:58 2021] POST /identity/v3/auth/tokens => generated 3409 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:31:59.328079 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175a3b1e-c670-49fa-a7f8-f50915cdef0e service cinder] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:31:59.329639 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-175a3b1e-c670-49fa-a7f8-f50915cdef0e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:31:59.385152 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175a3b1e-c670-49fa-a7f8-f50915cdef0e service cinder] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:31:59.388955 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c20bd-2f4a-477f-8464-0eded41d48e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:31:59.389622 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c20bd-2f4a-477f-8464-0eded41d48e5 service neutron] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:31:59.389907 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c20bd-2f4a-477f-8464-0eded41d48e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:31:59.390333 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c20bd-2f4a-477f-8464-0eded41d48e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:31:59.392146 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-d42c20bd-2f4a-477f-8464-0eded41d48e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:31:59.402255 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42c20bd-2f4a-477f-8464-0eded41d48e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:31:59.403969 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42c20bd-2f4a-477f-8464-0eded41d48e5 service neutron] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:31:59.412922 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1221/2443] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:31:59 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:32:00.864296 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d6e66-93c1-430a-8c65-bfa736b0e38a None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:32:00.865727 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-566d6e66-93c1-430a-8c65-bfa736b0e38a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:32:00.936938 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d6e66-93c1-430a-8c65-bfa736b0e38a None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:32:00.945472 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a795966d-329e-4ad9-b309-03c03ccdda7b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bd99e4f2d444a388ecde7ea3cb61089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:32:00.945472 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795966d-329e-4ad9-b309-03c03ccdda7b service placement] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:32:00.945472 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795966d-329e-4ad9-b309-03c03ccdda7b service placement] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:32:00.945472 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795966d-329e-4ad9-b309-03c03ccdda7b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:32:00.946694 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-a795966d-329e-4ad9-b309-03c03ccdda7b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:32:00.959765 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a795966d-329e-4ad9-b309-03c03ccdda7b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:32:00.961504 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a795966d-329e-4ad9-b309-03c03ccdda7b service placement] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:32:00.978457 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1223/2444] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:32:00 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:32:15.528713 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e705fe6-7176-4222-8539-a786632d33ac None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:32:15.530078 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e705fe6-7176-4222-8539-a786632d33ac None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:32:15.530564 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e705fe6-7176-4222-8539-a786632d33ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:32:15.554721 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-3e705fe6-7176-4222-8539-a786632d33ac None None] MFA Rules not processed for user `9a37985dd5034ceeabfa47797efba5a1`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:32:15.556135 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-3e705fe6-7176-4222-8539-a786632d33ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:32:15.645670 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1222/2445] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:32:15 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:32:16.091049 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a795966d-329e-4ad9-b309-03c03ccdda7b service placement] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:32:16.102783 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a795966d-329e-4ad9-b309-03c03ccdda7b service placement] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:32:16.107966 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db003ddb-9e59-429e-84bf-09f0ed090570 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:32:16.108660 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db003ddb-9e59-429e-84bf-09f0ed090570 service neutron] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:32:16.108940 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db003ddb-9e59-429e-84bf-09f0ed090570 service neutron] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:32:16.109213 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db003ddb-9e59-429e-84bf-09f0ed090570 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:32:16.111370 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-db003ddb-9e59-429e-84bf-09f0ed090570 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:32:16.137872 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db003ddb-9e59-429e-84bf-09f0ed090570 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:32:16.139716 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db003ddb-9e59-429e-84bf-09f0ed090570 service neutron] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:32:16.154133 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1224/2446] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:32:16 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:32:16.243259 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0779802-199c-4798-b43d-ae13fc8d0f2b None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:32:16.243618 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0779802-199c-4798-b43d-ae13fc8d0f2b None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:32:16.244008 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0779802-199c-4798-b43d-ae13fc8d0f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:32:16.263381 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-b0779802-199c-4798-b43d-ae13fc8d0f2b None None] MFA Rules not processed for user `835bbb43ae5f48bfa14b22cb0a47cb4e`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:32:16.264476 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-b0779802-199c-4798-b43d-ae13fc8d0f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:32:16.357084 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1223/2447] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:32:16 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:32:17.687522 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db003ddb-9e59-429e-84bf-09f0ed090570 service neutron] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:32:17.689761 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-db003ddb-9e59-429e-84bf-09f0ed090570 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:32:17.785255 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db003ddb-9e59-429e-84bf-09f0ed090570 service neutron] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:32:17.791958 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a9ebe9-4174-4fe8-9c60-87dd0abb13e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3417097a280b499086b36df9a2548239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:32:17.792885 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a9ebe9-4174-4fe8-9c60-87dd0abb13e2 service nova] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:32:17.793184 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a9ebe9-4174-4fe8-9c60-87dd0abb13e2 service nova] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:32:17.793462 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a9ebe9-4174-4fe8-9c60-87dd0abb13e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:32:17.795652 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-d2a9ebe9-4174-4fe8-9c60-87dd0abb13e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:32:17.809253 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a9ebe9-4174-4fe8-9c60-87dd0abb13e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:32:17.810895 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a9ebe9-4174-4fe8-9c60-87dd0abb13e2 service nova] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:32:17.823076 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1225/2448] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:32:17 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 18:32:21.921978 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0779802-199c-4798-b43d-ae13fc8d0f2b None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:32:21.923658 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-b0779802-199c-4798-b43d-ae13fc8d0f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:32:21.945221 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0779802-199c-4798-b43d-ae13fc8d0f2b None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:32:21.952359 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85f12fc-7f47-457e-b1dd-99bf9507f8a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3417097a280b499086b36df9a2548239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:32:21.954101 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f12fc-7f47-457e-b1dd-99bf9507f8a4 service nova] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:32:21.955034 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f12fc-7f47-457e-b1dd-99bf9507f8a4 service nova] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:32:21.955244 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f12fc-7f47-457e-b1dd-99bf9507f8a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:32:21.958475 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-c85f12fc-7f47-457e-b1dd-99bf9507f8a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:32:21.993864 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85f12fc-7f47-457e-b1dd-99bf9507f8a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:32:21.996233 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85f12fc-7f47-457e-b1dd-99bf9507f8a4 service nova] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:32:22.008548 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1224/2449] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:32:21 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:32:30.879815 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f9175-f658-4f39-9521-db35a3b080d6 None None] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:32:30.880428 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f9175-f658-4f39-9521-db35a3b080d6 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:32:30.880428 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f9175-f658-4f39-9521-db35a3b080d6 None None] PATH_INFO: `/` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:32:30.882314 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1226/2450] 10.222.0.18 () {54 vars in 921 bytes} [Tue Oct 12 18:32:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:32:30.893161 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0967de-8e7a-4663-8401-6b8025e357a0 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:32:30.893675 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0967de-8e7a-4663-8401-6b8025e357a0 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:32:30.893798 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0967de-8e7a-4663-8401-6b8025e357a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:32:30.915924 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-9a0967de-8e7a-4663-8401-6b8025e357a0 None None] MFA Rules not processed for user `9a1ea6f47a7c41aba102ad481f5ad5c8`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:32:30.917901 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-9a0967de-8e7a-4663-8401-6b8025e357a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:32:30.927824 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1225/2451] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Oct 12 18:32:30 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:32:30.941219 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f9175-f658-4f39-9521-db35a3b080d6 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:32:30.943042 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-763f9175-f658-4f39-9521-db35a3b080d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:32:30.956877 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f9175-f658-4f39-9521-db35a3b080d6 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:32:30.960560 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fca14c-ffe1-4f0a-8d19-ce7440523af4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:32:30.961201 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fca14c-ffe1-4f0a-8d19-ce7440523af4 service neutron] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:32:30.961483 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fca14c-ffe1-4f0a-8d19-ce7440523af4 service neutron] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:32:30.961759 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fca14c-ffe1-4f0a-8d19-ce7440523af4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:32:30.969021 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fca14c-ffe1-4f0a-8d19-ce7440523af4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:32:30.970449 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fca14c-ffe1-4f0a-8d19-ce7440523af4 service neutron] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:32:30.980050 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1227/2452] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:32:30 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:32:47.194271 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0967de-8e7a-4663-8401-6b8025e357a0 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:32:47.260131 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0967de-8e7a-4663-8401-6b8025e357a0 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:32:47.264769 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce6d6f-da80-4aba-a7c6-33d33568d325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:32:47.265638 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce6d6f-da80-4aba-a7c6-33d33568d325 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:32:47.265918 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce6d6f-da80-4aba-a7c6-33d33568d325 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:32:47.266190 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce6d6f-da80-4aba-a7c6-33d33568d325 admin admin] PATH_INFO: `/v3/users/0b592066a4944a95bc0044fa35f43331` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:32:47.267399 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ce6d6f-da80-4aba-a7c6-33d33568d325 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b592066a4944a95bc0044fa35f43331)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:32:47.269361 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ce6d6f-da80-4aba-a7c6-33d33568d325 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:32:47.483020 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-c4ce6d6f-da80-4aba-a7c6-33d33568d325 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b592066a4944a95bc0044fa35f43331'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:32:47.499199 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-c4ce6d6f-da80-4aba-a7c6-33d33568d325 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b592066a4944a95bc0044fa35f43331'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:32:47.520908 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-c4ce6d6f-da80-4aba-a7c6-33d33568d325 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b592066a4944a95bc0044fa35f43331'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:32:47.642106 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-c4ce6d6f-da80-4aba-a7c6-33d33568d325 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b592066a4944a95bc0044fa35f43331'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:32:47.643435 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-c4ce6d6f-da80-4aba-a7c6-33d33568d325 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b592066a4944a95bc0044fa35f43331'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:32:47.655847 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1226/2453] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:32:47 2021] DELETE /identity/v3/users/0b592066a4944a95bc0044fa35f43331 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:32:47.670223 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d805f65-1031-48f4-b8e8-333a5525af5e None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:32:47.670858 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d805f65-1031-48f4-b8e8-333a5525af5e None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:32:47.670858 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d805f65-1031-48f4-b8e8-333a5525af5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:32:47.689457 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-4d805f65-1031-48f4-b8e8-333a5525af5e None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:32:47.690692 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-4d805f65-1031-48f4-b8e8-333a5525af5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:32:47.773863 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1228/2454] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:32:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:32:47.790117 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce6d6f-da80-4aba-a7c6-33d33568d325 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:32:47.792311 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-c4ce6d6f-da80-4aba-a7c6-33d33568d325 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:32:47.862319 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce6d6f-da80-4aba-a7c6-33d33568d325 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:32:47.865968 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41a81e5-5a1e-466a-9d97-9494e9d2d374 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:32:47.866755 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a81e5-5a1e-466a-9d97-9494e9d2d374 service neutron] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:32:47.867087 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a81e5-5a1e-466a-9d97-9494e9d2d374 service neutron] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:32:47.867358 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a81e5-5a1e-466a-9d97-9494e9d2d374 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:32:47.878490 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41a81e5-5a1e-466a-9d97-9494e9d2d374 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:32:47.879984 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41a81e5-5a1e-466a-9d97-9494e9d2d374 service neutron] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:32:47.898786 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1227/2455] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:32:47 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 18:32:48.339780 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d805f65-1031-48f4-b8e8-333a5525af5e None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:32:48.341330 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-4d805f65-1031-48f4-b8e8-333a5525af5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:32:48.356209 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d805f65-1031-48f4-b8e8-333a5525af5e None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:32:48.365337 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed16a551-e3a8-41c7-a633-6a9b87fa91ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:32:48.366226 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16a551-e3a8-41c7-a633-6a9b87fa91ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:32:48.366507 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16a551-e3a8-41c7-a633-6a9b87fa91ab admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:32:48.366774 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16a551-e3a8-41c7-a633-6a9b87fa91ab admin admin] PATH_INFO: `/v3/projects/64aad5d8fff24802806797ab9c0eb9fb` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:32:48.368315 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed16a551-e3a8-41c7-a633-6a9b87fa91ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=64aad5d8fff24802806797ab9c0eb9fb)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:32:48.370946 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed16a551-e3a8-41c7-a633-6a9b87fa91ab admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:32:48.475298 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-ed16a551-e3a8-41c7-a633-6a9b87fa91ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64aad5d8fff24802806797ab9c0eb9fb', 'request_id': 'req-ed16a551-e3a8-41c7-a633-6a9b87fa91ab'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:32:48.482001 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-ed16a551-e3a8-41c7-a633-6a9b87fa91ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64aad5d8fff24802806797ab9c0eb9fb', 'request_id': 'req-ed16a551-e3a8-41c7-a633-6a9b87fa91ab'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:32:48.487777 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-ed16a551-e3a8-41c7-a633-6a9b87fa91ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64aad5d8fff24802806797ab9c0eb9fb', 'request_id': 'req-ed16a551-e3a8-41c7-a633-6a9b87fa91ab'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:32:48.571547 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-ed16a551-e3a8-41c7-a633-6a9b87fa91ab admin admin] The token cache is being invalidate because project 64aad5d8fff24802806797ab9c0eb9fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74005) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:32:48.571847 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-ed16a551-e3a8-41c7-a633-6a9b87fa91ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:32:48.572604 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-ed16a551-e3a8-41c7-a633-6a9b87fa91ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:32:48.580959 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1229/2456] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:32:48 2021] DELETE /identity/v3/projects/64aad5d8fff24802806797ab9c0eb9fb => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:32:48.586879 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afaebee-6d30-4050-acef-d3b763a389d7 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:32:48.587964 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afaebee-6d30-4050-acef-d3b763a389d7 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:32:48.587964 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afaebee-6d30-4050-acef-d3b763a389d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:32:48.607354 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-7afaebee-6d30-4050-acef-d3b763a389d7 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:32:48.608573 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-7afaebee-6d30-4050-acef-d3b763a389d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:32:48.676917 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1228/2457] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:32:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:32:48.684896 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d97a12f-e817-4049-81f3-7be64875a7ec None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:32:48.685423 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d97a12f-e817-4049-81f3-7be64875a7ec None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:32:48.685535 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d97a12f-e817-4049-81f3-7be64875a7ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:32:48.711442 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-1d97a12f-e817-4049-81f3-7be64875a7ec None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:32:48.711442 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-1d97a12f-e817-4049-81f3-7be64875a7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:32:48.719609 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1230/2458] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:32:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:32:48.725341 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afaebee-6d30-4050-acef-d3b763a389d7 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:32:48.738287 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afaebee-6d30-4050-acef-d3b763a389d7 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:32:48.742998 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23946f7-a615-4555-a612-7f5ebd54b0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:32:48.743667 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23946f7-a615-4555-a612-7f5ebd54b0aa admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:32:48.743979 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23946f7-a615-4555-a612-7f5ebd54b0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:32:48.744244 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23946f7-a615-4555-a612-7f5ebd54b0aa admin admin] PATH_INFO: `/v3/domains` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:32:48.745084 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23946f7-a615-4555-a612-7f5ebd54b0aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:32:48.745393 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23946f7-a615-4555-a612-7f5ebd54b0aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:32:48.746991 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23946f7-a615-4555-a612-7f5ebd54b0aa admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:32:48.759022 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1229/2459] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 12 18:32:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:32:48.764110 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d97a12f-e817-4049-81f3-7be64875a7ec None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:32:48.775506 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d97a12f-e817-4049-81f3-7be64875a7ec None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:32:48.780630 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e987566-a754-4a6d-ac11-80a8943e5ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:32:48.781296 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e987566-a754-4a6d-ac11-80a8943e5ed5 admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:32:48.781578 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e987566-a754-4a6d-ac11-80a8943e5ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:32:48.781995 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e987566-a754-4a6d-ac11-80a8943e5ed5 admin admin] PATH_INFO: `/v3/projects` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:32:48.782550 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e987566-a754-4a6d-ac11-80a8943e5ed5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:32:48.784502 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e987566-a754-4a6d-ac11-80a8943e5ed5 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:32:48.888749 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1231/2460] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:32:48 2021] POST /identity/v3/projects => generated 371 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:32:48.892750 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23946f7-a615-4555-a612-7f5ebd54b0aa admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:32:48.902810 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23946f7-a615-4555-a612-7f5ebd54b0aa admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:32:48.961282 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f5914a-6a90-4eb9-ab3d-3e10f99e82bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:32:48.961950 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5914a-6a90-4eb9-ab3d-3e10f99e82bd admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:32:48.962232 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5914a-6a90-4eb9-ab3d-3e10f99e82bd admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:32:48.962585 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5914a-6a90-4eb9-ab3d-3e10f99e82bd admin admin] PATH_INFO: `/v3/users` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:32:48.963308 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f5914a-6a90-4eb9-ab3d-3e10f99e82bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:32:48.965304 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f5914a-6a90-4eb9-ab3d-3e10f99e82bd admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:32:49.052795 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1230/2461] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:32:48 2021] POST /identity/v3/users => generated 286 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:32:49.057711 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e987566-a754-4a6d-ac11-80a8943e5ed5 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:32:49.069946 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e987566-a754-4a6d-ac11-80a8943e5ed5 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:32:49.075155 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a2042e-d5ec-4709-b5d4-fd5d0a59a2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:32:49.075830 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2042e-d5ec-4709-b5d4-fd5d0a59a2b3 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:32:49.076105 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2042e-d5ec-4709-b5d4-fd5d0a59a2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:32:49.076382 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2042e-d5ec-4709-b5d4-fd5d0a59a2b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:32:49.077163 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a2042e-d5ec-4709-b5d4-fd5d0a59a2b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:32:49.078775 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a2042e-d5ec-4709-b5d4-fd5d0a59a2b3 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:32:49.090199 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1232/2462] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:32:49 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:32:49.094338 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f5914a-6a90-4eb9-ab3d-3e10f99e82bd admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:32:49.105087 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f5914a-6a90-4eb9-ab3d-3e10f99e82bd admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:32:49.109962 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0460f17f-6e24-4ded-b7fd-742d3ad060ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:32:49.110630 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0460f17f-6e24-4ded-b7fd-742d3ad060ef admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:32:49.110910 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0460f17f-6e24-4ded-b7fd-742d3ad060ef admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:32:49.111218 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0460f17f-6e24-4ded-b7fd-742d3ad060ef admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:32:49.111956 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0460f17f-6e24-4ded-b7fd-742d3ad060ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:32:49.113610 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0460f17f-6e24-4ded-b7fd-742d3ad060ef admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:32:49.124617 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1231/2463] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:32:49 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:32:49.128957 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a2042e-d5ec-4709-b5d4-fd5d0a59a2b3 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:32:49.138950 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a2042e-d5ec-4709-b5d4-fd5d0a59a2b3 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:32:49.143743 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fb4bef-ab37-40f6-96b1-3a81218cadb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:32:49.144776 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb4bef-ab37-40f6-96b1-3a81218cadb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:32:49.145056 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb4bef-ab37-40f6-96b1-3a81218cadb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:32:49.145327 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb4bef-ab37-40f6-96b1-3a81218cadb0 admin admin] PATH_INFO: `/v3/projects/0a0a5df2996148e4a27315c28ef9279a/users/71bd1959cbe14157a8a2b30d90beecff/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:32:49.161563 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fb4bef-ab37-40f6-96b1-3a81218cadb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a0a5df2996148e4a27315c28ef9279a, user_id=71bd1959cbe14157a8a2b30d90beecff, role_id=33b8a5a8d1d643f2a98f598e6ab0a1cf)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:32:49.164234 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fb4bef-ab37-40f6-96b1-3a81218cadb0 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:32:49.279181 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1233/2464] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:32:49 2021] PUT /identity/v3/projects/0a0a5df2996148e4a27315c28ef9279a/users/71bd1959cbe14157a8a2b30d90beecff/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:32:49.295914 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dedf41-075a-4e13-9f75-652846ccab74 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:32:49.296206 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dedf41-075a-4e13-9f75-652846ccab74 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:32:49.296520 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dedf41-075a-4e13-9f75-652846ccab74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:32:49.330176 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-34dedf41-075a-4e13-9f75-652846ccab74 None None] MFA Rules not processed for user `71bd1959cbe14157a8a2b30d90beecff`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:32:49.331377 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-34dedf41-075a-4e13-9f75-652846ccab74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:32:49.394057 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1232/2465] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:32:49 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:32:49.405419 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fb4bef-ab37-40f6-96b1-3a81218cadb0 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:32:49.407139 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-f4fb4bef-ab37-40f6-96b1-3a81218cadb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:32:49.464920 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fb4bef-ab37-40f6-96b1-3a81218cadb0 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:32:49.468543 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e767b4e3-f1b0-4658-b710-cae82612fc40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6966ce0774f4437a9b688494e9d0574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:32:49.469178 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e767b4e3-f1b0-4658-b710-cae82612fc40 service cinder] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:32:49.469457 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e767b4e3-f1b0-4658-b710-cae82612fc40 service cinder] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:32:49.469727 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e767b4e3-f1b0-4658-b710-cae82612fc40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:32:49.478102 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e767b4e3-f1b0-4658-b710-cae82612fc40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:32:49.479590 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e767b4e3-f1b0-4658-b710-cae82612fc40 service cinder] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:32:49.488348 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1234/2466] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:32:49 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:32:49.513390 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dedf41-075a-4e13-9f75-652846ccab74 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:32:49.573671 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dedf41-075a-4e13-9f75-652846ccab74 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:32:49.578406 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287e59ee-5762-428a-ae43-b17380de98cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:32:49.579269 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e59ee-5762-428a-ae43-b17380de98cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:32:49.579551 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e59ee-5762-428a-ae43-b17380de98cb admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:32:49.579823 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e59ee-5762-428a-ae43-b17380de98cb admin admin] PATH_INFO: `/v3/users/71bd1959cbe14157a8a2b30d90beecff` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:32:49.581132 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287e59ee-5762-428a-ae43-b17380de98cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=71bd1959cbe14157a8a2b30d90beecff)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:32:49.583046 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287e59ee-5762-428a-ae43-b17380de98cb admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:32:49.800777 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-287e59ee-5762-428a-ae43-b17380de98cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71bd1959cbe14157a8a2b30d90beecff'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:32:49.808993 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-287e59ee-5762-428a-ae43-b17380de98cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71bd1959cbe14157a8a2b30d90beecff'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:32:49.827912 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-287e59ee-5762-428a-ae43-b17380de98cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71bd1959cbe14157a8a2b30d90beecff'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:32:49.904001 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-287e59ee-5762-428a-ae43-b17380de98cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71bd1959cbe14157a8a2b30d90beecff'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:32:49.904657 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-287e59ee-5762-428a-ae43-b17380de98cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71bd1959cbe14157a8a2b30d90beecff'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:32:49.911068 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1233/2467] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:32:49 2021] DELETE /identity/v3/users/71bd1959cbe14157a8a2b30d90beecff => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:32:49.916645 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a05224-77cb-414e-9a78-dc12fc2df936 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:32:49.917146 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a05224-77cb-414e-9a78-dc12fc2df936 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:32:49.917385 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a05224-77cb-414e-9a78-dc12fc2df936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:32:49.936425 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-53a05224-77cb-414e-9a78-dc12fc2df936 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:32:49.937644 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-53a05224-77cb-414e-9a78-dc12fc2df936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:32:49.996184 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1235/2468] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:32:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:32:50.006647 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287e59ee-5762-428a-ae43-b17380de98cb admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:32:50.008072 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-287e59ee-5762-428a-ae43-b17380de98cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:32:50.065187 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287e59ee-5762-428a-ae43-b17380de98cb admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:32:50.068858 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea40c5df-53b1-4233-8a07-aa97c1be3ecc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:32:50.069511 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40c5df-53b1-4233-8a07-aa97c1be3ecc service neutron] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:32:50.069787 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40c5df-53b1-4233-8a07-aa97c1be3ecc service neutron] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:32:50.070061 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40c5df-53b1-4233-8a07-aa97c1be3ecc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:32:50.079706 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea40c5df-53b1-4233-8a07-aa97c1be3ecc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:32:50.081181 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea40c5df-53b1-4233-8a07-aa97c1be3ecc service neutron] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:32:50.091522 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1234/2469] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:32:50 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 18:32:50.563322 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a05224-77cb-414e-9a78-dc12fc2df936 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:32:50.565086 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-53a05224-77cb-414e-9a78-dc12fc2df936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:32:50.579464 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a05224-77cb-414e-9a78-dc12fc2df936 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:32:50.584618 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf82caa-410f-483f-8662-3fa06a6527a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:32:50.589442 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf82caa-410f-483f-8662-3fa06a6527a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:32:50.589442 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf82caa-410f-483f-8662-3fa06a6527a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:32:50.589442 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf82caa-410f-483f-8662-3fa06a6527a3 admin admin] PATH_INFO: `/v3/projects/0a0a5df2996148e4a27315c28ef9279a` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:32:50.589442 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf82caa-410f-483f-8662-3fa06a6527a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a0a5df2996148e4a27315c28ef9279a)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:32:50.589442 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf82caa-410f-483f-8662-3fa06a6527a3 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:32:50.727237 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-bdf82caa-410f-483f-8662-3fa06a6527a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a0a5df2996148e4a27315c28ef9279a', 'request_id': 'req-bdf82caa-410f-483f-8662-3fa06a6527a3'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:32:50.734108 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-bdf82caa-410f-483f-8662-3fa06a6527a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a0a5df2996148e4a27315c28ef9279a', 'request_id': 'req-bdf82caa-410f-483f-8662-3fa06a6527a3'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:32:50.739583 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-bdf82caa-410f-483f-8662-3fa06a6527a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a0a5df2996148e4a27315c28ef9279a', 'request_id': 'req-bdf82caa-410f-483f-8662-3fa06a6527a3'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:32:50.851466 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-bdf82caa-410f-483f-8662-3fa06a6527a3 admin admin] The token cache is being invalidate because project 0a0a5df2996148e4a27315c28ef9279a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74005) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:32:50.851754 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-bdf82caa-410f-483f-8662-3fa06a6527a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:32:50.852470 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-bdf82caa-410f-483f-8662-3fa06a6527a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:32:50.854706 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1236/2470] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:32:50 2021] DELETE /identity/v3/projects/0a0a5df2996148e4a27315c28ef9279a => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:32:50.860532 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8493e43e-4281-47b4-b77a-bceb07c7a44b None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:32:50.861266 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8493e43e-4281-47b4-b77a-bceb07c7a44b None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:32:50.861266 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8493e43e-4281-47b4-b77a-bceb07c7a44b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:32:50.878612 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-8493e43e-4281-47b4-b77a-bceb07c7a44b None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:32:50.879830 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-8493e43e-4281-47b4-b77a-bceb07c7a44b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:32:50.941986 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1235/2471] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:32:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:32:50.951031 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8428270b-ddc6-4e71-afe8-1f4ab552debb None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:32:50.951778 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8428270b-ddc6-4e71-afe8-1f4ab552debb None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:32:50.951778 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8428270b-ddc6-4e71-afe8-1f4ab552debb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:32:50.971516 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-8428270b-ddc6-4e71-afe8-1f4ab552debb None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:32:50.972831 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-8428270b-ddc6-4e71-afe8-1f4ab552debb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:32:50.980789 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1237/2472] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:32:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:32:50.985640 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8493e43e-4281-47b4-b77a-bceb07c7a44b None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:32:50.998192 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8493e43e-4281-47b4-b77a-bceb07c7a44b None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:32:51.003112 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ab15cf-7f94-4e9d-bd0f-8b071cb6129c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:32:51.003767 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab15cf-7f94-4e9d-bd0f-8b071cb6129c admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:32:51.004046 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab15cf-7f94-4e9d-bd0f-8b071cb6129c admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:32:51.004320 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab15cf-7f94-4e9d-bd0f-8b071cb6129c admin admin] PATH_INFO: `/v3/domains` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:32:51.005089 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ab15cf-7f94-4e9d-bd0f-8b071cb6129c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:32:51.005397 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ab15cf-7f94-4e9d-bd0f-8b071cb6129c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:32:51.007024 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ab15cf-7f94-4e9d-bd0f-8b071cb6129c admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:32:51.019496 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1236/2473] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 12 18:32:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:32:51.024248 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8428270b-ddc6-4e71-afe8-1f4ab552debb None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:32:51.034769 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8428270b-ddc6-4e71-afe8-1f4ab552debb None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:32:51.039528 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13e2a3d-9d83-4892-a61f-f96a4a99ecc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:32:51.040194 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13e2a3d-9d83-4892-a61f-f96a4a99ecc5 admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:32:51.041077 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13e2a3d-9d83-4892-a61f-f96a4a99ecc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:32:51.041351 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13e2a3d-9d83-4892-a61f-f96a4a99ecc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:32:51.042062 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13e2a3d-9d83-4892-a61f-f96a4a99ecc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:32:51.043968 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13e2a3d-9d83-4892-a61f-f96a4a99ecc5 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:32:51.222597 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1238/2474] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:32:51 2021] POST /identity/v3/projects => generated 383 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:32:51.227035 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ab15cf-7f94-4e9d-bd0f-8b071cb6129c admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:32:51.238069 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ab15cf-7f94-4e9d-bd0f-8b071cb6129c admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:32:51.301039 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e0a42d-71df-47fe-aa6c-0d7dd082d256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:32:51.301708 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0a42d-71df-47fe-aa6c-0d7dd082d256 admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:32:51.301984 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0a42d-71df-47fe-aa6c-0d7dd082d256 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:32:51.302253 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0a42d-71df-47fe-aa6c-0d7dd082d256 admin admin] PATH_INFO: `/v3/users` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:32:51.302968 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e0a42d-71df-47fe-aa6c-0d7dd082d256 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:32:51.304908 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e0a42d-71df-47fe-aa6c-0d7dd082d256 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:32:51.418338 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1237/2475] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:32:51 2021] POST /identity/v3/users => generated 292 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:32:51.422648 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13e2a3d-9d83-4892-a61f-f96a4a99ecc5 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:32:51.433596 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13e2a3d-9d83-4892-a61f-f96a4a99ecc5 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:32:51.438336 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac512b8-8816-4074-b737-dc76863088cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:32:51.438999 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac512b8-8816-4074-b737-dc76863088cc admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:32:51.439280 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac512b8-8816-4074-b737-dc76863088cc admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:32:51.439553 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac512b8-8816-4074-b737-dc76863088cc admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:32:51.440286 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac512b8-8816-4074-b737-dc76863088cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:32:51.441931 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac512b8-8816-4074-b737-dc76863088cc admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:32:51.453209 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1239/2476] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:32:51 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:32:51.457278 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e0a42d-71df-47fe-aa6c-0d7dd082d256 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:32:51.467616 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e0a42d-71df-47fe-aa6c-0d7dd082d256 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:32:51.472276 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567dffc3-db85-422f-9deb-020af456c6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:32:51.473202 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567dffc3-db85-422f-9deb-020af456c6ed admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:32:51.473396 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567dffc3-db85-422f-9deb-020af456c6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:32:51.473664 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567dffc3-db85-422f-9deb-020af456c6ed admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:32:51.474440 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567dffc3-db85-422f-9deb-020af456c6ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:32:51.476017 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567dffc3-db85-422f-9deb-020af456c6ed admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:32:51.486492 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1238/2477] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:32:51 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:32:51.491849 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac512b8-8816-4074-b737-dc76863088cc admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:32:51.502515 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac512b8-8816-4074-b737-dc76863088cc admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:32:51.507261 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076fb3dc-e07a-4d3f-ba48-92d2d2b8d75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:32:51.508160 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076fb3dc-e07a-4d3f-ba48-92d2d2b8d75f admin admin] REQUEST_METHOD: `PUT` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:32:51.508468 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076fb3dc-e07a-4d3f-ba48-92d2d2b8d75f admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:32:51.508749 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076fb3dc-e07a-4d3f-ba48-92d2d2b8d75f admin admin] PATH_INFO: `/v3/projects/4ec087a3edc444cbb249442bb987326c/users/eaaa8dff1ca444f081caa0cd1b4be6a9/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:32:51.524973 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076fb3dc-e07a-4d3f-ba48-92d2d2b8d75f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ec087a3edc444cbb249442bb987326c, user_id=eaaa8dff1ca444f081caa0cd1b4be6a9, role_id=33b8a5a8d1d643f2a98f598e6ab0a1cf)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:32:51.527645 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076fb3dc-e07a-4d3f-ba48-92d2d2b8d75f admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:32:51.624659 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1240/2478] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:32:51 2021] PUT /identity/v3/projects/4ec087a3edc444cbb249442bb987326c/users/eaaa8dff1ca444f081caa0cd1b4be6a9/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:32:51.630430 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4be9b80-614f-44b4-b15a-b9f51fd43d1c None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:32:51.630998 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4be9b80-614f-44b4-b15a-b9f51fd43d1c None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:32:51.631284 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4be9b80-614f-44b4-b15a-b9f51fd43d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:32:51.649641 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-b4be9b80-614f-44b4-b15a-b9f51fd43d1c None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:32:51.651716 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-b4be9b80-614f-44b4-b15a-b9f51fd43d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:32:51.727326 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1239/2479] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:32:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:32:51.737424 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076fb3dc-e07a-4d3f-ba48-92d2d2b8d75f admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:32:51.739298 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-076fb3dc-e07a-4d3f-ba48-92d2d2b8d75f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:32:51.797398 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076fb3dc-e07a-4d3f-ba48-92d2d2b8d75f admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:32:51.801149 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f766bf7-b5b9-461d-b05f-fac50053ef8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:32:51.802242 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f766bf7-b5b9-461d-b05f-fac50053ef8c service neutron] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:32:51.802545 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f766bf7-b5b9-461d-b05f-fac50053ef8c service neutron] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:32:51.802855 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f766bf7-b5b9-461d-b05f-fac50053ef8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:32:51.816453 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f766bf7-b5b9-461d-b05f-fac50053ef8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:32:51.817943 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f766bf7-b5b9-461d-b05f-fac50053ef8c service neutron] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:32:51.829114 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1241/2480] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:32:51 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:32:53.436392 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1a309-4475-4acc-9c84-95d63afa9074 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:32:53.441146 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1a309-4475-4acc-9c84-95d63afa9074 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:32:53.441146 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1a309-4475-4acc-9c84-95d63afa9074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:32:53.464949 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-b7e1a309-4475-4acc-9c84-95d63afa9074 None None] MFA Rules not processed for user `eaaa8dff1ca444f081caa0cd1b4be6a9`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:32:53.466180 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-b7e1a309-4475-4acc-9c84-95d63afa9074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:32:53.543733 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1240/2481] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:32:53 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:32:53.554062 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f766bf7-b5b9-461d-b05f-fac50053ef8c service neutron] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:32:53.555401 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-6f766bf7-b5b9-461d-b05f-fac50053ef8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:32:53.612244 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f766bf7-b5b9-461d-b05f-fac50053ef8c service neutron] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:32:53.616329 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cd50ba-854a-424a-8814-e52c166dd9fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6966ce0774f4437a9b688494e9d0574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:32:53.617012 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd50ba-854a-424a-8814-e52c166dd9fd service cinder] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:32:53.617285 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd50ba-854a-424a-8814-e52c166dd9fd service cinder] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:32:53.617552 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd50ba-854a-424a-8814-e52c166dd9fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:32:53.626585 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cd50ba-854a-424a-8814-e52c166dd9fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:32:53.628020 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cd50ba-854a-424a-8814-e52c166dd9fd service cinder] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:32:53.637726 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1242/2482] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:32:53 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:32:56.497048 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b558b2-7d1e-4bff-96e1-90f19c4b9f44 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:32:56.497677 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b558b2-7d1e-4bff-96e1-90f19c4b9f44 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:32:56.497677 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b558b2-7d1e-4bff-96e1-90f19c4b9f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:32:56.515910 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-45b558b2-7d1e-4bff-96e1-90f19c4b9f44 None None] MFA Rules not processed for user `eaaa8dff1ca444f081caa0cd1b4be6a9`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:32:56.517403 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-45b558b2-7d1e-4bff-96e1-90f19c4b9f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:32:56.524662 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1241/2483] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:32:56 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:34:12.897171 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cd50ba-854a-424a-8814-e52c166dd9fd service cinder] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:34:12.898578 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-01cd50ba-854a-424a-8814-e52c166dd9fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:34:12.964938 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cd50ba-854a-424a-8814-e52c166dd9fd service cinder] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:34:12.969952 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2595830b-986f-451e-b003-8695356521e5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bd99e4f2d444a388ecde7ea3cb61089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:34:12.970592 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595830b-986f-451e-b003-8695356521e5 service placement] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:34:12.970877 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595830b-986f-451e-b003-8695356521e5 service placement] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:34:12.971151 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595830b-986f-451e-b003-8695356521e5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:34:12.972942 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-2595830b-986f-451e-b003-8695356521e5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:34:12.984092 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2595830b-986f-451e-b003-8695356521e5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:34:12.985708 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2595830b-986f-451e-b003-8695356521e5 service placement] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:34:12.995392 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1243/2484] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:34:12 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:34:26.811830 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5552fdf4-d083-4b98-a79e-0b2685ebfc0b None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:34:26.812758 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5552fdf4-d083-4b98-a79e-0b2685ebfc0b None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:34:26.812758 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5552fdf4-d083-4b98-a79e-0b2685ebfc0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:34:26.831223 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-5552fdf4-d083-4b98-a79e-0b2685ebfc0b None None] MFA Rules not processed for user `eaaa8dff1ca444f081caa0cd1b4be6a9`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:34:26.832623 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-5552fdf4-d083-4b98-a79e-0b2685ebfc0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:34:26.839586 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1242/2485] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:34:26 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:34:35.394703 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ac01d-af82-4cbc-85fe-4bdeb391cdb5 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:34:35.395217 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ac01d-af82-4cbc-85fe-4bdeb391cdb5 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:34:35.395315 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ac01d-af82-4cbc-85fe-4bdeb391cdb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:34:35.413264 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-749ac01d-af82-4cbc-85fe-4bdeb391cdb5 None None] MFA Rules not processed for user `8f6a3a7064754fb79a0a06b3ad4a7d05`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:34:35.414470 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-749ac01d-af82-4cbc-85fe-4bdeb391cdb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:34:35.469990 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1244/2486] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Oct 12 18:34:35 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:34:35.614120 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5552fdf4-d083-4b98-a79e-0b2685ebfc0b None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:34:35.615747 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-5552fdf4-d083-4b98-a79e-0b2685ebfc0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:34:35.695633 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5552fdf4-d083-4b98-a79e-0b2685ebfc0b None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:34:35.700623 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef868ad-2b26-40df-86e8-f8dc3c2e24d2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f527f925af24eba8cabffe457fceb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:34:35.701273 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef868ad-2b26-40df-86e8-f8dc3c2e24d2 service swift] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:34:35.702090 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef868ad-2b26-40df-86e8-f8dc3c2e24d2 service swift] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:34:35.702367 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef868ad-2b26-40df-86e8-f8dc3c2e24d2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:34:35.710640 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef868ad-2b26-40df-86e8-f8dc3c2e24d2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:34:35.712225 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef868ad-2b26-40df-86e8-f8dc3c2e24d2 service swift] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:34:35.721163 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1243/2487] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Oct 12 18:34:35 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 12 18:34:43.464483 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749ac01d-af82-4cbc-85fe-4bdeb391cdb5 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:34:43.475854 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749ac01d-af82-4cbc-85fe-4bdeb391cdb5 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:34:43.480086 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4560877-d229-455e-a32f-b5be98b80fad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:34:43.480961 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4560877-d229-455e-a32f-b5be98b80fad service neutron] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:34:43.481241 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4560877-d229-455e-a32f-b5be98b80fad service neutron] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:34:43.481566 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4560877-d229-455e-a32f-b5be98b80fad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:34:43.483396 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-a4560877-d229-455e-a32f-b5be98b80fad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:34:43.574031 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4560877-d229-455e-a32f-b5be98b80fad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:34:43.575645 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4560877-d229-455e-a32f-b5be98b80fad service neutron] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:34:43.608340 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1245/2488] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:34:43 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:34:50.587418 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef868ad-2b26-40df-86e8-f8dc3c2e24d2 service swift] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:34:50.597036 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef868ad-2b26-40df-86e8-f8dc3c2e24d2 service swift] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:34:50.600909 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99375ed8-02e5-44fa-885c-d75a906ea374 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:34:50.601544 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99375ed8-02e5-44fa-885c-d75a906ea374 service neutron] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:34:50.601826 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99375ed8-02e5-44fa-885c-d75a906ea374 service neutron] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:34:50.602101 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99375ed8-02e5-44fa-885c-d75a906ea374 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:34:50.603910 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-99375ed8-02e5-44fa-885c-d75a906ea374 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:34:50.617700 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99375ed8-02e5-44fa-885c-d75a906ea374 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:34:50.619485 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99375ed8-02e5-44fa-885c-d75a906ea374 service neutron] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:34:50.630468 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1244/2489] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:34:50 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:34:56.363549 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4560877-d229-455e-a32f-b5be98b80fad service neutron] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:34:56.365612 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-a4560877-d229-455e-a32f-b5be98b80fad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:34:56.423400 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4560877-d229-455e-a32f-b5be98b80fad service neutron] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:34:56.427061 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe7ca6f-6520-4e7e-a1bf-6dcca2def7d0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a3d3e5a5cfc4ac3afcece4e55f23552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:34:56.427705 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe7ca6f-6520-4e7e-a1bf-6dcca2def7d0 service glance] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:34:56.427990 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe7ca6f-6520-4e7e-a1bf-6dcca2def7d0 service glance] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:34:56.428268 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe7ca6f-6520-4e7e-a1bf-6dcca2def7d0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:34:56.430136 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-7fe7ca6f-6520-4e7e-a1bf-6dcca2def7d0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:34:56.515023 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe7ca6f-6520-4e7e-a1bf-6dcca2def7d0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:34:56.516632 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe7ca6f-6520-4e7e-a1bf-6dcca2def7d0 service glance] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:34:56.528975 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1246/2490] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:34:56 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:34:56.807346 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99375ed8-02e5-44fa-885c-d75a906ea374 service neutron] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:34:56.813440 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-99375ed8-02e5-44fa-885c-d75a906ea374 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:34:56.821766 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99375ed8-02e5-44fa-885c-d75a906ea374 service neutron] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:34:56.825456 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc8152d-6bdf-4da5-8a5f-848f48f26aeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:34:56.826099 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8152d-6bdf-4da5-8a5f-848f48f26aeb service neutron] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:34:56.826384 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8152d-6bdf-4da5-8a5f-848f48f26aeb service neutron] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:34:56.826659 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8152d-6bdf-4da5-8a5f-848f48f26aeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:34:56.828631 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-7bc8152d-6bdf-4da5-8a5f-848f48f26aeb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:34:56.838411 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc8152d-6bdf-4da5-8a5f-848f48f26aeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:34:56.840100 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc8152d-6bdf-4da5-8a5f-848f48f26aeb service neutron] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:34:56.849132 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1245/2491] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:34:56 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:34:58.880265 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe7ca6f-6520-4e7e-a1bf-6dcca2def7d0 service glance] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:34:58.882348 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-7fe7ca6f-6520-4e7e-a1bf-6dcca2def7d0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:34:58.901061 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe7ca6f-6520-4e7e-a1bf-6dcca2def7d0 service glance] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:34:58.910903 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c544186-48fd-48aa-b513-4824cf579152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:34:58.911871 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c544186-48fd-48aa-b513-4824cf579152 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:34:58.912368 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c544186-48fd-48aa-b513-4824cf579152 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:34:58.912694 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c544186-48fd-48aa-b513-4824cf579152 admin admin] PATH_INFO: `/v3/users/d6959ea6a5c642258bc40a8fe0c2b3ce` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:34:58.913958 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c544186-48fd-48aa-b513-4824cf579152 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6959ea6a5c642258bc40a8fe0c2b3ce)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:34:58.916076 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c544186-48fd-48aa-b513-4824cf579152 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:34:59.177996 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-9c544186-48fd-48aa-b513-4824cf579152 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6959ea6a5c642258bc40a8fe0c2b3ce'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:34:59.178653 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-9c544186-48fd-48aa-b513-4824cf579152 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6959ea6a5c642258bc40a8fe0c2b3ce'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:34:59.189965 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-9c544186-48fd-48aa-b513-4824cf579152 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6959ea6a5c642258bc40a8fe0c2b3ce'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:34:59.190605 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-9c544186-48fd-48aa-b513-4824cf579152 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6959ea6a5c642258bc40a8fe0c2b3ce'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:34:59.197425 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-9c544186-48fd-48aa-b513-4824cf579152 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6959ea6a5c642258bc40a8fe0c2b3ce'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:34:59.275846 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1247/2492] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:34:58 2021] DELETE /identity/v3/users/d6959ea6a5c642258bc40a8fe0c2b3ce => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 18:34:59.286273 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2128d0-fa8b-4948-9489-1f9d24f19b4d None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:34:59.286826 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2128d0-fa8b-4948-9489-1f9d24f19b4d None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:34:59.286990 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2128d0-fa8b-4948-9489-1f9d24f19b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:34:59.304653 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-3f2128d0-fa8b-4948-9489-1f9d24f19b4d None None] MFA Rules not processed for user `8f6a3a7064754fb79a0a06b3ad4a7d05`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:34:59.305949 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-3f2128d0-fa8b-4948-9489-1f9d24f19b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:34:59.360832 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1246/2493] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Oct 12 18:34:59 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:34:59.374984 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c544186-48fd-48aa-b513-4824cf579152 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:34:59.376654 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-9c544186-48fd-48aa-b513-4824cf579152 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:34:59.456735 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c544186-48fd-48aa-b513-4824cf579152 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:34:59.461810 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458b3ef1-a4fb-4067-9db7-0c7f714b5de2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f527f925af24eba8cabffe457fceb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:34:59.462458 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b3ef1-a4fb-4067-9db7-0c7f714b5de2 service swift] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:34:59.462743 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b3ef1-a4fb-4067-9db7-0c7f714b5de2 service swift] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:34:59.463071 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b3ef1-a4fb-4067-9db7-0c7f714b5de2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:34:59.472041 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458b3ef1-a4fb-4067-9db7-0c7f714b5de2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:34:59.473697 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458b3ef1-a4fb-4067-9db7-0c7f714b5de2 service swift] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:34:59.482274 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1248/2494] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Oct 12 18:34:59 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 18:34:59.551418 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2128d0-fa8b-4948-9489-1f9d24f19b4d None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:34:59.555593 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-3f2128d0-fa8b-4948-9489-1f9d24f19b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:34:59.628500 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2128d0-fa8b-4948-9489-1f9d24f19b4d None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:34:59.634970 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c02ee88-15c9-40e2-8c9c-98fd850f3263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:34:59.634970 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c02ee88-15c9-40e2-8c9c-98fd850f3263 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:34:59.634970 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c02ee88-15c9-40e2-8c9c-98fd850f3263 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:34:59.635715 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c02ee88-15c9-40e2-8c9c-98fd850f3263 admin admin] PATH_INFO: `/v3/projects/38a1ca7b8f55456eb3c6946099885e5e` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:34:59.636338 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c02ee88-15c9-40e2-8c9c-98fd850f3263 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38a1ca7b8f55456eb3c6946099885e5e)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:34:59.638884 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c02ee88-15c9-40e2-8c9c-98fd850f3263 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:34:59.754243 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-0c02ee88-15c9-40e2-8c9c-98fd850f3263 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38a1ca7b8f55456eb3c6946099885e5e', 'request_id': 'req-0c02ee88-15c9-40e2-8c9c-98fd850f3263'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:34:59.816488 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-0c02ee88-15c9-40e2-8c9c-98fd850f3263 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38a1ca7b8f55456eb3c6946099885e5e', 'request_id': 'req-0c02ee88-15c9-40e2-8c9c-98fd850f3263'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:34:59.825920 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-0c02ee88-15c9-40e2-8c9c-98fd850f3263 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38a1ca7b8f55456eb3c6946099885e5e', 'request_id': 'req-0c02ee88-15c9-40e2-8c9c-98fd850f3263'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:34:59.851611 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-0c02ee88-15c9-40e2-8c9c-98fd850f3263 admin admin] The token cache is being invalidate because project 38a1ca7b8f55456eb3c6946099885e5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:34:59.852800 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-0c02ee88-15c9-40e2-8c9c-98fd850f3263 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:34:59.853875 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-0c02ee88-15c9-40e2-8c9c-98fd850f3263 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:34:59.856259 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1247/2495] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:34:59 2021] DELETE /identity/v3/projects/38a1ca7b8f55456eb3c6946099885e5e => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:34:59.860740 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458b3ef1-a4fb-4067-9db7-0c7f714b5de2 service swift] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:34:59.879341 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458b3ef1-a4fb-4067-9db7-0c7f714b5de2 service swift] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:34:59.957408 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1b0802-e6af-4f67-a059-d0c20301d970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:34:59.958625 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b0802-e6af-4f67-a059-d0c20301d970 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:34:59.959117 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b0802-e6af-4f67-a059-d0c20301d970 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:34:59.959579 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b0802-e6af-4f67-a059-d0c20301d970 admin admin] PATH_INFO: `/v3/users/a5ab3098aa7a41698260180bf0ed0be4` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:34:59.964033 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1b0802-e6af-4f67-a059-d0c20301d970 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5ab3098aa7a41698260180bf0ed0be4)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:34:59.967384 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1b0802-e6af-4f67-a059-d0c20301d970 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:35:00.202034 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-5b1b0802-e6af-4f67-a059-d0c20301d970 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5ab3098aa7a41698260180bf0ed0be4'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:35:00.204233 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-5b1b0802-e6af-4f67-a059-d0c20301d970 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5ab3098aa7a41698260180bf0ed0be4'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:35:00.226528 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-5b1b0802-e6af-4f67-a059-d0c20301d970 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5ab3098aa7a41698260180bf0ed0be4'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:35:00.227259 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-5b1b0802-e6af-4f67-a059-d0c20301d970 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5ab3098aa7a41698260180bf0ed0be4'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:35:00.235479 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-5b1b0802-e6af-4f67-a059-d0c20301d970 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5ab3098aa7a41698260180bf0ed0be4'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:35:00.338693 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1249/2496] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:34:59 2021] DELETE /identity/v3/users/a5ab3098aa7a41698260180bf0ed0be4 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:35:00.635967 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c02ee88-15c9-40e2-8c9c-98fd850f3263 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:35:00.637440 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-0c02ee88-15c9-40e2-8c9c-98fd850f3263 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:35:00.661008 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c02ee88-15c9-40e2-8c9c-98fd850f3263 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:35:00.722988 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2b0dc9-9b5b-4ed0-a26d-41842dd08d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:35:00.723919 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b0dc9-9b5b-4ed0-a26d-41842dd08d35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:35:00.724166 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b0dc9-9b5b-4ed0-a26d-41842dd08d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:35:00.724392 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b0dc9-9b5b-4ed0-a26d-41842dd08d35 admin admin] PATH_INFO: `/v3/projects/31e826e73cd747eba516dd786f63bc90` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:35:00.725833 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2b0dc9-9b5b-4ed0-a26d-41842dd08d35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31e826e73cd747eba516dd786f63bc90)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:35:00.727607 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2b0dc9-9b5b-4ed0-a26d-41842dd08d35 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:35:00.847646 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-7b2b0dc9-9b5b-4ed0-a26d-41842dd08d35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31e826e73cd747eba516dd786f63bc90', 'request_id': 'req-7b2b0dc9-9b5b-4ed0-a26d-41842dd08d35'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:35:00.939625 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-7b2b0dc9-9b5b-4ed0-a26d-41842dd08d35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31e826e73cd747eba516dd786f63bc90', 'request_id': 'req-7b2b0dc9-9b5b-4ed0-a26d-41842dd08d35'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:35:00.947724 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-7b2b0dc9-9b5b-4ed0-a26d-41842dd08d35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31e826e73cd747eba516dd786f63bc90', 'request_id': 'req-7b2b0dc9-9b5b-4ed0-a26d-41842dd08d35'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:35:00.959938 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-7b2b0dc9-9b5b-4ed0-a26d-41842dd08d35 admin admin] The token cache is being invalidate because project 31e826e73cd747eba516dd786f63bc90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:35:00.961738 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-7b2b0dc9-9b5b-4ed0-a26d-41842dd08d35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:35:00.961738 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-7b2b0dc9-9b5b-4ed0-a26d-41842dd08d35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:35:00.963481 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1248/2497] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:35:00 2021] DELETE /identity/v3/projects/31e826e73cd747eba516dd786f63bc90 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 18:35:10.293333 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1b0802-e6af-4f67-a059-d0c20301d970 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:35:10.295433 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-5b1b0802-e6af-4f67-a059-d0c20301d970 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:35:10.350897 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1b0802-e6af-4f67-a059-d0c20301d970 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:35:10.402773 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1983ef-b452-4dcc-8dad-164319bd9682 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6966ce0774f4437a9b688494e9d0574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:35:10.403423 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1983ef-b452-4dcc-8dad-164319bd9682 service cinder] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:35:10.403706 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1983ef-b452-4dcc-8dad-164319bd9682 service cinder] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:35:10.403979 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1983ef-b452-4dcc-8dad-164319bd9682 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:35:10.406057 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-1a1983ef-b452-4dcc-8dad-164319bd9682 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:35:10.468592 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1983ef-b452-4dcc-8dad-164319bd9682 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:35:10.470323 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1983ef-b452-4dcc-8dad-164319bd9682 service cinder] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:35:10.479576 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1250/2498] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:35:10 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:35:30.287796 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da8fecd-a0af-4ec7-bd55-b1ee5e316ddf None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:35:30.288391 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da8fecd-a0af-4ec7-bd55-b1ee5e316ddf None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:35:30.288391 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da8fecd-a0af-4ec7-bd55-b1ee5e316ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:35:30.305666 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-7da8fecd-a0af-4ec7-bd55-b1ee5e316ddf None None] MFA Rules not processed for user `9a37985dd5034ceeabfa47797efba5a1`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:35:30.306847 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-7da8fecd-a0af-4ec7-bd55-b1ee5e316ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:35:30.314353 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1249/2499] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:35:30 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:35:32.629132 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b46d70-4167-4170-9eb3-bd912d01c094 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:35:32.629617 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b46d70-4167-4170-9eb3-bd912d01c094 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:35:32.629822 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b46d70-4167-4170-9eb3-bd912d01c094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:35:32.649730 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-c3b46d70-4167-4170-9eb3-bd912d01c094 None None] MFA Rules not processed for user `8f6a3a7064754fb79a0a06b3ad4a7d05`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:35:32.650968 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-c3b46d70-4167-4170-9eb3-bd912d01c094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:35:32.709271 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1251/2500] 10.222.0.18 () {58 vars in 967 bytes} [Tue Oct 12 18:35:32 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:35:32.722649 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da8fecd-a0af-4ec7-bd55-b1ee5e316ddf None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:35:32.724036 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-7da8fecd-a0af-4ec7-bd55-b1ee5e316ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:35:32.795075 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da8fecd-a0af-4ec7-bd55-b1ee5e316ddf None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:35:32.800020 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dd0212-76f6-467b-a9de-43aaca1e2844 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f527f925af24eba8cabffe457fceb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:35:32.800738 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd0212-76f6-467b-a9de-43aaca1e2844 service swift] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:35:32.801038 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd0212-76f6-467b-a9de-43aaca1e2844 service swift] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:35:32.801328 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd0212-76f6-467b-a9de-43aaca1e2844 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:35:32.809412 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dd0212-76f6-467b-a9de-43aaca1e2844 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:35:32.811001 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dd0212-76f6-467b-a9de-43aaca1e2844 service swift] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:35:32.819344 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1250/2501] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Oct 12 18:35:32 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 18:35:34.647702 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b46d70-4167-4170-9eb3-bd912d01c094 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:35:34.649161 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-c3b46d70-4167-4170-9eb3-bd912d01c094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:35:34.711299 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b46d70-4167-4170-9eb3-bd912d01c094 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:35:34.715388 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcf59a9-ccb5-46b6-815e-de7fc9bcbb96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:35:34.716046 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf59a9-ccb5-46b6-815e-de7fc9bcbb96 service neutron] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:35:34.716332 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf59a9-ccb5-46b6-815e-de7fc9bcbb96 service neutron] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:35:34.716640 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf59a9-ccb5-46b6-815e-de7fc9bcbb96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:35:34.718491 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-dbcf59a9-ccb5-46b6-815e-de7fc9bcbb96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:35:34.791112 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcf59a9-ccb5-46b6-815e-de7fc9bcbb96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:35:34.792593 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcf59a9-ccb5-46b6-815e-de7fc9bcbb96 service neutron] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:35:34.803767 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1252/2502] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:35:34 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:35:36.044197 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dd0212-76f6-467b-a9de-43aaca1e2844 service swift] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:35:36.064773 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dd0212-76f6-467b-a9de-43aaca1e2844 service swift] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:35:36.074717 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f280306b-31e5-43a0-864e-1deadf0b321c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:35:36.075362 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f280306b-31e5-43a0-864e-1deadf0b321c service neutron] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:35:36.076948 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f280306b-31e5-43a0-864e-1deadf0b321c service neutron] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:35:36.076948 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f280306b-31e5-43a0-864e-1deadf0b321c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:35:36.079529 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-f280306b-31e5-43a0-864e-1deadf0b321c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:35:36.098447 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f280306b-31e5-43a0-864e-1deadf0b321c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:35:36.102365 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f280306b-31e5-43a0-864e-1deadf0b321c service neutron] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:35:36.117988 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1251/2503] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:35:36 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:35:41.495504 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcf59a9-ccb5-46b6-815e-de7fc9bcbb96 service neutron] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:35:41.496983 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-dbcf59a9-ccb5-46b6-815e-de7fc9bcbb96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:35:41.508272 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcf59a9-ccb5-46b6-815e-de7fc9bcbb96 service neutron] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:35:41.511854 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7936391a-697d-46cb-94db-8a66c5e1ff48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6966ce0774f4437a9b688494e9d0574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:35:41.512537 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936391a-697d-46cb-94db-8a66c5e1ff48 service cinder] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:35:41.512816 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936391a-697d-46cb-94db-8a66c5e1ff48 service cinder] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:35:41.513089 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936391a-697d-46cb-94db-8a66c5e1ff48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:35:41.514812 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-7936391a-697d-46cb-94db-8a66c5e1ff48 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:35:41.592065 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7936391a-697d-46cb-94db-8a66c5e1ff48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:35:41.594083 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7936391a-697d-46cb-94db-8a66c5e1ff48 service cinder] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:35:41.603065 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1253/2504] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:35:41 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:35:47.987986 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f280306b-31e5-43a0-864e-1deadf0b321c service neutron] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:35:47.989611 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-f280306b-31e5-43a0-864e-1deadf0b321c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:35:48.002858 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f280306b-31e5-43a0-864e-1deadf0b321c service neutron] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:35:48.007850 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0ae1d3-8c49-4e71-8ade-7529976701fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:35:48.008628 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ae1d3-8c49-4e71-8ade-7529976701fa service neutron] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:35:48.008969 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ae1d3-8c49-4e71-8ade-7529976701fa service neutron] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:35:48.009175 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ae1d3-8c49-4e71-8ade-7529976701fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:35:48.011195 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-fd0ae1d3-8c49-4e71-8ade-7529976701fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:35:48.087490 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0ae1d3-8c49-4e71-8ade-7529976701fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:35:48.088987 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0ae1d3-8c49-4e71-8ade-7529976701fa service neutron] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:35:48.099874 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1252/2505] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:35:47 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:35:52.343132 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7936391a-697d-46cb-94db-8a66c5e1ff48 service cinder] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:35:52.344703 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-7936391a-697d-46cb-94db-8a66c5e1ff48 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:35:52.360000 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7936391a-697d-46cb-94db-8a66c5e1ff48 service cinder] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:35:52.364717 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71fbe77-6e63-4c86-a6f8-689bd0466f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:35:52.365498 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71fbe77-6e63-4c86-a6f8-689bd0466f78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:35:52.365780 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71fbe77-6e63-4c86-a6f8-689bd0466f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:35:52.366055 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71fbe77-6e63-4c86-a6f8-689bd0466f78 admin admin] PATH_INFO: `/v3/users/835bbb43ae5f48bfa14b22cb0a47cb4e` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:35:52.367268 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71fbe77-6e63-4c86-a6f8-689bd0466f78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=835bbb43ae5f48bfa14b22cb0a47cb4e)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:35:52.369228 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71fbe77-6e63-4c86-a6f8-689bd0466f78 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:35:52.606214 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-d71fbe77-6e63-4c86-a6f8-689bd0466f78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '835bbb43ae5f48bfa14b22cb0a47cb4e'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:35:52.607028 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-d71fbe77-6e63-4c86-a6f8-689bd0466f78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '835bbb43ae5f48bfa14b22cb0a47cb4e'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:35:52.619456 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-d71fbe77-6e63-4c86-a6f8-689bd0466f78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '835bbb43ae5f48bfa14b22cb0a47cb4e'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:35:52.620207 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-d71fbe77-6e63-4c86-a6f8-689bd0466f78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '835bbb43ae5f48bfa14b22cb0a47cb4e'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:35:52.629198 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-d71fbe77-6e63-4c86-a6f8-689bd0466f78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '835bbb43ae5f48bfa14b22cb0a47cb4e'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:35:52.728183 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1254/2506] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:35:52 2021] DELETE /identity/v3/users/835bbb43ae5f48bfa14b22cb0a47cb4e => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:35:52.996939 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0ae1d3-8c49-4e71-8ade-7529976701fa service neutron] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:35:53.012097 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0ae1d3-8c49-4e71-8ade-7529976701fa service neutron] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:35:53.079144 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aabd33-639b-4d92-81fd-a6bc09d53169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:35:53.080248 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aabd33-639b-4d92-81fd-a6bc09d53169 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:35:53.080562 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aabd33-639b-4d92-81fd-a6bc09d53169 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:35:53.080865 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aabd33-639b-4d92-81fd-a6bc09d53169 admin admin] PATH_INFO: `/v3/projects/ee04649277c84912b20967b31162615b` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:35:53.082258 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aabd33-639b-4d92-81fd-a6bc09d53169 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee04649277c84912b20967b31162615b)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:35:53.084250 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aabd33-639b-4d92-81fd-a6bc09d53169 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:35:53.234046 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-59aabd33-639b-4d92-81fd-a6bc09d53169 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee04649277c84912b20967b31162615b', 'request_id': 'req-59aabd33-639b-4d92-81fd-a6bc09d53169'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:35:53.323243 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-59aabd33-639b-4d92-81fd-a6bc09d53169 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee04649277c84912b20967b31162615b', 'request_id': 'req-59aabd33-639b-4d92-81fd-a6bc09d53169'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:35:53.330270 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-59aabd33-639b-4d92-81fd-a6bc09d53169 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee04649277c84912b20967b31162615b', 'request_id': 'req-59aabd33-639b-4d92-81fd-a6bc09d53169'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:35:53.340356 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-59aabd33-639b-4d92-81fd-a6bc09d53169 admin admin] The token cache is being invalidate because project ee04649277c84912b20967b31162615b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:35:53.340673 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-59aabd33-639b-4d92-81fd-a6bc09d53169 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:35:53.341307 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-59aabd33-639b-4d92-81fd-a6bc09d53169 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:35:53.343373 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1253/2507] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:35:52 2021] DELETE /identity/v3/projects/ee04649277c84912b20967b31162615b => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 18:35:53.350140 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72159f83-98d4-4c2b-91e9-0ad6cec15ffb None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:35:53.350616 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72159f83-98d4-4c2b-91e9-0ad6cec15ffb None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:35:53.350804 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72159f83-98d4-4c2b-91e9-0ad6cec15ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:35:53.369173 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-72159f83-98d4-4c2b-91e9-0ad6cec15ffb None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:35:53.370465 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-72159f83-98d4-4c2b-91e9-0ad6cec15ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:35:53.427124 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1255/2508] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:35:53 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:35:53.435035 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88138446-a281-46dc-a447-30501f210f57 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:35:53.435319 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88138446-a281-46dc-a447-30501f210f57 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:35:53.435617 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88138446-a281-46dc-a447-30501f210f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:35:53.455777 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-88138446-a281-46dc-a447-30501f210f57 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:35:53.457004 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-88138446-a281-46dc-a447-30501f210f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:35:53.464935 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1254/2509] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:35:53 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:35:53.469968 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72159f83-98d4-4c2b-91e9-0ad6cec15ffb None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:35:53.479472 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72159f83-98d4-4c2b-91e9-0ad6cec15ffb None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:35:53.484758 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f2b0ec-69c3-4c31-89e7-d142e85ef8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:35:53.485414 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f2b0ec-69c3-4c31-89e7-d142e85ef8a7 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:35:53.485702 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f2b0ec-69c3-4c31-89e7-d142e85ef8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:35:53.485978 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f2b0ec-69c3-4c31-89e7-d142e85ef8a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:35:53.486709 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f2b0ec-69c3-4c31-89e7-d142e85ef8a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:35:53.487070 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f2b0ec-69c3-4c31-89e7-d142e85ef8a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:35:53.488683 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f2b0ec-69c3-4c31-89e7-d142e85ef8a7 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:35:53.503515 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1256/2510] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 12 18:35:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:35:53.507865 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88138446-a281-46dc-a447-30501f210f57 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:35:53.517046 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88138446-a281-46dc-a447-30501f210f57 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:35:53.521864 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c78aeff-23a3-4e30-be6d-fc45f591a010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:35:53.522512 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c78aeff-23a3-4e30-be6d-fc45f591a010 admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:35:53.522789 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c78aeff-23a3-4e30-be6d-fc45f591a010 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:35:53.523066 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c78aeff-23a3-4e30-be6d-fc45f591a010 admin admin] PATH_INFO: `/v3/projects` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:35:53.523771 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c78aeff-23a3-4e30-be6d-fc45f591a010 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:35:53.525696 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c78aeff-23a3-4e30-be6d-fc45f591a010 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:35:53.605244 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1255/2511] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:35:53 2021] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:35:53.609839 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f2b0ec-69c3-4c31-89e7-d142e85ef8a7 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:35:53.620714 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f2b0ec-69c3-4c31-89e7-d142e85ef8a7 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:35:53.675017 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f23ca5-1c66-4ead-ad73-1bfdcfa6bf14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:35:53.675684 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f23ca5-1c66-4ead-ad73-1bfdcfa6bf14 admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:35:53.675964 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f23ca5-1c66-4ead-ad73-1bfdcfa6bf14 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:35:53.676241 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f23ca5-1c66-4ead-ad73-1bfdcfa6bf14 admin admin] PATH_INFO: `/v3/users` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:35:53.677141 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f23ca5-1c66-4ead-ad73-1bfdcfa6bf14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:35:53.679017 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f23ca5-1c66-4ead-ad73-1bfdcfa6bf14 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:35:53.770022 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1257/2512] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:35:53 2021] POST /identity/v3/users => generated 293 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:35:53.774212 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c78aeff-23a3-4e30-be6d-fc45f591a010 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:35:53.785469 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c78aeff-23a3-4e30-be6d-fc45f591a010 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:35:53.790023 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e012fc7-a21f-44a3-aafd-aee2aa485a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:35:53.790732 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e012fc7-a21f-44a3-aafd-aee2aa485a70 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:35:53.791013 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e012fc7-a21f-44a3-aafd-aee2aa485a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:35:53.791279 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e012fc7-a21f-44a3-aafd-aee2aa485a70 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:35:53.792003 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e012fc7-a21f-44a3-aafd-aee2aa485a70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:35:53.793602 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e012fc7-a21f-44a3-aafd-aee2aa485a70 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:35:53.807967 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1256/2513] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:35:53 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:35:53.812002 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f23ca5-1c66-4ead-ad73-1bfdcfa6bf14 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:35:53.822393 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f23ca5-1c66-4ead-ad73-1bfdcfa6bf14 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:35:53.828236 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca64ec4-57be-42d5-85b3-d1dd12904971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:35:53.829189 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca64ec4-57be-42d5-85b3-d1dd12904971 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:35:53.829591 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca64ec4-57be-42d5-85b3-d1dd12904971 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:35:53.829933 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca64ec4-57be-42d5-85b3-d1dd12904971 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:35:53.830978 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca64ec4-57be-42d5-85b3-d1dd12904971 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:35:53.832800 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca64ec4-57be-42d5-85b3-d1dd12904971 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:35:53.844617 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1258/2514] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:35:53 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:35:53.852580 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e012fc7-a21f-44a3-aafd-aee2aa485a70 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:35:53.858686 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e012fc7-a21f-44a3-aafd-aee2aa485a70 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:35:53.870287 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a80b6-61ac-4cbf-be1e-b11c2c87bee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:35:53.871209 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a80b6-61ac-4cbf-be1e-b11c2c87bee4 admin admin] REQUEST_METHOD: `PUT` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:35:53.871483 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a80b6-61ac-4cbf-be1e-b11c2c87bee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:35:53.871768 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a80b6-61ac-4cbf-be1e-b11c2c87bee4 admin admin] PATH_INFO: `/v3/projects/9b114869544b4236a53ce1103cfc7abf/users/75606513d1c04a9a8f95e0c0f60d9c11/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:35:53.887508 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64a80b6-61ac-4cbf-be1e-b11c2c87bee4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b114869544b4236a53ce1103cfc7abf, user_id=75606513d1c04a9a8f95e0c0f60d9c11, role_id=33b8a5a8d1d643f2a98f598e6ab0a1cf)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:35:53.890896 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64a80b6-61ac-4cbf-be1e-b11c2c87bee4 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:35:53.964073 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1257/2515] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:35:53 2021] PUT /identity/v3/projects/9b114869544b4236a53ce1103cfc7abf/users/75606513d1c04a9a8f95e0c0f60d9c11/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 18:35:53.969955 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dbf180-7994-450f-866c-f5b663f1fd35 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:35:53.970345 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dbf180-7994-450f-866c-f5b663f1fd35 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:35:53.970495 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dbf180-7994-450f-866c-f5b663f1fd35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:35:53.988628 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-b1dbf180-7994-450f-866c-f5b663f1fd35 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:35:53.989843 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-b1dbf180-7994-450f-866c-f5b663f1fd35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:35:54.047162 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1259/2516] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:35:53 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:35:54.057155 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a80b6-61ac-4cbf-be1e-b11c2c87bee4 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:35:54.058861 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-e64a80b6-61ac-4cbf-be1e-b11c2c87bee4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:35:54.116780 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a80b6-61ac-4cbf-be1e-b11c2c87bee4 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:35:54.120588 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cf1662-4515-41c1-9625-a0adc2f20131 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:35:54.121227 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf1662-4515-41c1-9625-a0adc2f20131 service neutron] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:35:54.121534 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf1662-4515-41c1-9625-a0adc2f20131 service neutron] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:35:54.121808 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf1662-4515-41c1-9625-a0adc2f20131 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:35:54.133010 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cf1662-4515-41c1-9625-a0adc2f20131 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:35:54.137066 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cf1662-4515-41c1-9625-a0adc2f20131 service neutron] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:35:54.145548 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1258/2517] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:35:54 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:35:54.454593 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dbf180-7994-450f-866c-f5b663f1fd35 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:35:54.464173 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dbf180-7994-450f-866c-f5b663f1fd35 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:35:54.468001 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02dbfcb-e2d7-41d0-8d72-e86d4507832b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:35:54.468700 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02dbfcb-e2d7-41d0-8d72-e86d4507832b service neutron] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:35:54.468978 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02dbfcb-e2d7-41d0-8d72-e86d4507832b service neutron] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:35:54.469275 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02dbfcb-e2d7-41d0-8d72-e86d4507832b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:35:54.471034 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-c02dbfcb-e2d7-41d0-8d72-e86d4507832b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:35:54.538544 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02dbfcb-e2d7-41d0-8d72-e86d4507832b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:35:54.540006 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02dbfcb-e2d7-41d0-8d72-e86d4507832b service neutron] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:35:54.551888 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1260/2518] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:35:54 2021] GET /identity/v3/auth/tokens => generated 3466 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:35:55.544056 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cccf58-5641-443a-9c8b-db810d4d6946 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:35:55.544646 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cccf58-5641-443a-9c8b-db810d4d6946 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:35:55.544758 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cccf58-5641-443a-9c8b-db810d4d6946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:35:55.574568 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-d0cccf58-5641-443a-9c8b-db810d4d6946 None None] MFA Rules not processed for user `75606513d1c04a9a8f95e0c0f60d9c11`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:35:55.576092 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-d0cccf58-5641-443a-9c8b-db810d4d6946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:35:55.673231 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1259/2519] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:35:55 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:35:55.684847 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b5e8af-fd51-48d5-9297-1e6092bcd5e8 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:35:55.686438 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b5e8af-fd51-48d5-9297-1e6092bcd5e8 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:35:55.686721 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b5e8af-fd51-48d5-9297-1e6092bcd5e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:35:55.705079 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-d5b5e8af-fd51-48d5-9297-1e6092bcd5e8 None None] MFA Rules not processed for user `75606513d1c04a9a8f95e0c0f60d9c11`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:35:55.706307 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-d5b5e8af-fd51-48d5-9297-1e6092bcd5e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:35:55.713420 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1261/2520] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:35:55 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:35:55.724547 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cccf58-5641-443a-9c8b-db810d4d6946 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:35:55.729491 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-d0cccf58-5641-443a-9c8b-db810d4d6946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:35:55.799912 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cccf58-5641-443a-9c8b-db810d4d6946 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:35:55.805577 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcdc264-311b-42b6-92e1-fa0d2567e490 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3417097a280b499086b36df9a2548239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:35:55.806224 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcdc264-311b-42b6-92e1-fa0d2567e490 service nova] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:35:55.806511 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcdc264-311b-42b6-92e1-fa0d2567e490 service nova] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:35:55.806793 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcdc264-311b-42b6-92e1-fa0d2567e490 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:35:55.815529 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcdc264-311b-42b6-92e1-fa0d2567e490 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:35:55.817247 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcdc264-311b-42b6-92e1-fa0d2567e490 service nova] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:35:55.827495 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1260/2521] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:35:55 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:36:09.306574 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b5e8af-fd51-48d5-9297-1e6092bcd5e8 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:36:09.317550 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b5e8af-fd51-48d5-9297-1e6092bcd5e8 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:36:09.320982 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91328775-ba7b-47dc-aad1-f73236112a14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:36:09.321622 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91328775-ba7b-47dc-aad1-f73236112a14 service neutron] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:36:09.321903 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91328775-ba7b-47dc-aad1-f73236112a14 service neutron] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:36:09.322178 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91328775-ba7b-47dc-aad1-f73236112a14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:36:09.323950 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-91328775-ba7b-47dc-aad1-f73236112a14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:36:09.334742 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91328775-ba7b-47dc-aad1-f73236112a14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:36:09.336392 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91328775-ba7b-47dc-aad1-f73236112a14 service neutron] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:36:09.344514 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1262/2522] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:36:09 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:36:10.337077 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcdc264-311b-42b6-92e1-fa0d2567e490 service nova] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:36:10.338548 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-4bcdc264-311b-42b6-92e1-fa0d2567e490 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:36:10.353267 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcdc264-311b-42b6-92e1-fa0d2567e490 service nova] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:36:10.357610 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0084fd2f-85a6-49ef-ba3e-8e8ef89dee50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:36:10.358582 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0084fd2f-85a6-49ef-ba3e-8e8ef89dee50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:36:10.358890 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0084fd2f-85a6-49ef-ba3e-8e8ef89dee50 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:36:10.359173 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0084fd2f-85a6-49ef-ba3e-8e8ef89dee50 admin admin] PATH_INFO: `/v3/users/eaaa8dff1ca444f081caa0cd1b4be6a9` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:36:10.360379 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0084fd2f-85a6-49ef-ba3e-8e8ef89dee50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eaaa8dff1ca444f081caa0cd1b4be6a9)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:36:10.362417 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0084fd2f-85a6-49ef-ba3e-8e8ef89dee50 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:36:10.777564 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-0084fd2f-85a6-49ef-ba3e-8e8ef89dee50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eaaa8dff1ca444f081caa0cd1b4be6a9'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:36:10.790498 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-0084fd2f-85a6-49ef-ba3e-8e8ef89dee50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eaaa8dff1ca444f081caa0cd1b4be6a9'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:36:10.815663 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-0084fd2f-85a6-49ef-ba3e-8e8ef89dee50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eaaa8dff1ca444f081caa0cd1b4be6a9'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:36:10.988776 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-0084fd2f-85a6-49ef-ba3e-8e8ef89dee50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eaaa8dff1ca444f081caa0cd1b4be6a9'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:36:10.999258 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-0084fd2f-85a6-49ef-ba3e-8e8ef89dee50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eaaa8dff1ca444f081caa0cd1b4be6a9'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:36:10.999258 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1261/2523] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:36:10 2021] DELETE /identity/v3/users/eaaa8dff1ca444f081caa0cd1b4be6a9 => generated 0 bytes in 660 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:36:11.275940 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91328775-ba7b-47dc-aad1-f73236112a14 service neutron] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:36:11.289920 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91328775-ba7b-47dc-aad1-f73236112a14 service neutron] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:36:11.352230 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4a4e2f-71fc-4b95-8abc-10be45d1365c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:36:11.353119 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a4e2f-71fc-4b95-8abc-10be45d1365c admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:36:11.353403 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a4e2f-71fc-4b95-8abc-10be45d1365c admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:36:11.353676 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a4e2f-71fc-4b95-8abc-10be45d1365c admin admin] PATH_INFO: `/v3/projects/4ec087a3edc444cbb249442bb987326c` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:36:11.354885 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4a4e2f-71fc-4b95-8abc-10be45d1365c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ec087a3edc444cbb249442bb987326c)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:36:11.356837 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4a4e2f-71fc-4b95-8abc-10be45d1365c admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:36:11.548215 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-5b4a4e2f-71fc-4b95-8abc-10be45d1365c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ec087a3edc444cbb249442bb987326c', 'request_id': 'req-5b4a4e2f-71fc-4b95-8abc-10be45d1365c'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:36:11.554346 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-5b4a4e2f-71fc-4b95-8abc-10be45d1365c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ec087a3edc444cbb249442bb987326c', 'request_id': 'req-5b4a4e2f-71fc-4b95-8abc-10be45d1365c'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:36:11.559718 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-5b4a4e2f-71fc-4b95-8abc-10be45d1365c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ec087a3edc444cbb249442bb987326c', 'request_id': 'req-5b4a4e2f-71fc-4b95-8abc-10be45d1365c'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:36:11.651009 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-5b4a4e2f-71fc-4b95-8abc-10be45d1365c admin admin] The token cache is being invalidate because project 4ec087a3edc444cbb249442bb987326c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74005) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:36:11.651294 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-5b4a4e2f-71fc-4b95-8abc-10be45d1365c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:36:11.651925 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-5b4a4e2f-71fc-4b95-8abc-10be45d1365c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:36:11.653497 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1263/2524] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:36:11 2021] DELETE /identity/v3/projects/4ec087a3edc444cbb249442bb987326c => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:36:23.306675 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce9f0a1-e7cd-463a-8b6e-5abfbbdcf2a2 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:36:23.307266 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce9f0a1-e7cd-463a-8b6e-5abfbbdcf2a2 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:36:23.307266 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce9f0a1-e7cd-463a-8b6e-5abfbbdcf2a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:36:23.325124 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-2ce9f0a1-e7cd-463a-8b6e-5abfbbdcf2a2 None None] MFA Rules not processed for user `75606513d1c04a9a8f95e0c0f60d9c11`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:36:23.326455 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-2ce9f0a1-e7cd-463a-8b6e-5abfbbdcf2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:36:23.380733 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1262/2525] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:36:23 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:36:40.982996 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ea438-7188-4c75-9888-e6fa9bf6181f None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:36:40.988827 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ea438-7188-4c75-9888-e6fa9bf6181f None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:36:40.988827 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ea438-7188-4c75-9888-e6fa9bf6181f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:36:41.002031 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-5e5ea438-7188-4c75-9888-e6fa9bf6181f None None] MFA Rules not processed for user `75606513d1c04a9a8f95e0c0f60d9c11`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:36:41.003251 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-5e5ea438-7188-4c75-9888-e6fa9bf6181f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:36:41.010243 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1264/2526] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:36:40 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:36:46.766484 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce9f0a1-e7cd-463a-8b6e-5abfbbdcf2a2 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:36:46.768093 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-2ce9f0a1-e7cd-463a-8b6e-5abfbbdcf2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:36:46.854519 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce9f0a1-e7cd-463a-8b6e-5abfbbdcf2a2 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:36:46.860088 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93beb91e-650e-424a-b49d-221f83c7825f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3417097a280b499086b36df9a2548239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:36:46.860772 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93beb91e-650e-424a-b49d-221f83c7825f service nova] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:36:46.861058 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93beb91e-650e-424a-b49d-221f83c7825f service nova] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:36:46.861941 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93beb91e-650e-424a-b49d-221f83c7825f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:36:46.863752 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-93beb91e-650e-424a-b49d-221f83c7825f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:36:46.943585 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93beb91e-650e-424a-b49d-221f83c7825f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:36:46.945212 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93beb91e-650e-424a-b49d-221f83c7825f service nova] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:36:46.963106 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1263/2527] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:36:46 2021] GET /identity/v3/auth/tokens => generated 3409 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:36:50.681524 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5ea438-7188-4c75-9888-e6fa9bf6181f None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:36:50.682932 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-5e5ea438-7188-4c75-9888-e6fa9bf6181f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:36:50.737335 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5ea438-7188-4c75-9888-e6fa9bf6181f None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:36:50.740899 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7a52d6-bc40-4bb4-9348-442ce6b17ea2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:36:50.741538 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a52d6-bc40-4bb4-9348-442ce6b17ea2 service neutron] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:36:50.741820 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a52d6-bc40-4bb4-9348-442ce6b17ea2 service neutron] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:36:50.742123 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a52d6-bc40-4bb4-9348-442ce6b17ea2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:36:50.743871 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-ab7a52d6-bc40-4bb4-9348-442ce6b17ea2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:36:50.805819 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7a52d6-bc40-4bb4-9348-442ce6b17ea2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:36:50.807248 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7a52d6-bc40-4bb4-9348-442ce6b17ea2 service neutron] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:36:50.817451 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1265/2528] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:36:50 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:36:54.797516 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93beb91e-650e-424a-b49d-221f83c7825f service nova] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:36:54.799678 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-93beb91e-650e-424a-b49d-221f83c7825f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:36:54.815352 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93beb91e-650e-424a-b49d-221f83c7825f service nova] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:36:54.820776 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fba9e01-5c0b-40c4-847e-01bd99d7dc54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:36:54.821694 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba9e01-5c0b-40c4-847e-01bd99d7dc54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:36:54.821968 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba9e01-5c0b-40c4-847e-01bd99d7dc54 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:36:54.822237 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba9e01-5c0b-40c4-847e-01bd99d7dc54 admin admin] PATH_INFO: `/v3/users/74acf90c734149808a501de7754b5943` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:36:54.823653 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fba9e01-5c0b-40c4-847e-01bd99d7dc54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74acf90c734149808a501de7754b5943)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:36:54.825641 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fba9e01-5c0b-40c4-847e-01bd99d7dc54 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:36:55.127200 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-4fba9e01-5c0b-40c4-847e-01bd99d7dc54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74acf90c734149808a501de7754b5943'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:36:55.134284 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-4fba9e01-5c0b-40c4-847e-01bd99d7dc54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74acf90c734149808a501de7754b5943'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:36:55.145411 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-4fba9e01-5c0b-40c4-847e-01bd99d7dc54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74acf90c734149808a501de7754b5943'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:36:55.215691 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-4fba9e01-5c0b-40c4-847e-01bd99d7dc54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74acf90c734149808a501de7754b5943'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:36:55.216456 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-4fba9e01-5c0b-40c4-847e-01bd99d7dc54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74acf90c734149808a501de7754b5943'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:36:55.223433 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1264/2529] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:36:54 2021] DELETE /identity/v3/users/74acf90c734149808a501de7754b5943 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:36:55.480861 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7a52d6-bc40-4bb4-9348-442ce6b17ea2 service neutron] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:36:55.494694 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7a52d6-bc40-4bb4-9348-442ce6b17ea2 service neutron] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:36:55.546387 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef20bc51-cc80-40ae-bda0-f53ec3182497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:36:55.547240 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef20bc51-cc80-40ae-bda0-f53ec3182497 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:36:55.547524 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef20bc51-cc80-40ae-bda0-f53ec3182497 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:36:55.547799 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef20bc51-cc80-40ae-bda0-f53ec3182497 admin admin] PATH_INFO: `/v3/projects/94cdd5201533434888e7691148b9a3a8` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:36:55.549518 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef20bc51-cc80-40ae-bda0-f53ec3182497 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94cdd5201533434888e7691148b9a3a8)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:36:55.551433 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef20bc51-cc80-40ae-bda0-f53ec3182497 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:36:55.690619 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-ef20bc51-cc80-40ae-bda0-f53ec3182497 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94cdd5201533434888e7691148b9a3a8', 'request_id': 'req-ef20bc51-cc80-40ae-bda0-f53ec3182497'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:36:55.696571 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-ef20bc51-cc80-40ae-bda0-f53ec3182497 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94cdd5201533434888e7691148b9a3a8', 'request_id': 'req-ef20bc51-cc80-40ae-bda0-f53ec3182497'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:36:55.701768 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-ef20bc51-cc80-40ae-bda0-f53ec3182497 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94cdd5201533434888e7691148b9a3a8', 'request_id': 'req-ef20bc51-cc80-40ae-bda0-f53ec3182497'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:36:55.809644 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-ef20bc51-cc80-40ae-bda0-f53ec3182497 admin admin] The token cache is being invalidate because project 94cdd5201533434888e7691148b9a3a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74005) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:36:55.809923 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-ef20bc51-cc80-40ae-bda0-f53ec3182497 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:36:55.810553 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-ef20bc51-cc80-40ae-bda0-f53ec3182497 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:36:55.812113 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1266/2530] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:36:55 2021] DELETE /identity/v3/projects/94cdd5201533434888e7691148b9a3a8 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:36:55.817972 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed678402-1b8d-43ec-abea-7f778d5fb4d5 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:36:55.818479 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed678402-1b8d-43ec-abea-7f778d5fb4d5 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:36:55.818589 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed678402-1b8d-43ec-abea-7f778d5fb4d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:36:55.835911 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-ed678402-1b8d-43ec-abea-7f778d5fb4d5 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:36:55.837142 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-ed678402-1b8d-43ec-abea-7f778d5fb4d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:36:55.900494 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1265/2531] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:36:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:36:55.909186 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28400d72-1861-4ef0-a180-5493728e3ee3 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:36:55.909474 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28400d72-1861-4ef0-a180-5493728e3ee3 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:36:55.909754 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28400d72-1861-4ef0-a180-5493728e3ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:36:55.928536 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-28400d72-1861-4ef0-a180-5493728e3ee3 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:36:55.929761 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-28400d72-1861-4ef0-a180-5493728e3ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:36:55.937698 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1267/2532] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:36:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:36:55.943091 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed678402-1b8d-43ec-abea-7f778d5fb4d5 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:36:55.952864 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed678402-1b8d-43ec-abea-7f778d5fb4d5 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:36:55.957363 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23782f18-c2e5-4431-8c7a-53e9f111f5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:36:55.958009 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23782f18-c2e5-4431-8c7a-53e9f111f5c5 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:36:55.958290 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23782f18-c2e5-4431-8c7a-53e9f111f5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:36:55.958565 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23782f18-c2e5-4431-8c7a-53e9f111f5c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:36:55.959317 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23782f18-c2e5-4431-8c7a-53e9f111f5c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:36:55.959620 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23782f18-c2e5-4431-8c7a-53e9f111f5c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:36:55.961247 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23782f18-c2e5-4431-8c7a-53e9f111f5c5 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:36:55.973601 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1266/2533] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 12 18:36:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:36:55.978067 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28400d72-1861-4ef0-a180-5493728e3ee3 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:36:55.987993 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28400d72-1861-4ef0-a180-5493728e3ee3 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:36:55.992784 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a2d49f-0b9b-441a-8ca7-65a9a60f64b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:36:55.993442 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2d49f-0b9b-441a-8ca7-65a9a60f64b5 admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:36:55.993725 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2d49f-0b9b-441a-8ca7-65a9a60f64b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:36:55.994002 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2d49f-0b9b-441a-8ca7-65a9a60f64b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:36:55.994716 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a2d49f-0b9b-441a-8ca7-65a9a60f64b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:36:55.996662 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a2d49f-0b9b-441a-8ca7-65a9a60f64b5 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:36:56.096460 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1268/2534] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:36:55 2021] POST /identity/v3/projects => generated 373 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 18:36:56.100695 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23782f18-c2e5-4431-8c7a-53e9f111f5c5 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:36:56.110404 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23782f18-c2e5-4431-8c7a-53e9f111f5c5 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:36:56.168722 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43323641-a591-4efa-873b-b890bd04470a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:36:56.169297 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43323641-a591-4efa-873b-b890bd04470a admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:36:56.169578 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43323641-a591-4efa-873b-b890bd04470a admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:36:56.169844 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43323641-a591-4efa-873b-b890bd04470a admin admin] PATH_INFO: `/v3/users` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:36:56.170551 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43323641-a591-4efa-873b-b890bd04470a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:36:56.172482 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43323641-a591-4efa-873b-b890bd04470a admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:36:56.295076 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1267/2535] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:36:56 2021] POST /identity/v3/users => generated 287 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:36:56.299232 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a2d49f-0b9b-441a-8ca7-65a9a60f64b5 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:36:56.309654 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a2d49f-0b9b-441a-8ca7-65a9a60f64b5 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:36:56.314460 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754718ba-5bfb-4afc-8228-ac842ef04371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:36:56.323523 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754718ba-5bfb-4afc-8228-ac842ef04371 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:36:56.323523 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754718ba-5bfb-4afc-8228-ac842ef04371 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:36:56.323523 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754718ba-5bfb-4afc-8228-ac842ef04371 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:36:56.323523 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754718ba-5bfb-4afc-8228-ac842ef04371 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:36:56.323523 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754718ba-5bfb-4afc-8228-ac842ef04371 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:36:56.330155 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1269/2536] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:36:56 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:36:56.339322 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43323641-a591-4efa-873b-b890bd04470a admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:36:56.351081 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43323641-a591-4efa-873b-b890bd04470a admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:36:56.355898 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887ee204-144a-4c01-9f58-9f83648a9968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:36:56.357860 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ee204-144a-4c01-9f58-9f83648a9968 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:36:56.357860 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ee204-144a-4c01-9f58-9f83648a9968 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:36:56.357860 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ee204-144a-4c01-9f58-9f83648a9968 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:36:56.358185 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887ee204-144a-4c01-9f58-9f83648a9968 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:36:56.359536 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887ee204-144a-4c01-9f58-9f83648a9968 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:36:56.369532 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1268/2537] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:36:56 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:36:56.373989 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754718ba-5bfb-4afc-8228-ac842ef04371 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:36:56.384270 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754718ba-5bfb-4afc-8228-ac842ef04371 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:36:56.389251 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62589f32-56b6-41f5-b580-c85b57188208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:36:56.390188 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62589f32-56b6-41f5-b580-c85b57188208 admin admin] REQUEST_METHOD: `PUT` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:36:56.390467 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62589f32-56b6-41f5-b580-c85b57188208 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:36:56.390745 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62589f32-56b6-41f5-b580-c85b57188208 admin admin] PATH_INFO: `/v3/projects/2a5b8dca8f3f4839a3666f9f7c296315/users/5a6a2e3f8400409a8dfb1dd36e0395c7/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:36:56.407344 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62589f32-56b6-41f5-b580-c85b57188208 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a5b8dca8f3f4839a3666f9f7c296315, user_id=5a6a2e3f8400409a8dfb1dd36e0395c7, role_id=33b8a5a8d1d643f2a98f598e6ab0a1cf)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:36:56.411413 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62589f32-56b6-41f5-b580-c85b57188208 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:36:56.519952 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1270/2538] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:36:56 2021] PUT /identity/v3/projects/2a5b8dca8f3f4839a3666f9f7c296315/users/5a6a2e3f8400409a8dfb1dd36e0395c7/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:36:56.531359 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0130d-b71a-40b5-b22b-2bb3a5417b3a None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:36:56.531771 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0130d-b71a-40b5-b22b-2bb3a5417b3a None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:36:56.532161 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0130d-b71a-40b5-b22b-2bb3a5417b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:36:56.561722 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-59e0130d-b71a-40b5-b22b-2bb3a5417b3a None None] MFA Rules not processed for user `5a6a2e3f8400409a8dfb1dd36e0395c7`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:36:56.562919 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-59e0130d-b71a-40b5-b22b-2bb3a5417b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:36:56.631277 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1269/2539] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:36:56 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:36:56.788457 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62589f32-56b6-41f5-b580-c85b57188208 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:36:56.788457 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-62589f32-56b6-41f5-b580-c85b57188208 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:36:56.788457 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62589f32-56b6-41f5-b580-c85b57188208 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:36:56.788859 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6513d27f-f9a7-4210-825d-44f52779b14e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3417097a280b499086b36df9a2548239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:36:56.788859 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6513d27f-f9a7-4210-825d-44f52779b14e service nova] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:36:56.788859 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6513d27f-f9a7-4210-825d-44f52779b14e service nova] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:36:56.788859 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6513d27f-f9a7-4210-825d-44f52779b14e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:36:56.789223 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6513d27f-f9a7-4210-825d-44f52779b14e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:36:56.789223 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6513d27f-f9a7-4210-825d-44f52779b14e service nova] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:36:56.789223 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1271/2540] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:36:56 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:36:59.978821 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e0130d-b71a-40b5-b22b-2bb3a5417b3a None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:37:00.042194 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e0130d-b71a-40b5-b22b-2bb3a5417b3a None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:37:00.046729 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a272ba-f2bf-4e6e-8a80-b60bf865a31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:37:00.047594 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a272ba-f2bf-4e6e-8a80-b60bf865a31d admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:37:00.047903 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a272ba-f2bf-4e6e-8a80-b60bf865a31d admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:37:00.048179 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a272ba-f2bf-4e6e-8a80-b60bf865a31d admin admin] PATH_INFO: `/v3/users/5a6a2e3f8400409a8dfb1dd36e0395c7` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:37:00.049439 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a272ba-f2bf-4e6e-8a80-b60bf865a31d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a6a2e3f8400409a8dfb1dd36e0395c7)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:37:00.051359 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a272ba-f2bf-4e6e-8a80-b60bf865a31d admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:37:00.297604 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-28a272ba-f2bf-4e6e-8a80-b60bf865a31d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a6a2e3f8400409a8dfb1dd36e0395c7'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:37:00.304419 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-28a272ba-f2bf-4e6e-8a80-b60bf865a31d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a6a2e3f8400409a8dfb1dd36e0395c7'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:37:00.316761 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-28a272ba-f2bf-4e6e-8a80-b60bf865a31d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a6a2e3f8400409a8dfb1dd36e0395c7'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:37:00.398737 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-28a272ba-f2bf-4e6e-8a80-b60bf865a31d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a6a2e3f8400409a8dfb1dd36e0395c7'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:37:00.399479 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-28a272ba-f2bf-4e6e-8a80-b60bf865a31d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a6a2e3f8400409a8dfb1dd36e0395c7'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:37:00.406098 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1270/2541] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:36:59 2021] DELETE /identity/v3/users/5a6a2e3f8400409a8dfb1dd36e0395c7 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:37:00.412212 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0f285-26ec-469a-b422-8fe71c4d11c1 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:37:00.412773 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0f285-26ec-469a-b422-8fe71c4d11c1 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:37:00.413228 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0f285-26ec-469a-b422-8fe71c4d11c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:37:00.442345 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-e7b0f285-26ec-469a-b422-8fe71c4d11c1 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:37:00.444432 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-e7b0f285-26ec-469a-b422-8fe71c4d11c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:37:00.539999 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1272/2542] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:37:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:37:00.549565 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a272ba-f2bf-4e6e-8a80-b60bf865a31d admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:37:00.550949 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-28a272ba-f2bf-4e6e-8a80-b60bf865a31d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:37:00.604789 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a272ba-f2bf-4e6e-8a80-b60bf865a31d admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:37:00.608344 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06caed4-1674-4017-b054-09e21ce38653 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:37:00.609004 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06caed4-1674-4017-b054-09e21ce38653 service neutron] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:37:00.609279 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06caed4-1674-4017-b054-09e21ce38653 service neutron] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:37:00.609548 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06caed4-1674-4017-b054-09e21ce38653 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:37:00.619047 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06caed4-1674-4017-b054-09e21ce38653 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:37:00.620566 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06caed4-1674-4017-b054-09e21ce38653 service neutron] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:37:00.630788 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1271/2543] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:37:00 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:37:01.123921 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b0f285-26ec-469a-b422-8fe71c4d11c1 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:37:01.125435 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-e7b0f285-26ec-469a-b422-8fe71c4d11c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:37:01.138352 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b0f285-26ec-469a-b422-8fe71c4d11c1 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:37:01.142913 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ba3b78-0f8f-445d-ba3f-d95268657beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:37:01.143768 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba3b78-0f8f-445d-ba3f-d95268657beb admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:37:01.144575 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba3b78-0f8f-445d-ba3f-d95268657beb admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:37:01.144865 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba3b78-0f8f-445d-ba3f-d95268657beb admin admin] PATH_INFO: `/v3/projects/2a5b8dca8f3f4839a3666f9f7c296315` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:37:01.146264 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ba3b78-0f8f-445d-ba3f-d95268657beb admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a5b8dca8f3f4839a3666f9f7c296315)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:37:01.148223 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ba3b78-0f8f-445d-ba3f-d95268657beb admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:37:01.277905 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-a8ba3b78-0f8f-445d-ba3f-d95268657beb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a5b8dca8f3f4839a3666f9f7c296315', 'request_id': 'req-a8ba3b78-0f8f-445d-ba3f-d95268657beb'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:37:01.284743 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-a8ba3b78-0f8f-445d-ba3f-d95268657beb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a5b8dca8f3f4839a3666f9f7c296315', 'request_id': 'req-a8ba3b78-0f8f-445d-ba3f-d95268657beb'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:37:01.290016 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-a8ba3b78-0f8f-445d-ba3f-d95268657beb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a5b8dca8f3f4839a3666f9f7c296315', 'request_id': 'req-a8ba3b78-0f8f-445d-ba3f-d95268657beb'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:37:01.362609 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-a8ba3b78-0f8f-445d-ba3f-d95268657beb admin admin] The token cache is being invalidate because project 2a5b8dca8f3f4839a3666f9f7c296315 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74005) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:37:01.362899 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-a8ba3b78-0f8f-445d-ba3f-d95268657beb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:37:01.364198 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-a8ba3b78-0f8f-445d-ba3f-d95268657beb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:37:01.365790 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1273/2544] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:37:01 2021] DELETE /identity/v3/projects/2a5b8dca8f3f4839a3666f9f7c296315 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:37:01.371465 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2220e499-2fd1-4ec7-aa03-aca9ce6edd1c None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:37:01.371941 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2220e499-2fd1-4ec7-aa03-aca9ce6edd1c None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:37:01.371941 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2220e499-2fd1-4ec7-aa03-aca9ce6edd1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:37:01.389450 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-2220e499-2fd1-4ec7-aa03-aca9ce6edd1c None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:37:01.390659 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-2220e499-2fd1-4ec7-aa03-aca9ce6edd1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:37:01.448860 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1272/2545] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:37:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:37:01.456829 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82daaf98-70c8-464e-8535-dea283918a5f None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:37:01.457336 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82daaf98-70c8-464e-8535-dea283918a5f None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:37:01.457440 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82daaf98-70c8-464e-8535-dea283918a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:37:01.475409 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-82daaf98-70c8-464e-8535-dea283918a5f None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:37:01.476662 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-82daaf98-70c8-464e-8535-dea283918a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:37:01.484927 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1274/2546] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:37:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:37:01.489715 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2220e499-2fd1-4ec7-aa03-aca9ce6edd1c None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:37:01.499493 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2220e499-2fd1-4ec7-aa03-aca9ce6edd1c None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:37:01.504692 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ded4d9-a0d1-4cc1-93fb-bb53a670f6f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:37:01.505340 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ded4d9-a0d1-4cc1-93fb-bb53a670f6f2 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:37:01.505622 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ded4d9-a0d1-4cc1-93fb-bb53a670f6f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:37:01.505893 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ded4d9-a0d1-4cc1-93fb-bb53a670f6f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:37:01.506614 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ded4d9-a0d1-4cc1-93fb-bb53a670f6f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:37:01.506915 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ded4d9-a0d1-4cc1-93fb-bb53a670f6f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:37:01.508507 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ded4d9-a0d1-4cc1-93fb-bb53a670f6f2 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:37:01.519923 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1273/2547] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 12 18:37:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:37:01.524243 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82daaf98-70c8-464e-8535-dea283918a5f None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:37:01.533666 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82daaf98-70c8-464e-8535-dea283918a5f None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:37:01.538293 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31a4425-89b3-488f-aa39-48202ff09308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:37:01.538931 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a4425-89b3-488f-aa39-48202ff09308 admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:37:01.539209 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a4425-89b3-488f-aa39-48202ff09308 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:37:01.539478 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a4425-89b3-488f-aa39-48202ff09308 admin admin] PATH_INFO: `/v3/projects` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:37:01.540167 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31a4425-89b3-488f-aa39-48202ff09308 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:37:01.542106 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31a4425-89b3-488f-aa39-48202ff09308 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:37:01.629502 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1275/2548] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:37:01 2021] POST /identity/v3/projects => generated 371 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:37:01.629717 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ded4d9-a0d1-4cc1-93fb-bb53a670f6f2 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:37:01.638444 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ded4d9-a0d1-4cc1-93fb-bb53a670f6f2 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:37:01.693668 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5496d9-8fb6-46d9-8c0e-920f399e733c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:37:01.694338 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5496d9-8fb6-46d9-8c0e-920f399e733c admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:37:01.694621 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5496d9-8fb6-46d9-8c0e-920f399e733c admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:37:01.694899 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5496d9-8fb6-46d9-8c0e-920f399e733c admin admin] PATH_INFO: `/v3/users` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:37:01.695608 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5496d9-8fb6-46d9-8c0e-920f399e733c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:37:01.697553 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5496d9-8fb6-46d9-8c0e-920f399e733c admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:37:01.775709 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1274/2549] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:37:01 2021] POST /identity/v3/users => generated 286 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:37:01.779943 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31a4425-89b3-488f-aa39-48202ff09308 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:37:01.790915 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31a4425-89b3-488f-aa39-48202ff09308 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:37:01.795575 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f25434-0a1f-407f-8e4e-cad3111878aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:37:01.796237 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f25434-0a1f-407f-8e4e-cad3111878aa admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:37:01.796556 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f25434-0a1f-407f-8e4e-cad3111878aa admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:37:01.796840 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f25434-0a1f-407f-8e4e-cad3111878aa admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:37:01.797584 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f25434-0a1f-407f-8e4e-cad3111878aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:37:01.799830 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f25434-0a1f-407f-8e4e-cad3111878aa admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:37:01.810677 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1276/2550] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:37:01 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:37:01.814758 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5496d9-8fb6-46d9-8c0e-920f399e733c admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:37:01.824566 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5496d9-8fb6-46d9-8c0e-920f399e733c admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:37:01.829114 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37459a71-ba8c-4a10-8a28-54b74d8fd6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:37:01.829771 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37459a71-ba8c-4a10-8a28-54b74d8fd6e1 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:37:01.830076 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37459a71-ba8c-4a10-8a28-54b74d8fd6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:37:01.830348 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37459a71-ba8c-4a10-8a28-54b74d8fd6e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:37:01.831077 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37459a71-ba8c-4a10-8a28-54b74d8fd6e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:37:01.832685 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37459a71-ba8c-4a10-8a28-54b74d8fd6e1 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:37:01.842228 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1275/2551] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:37:01 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:37:01.846888 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f25434-0a1f-407f-8e4e-cad3111878aa admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:37:01.857000 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f25434-0a1f-407f-8e4e-cad3111878aa admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:37:01.862516 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7857257c-96cd-4502-a524-2ebc6bacbf84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:37:01.863504 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857257c-96cd-4502-a524-2ebc6bacbf84 admin admin] REQUEST_METHOD: `PUT` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:37:01.864032 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857257c-96cd-4502-a524-2ebc6bacbf84 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:37:01.864309 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857257c-96cd-4502-a524-2ebc6bacbf84 admin admin] PATH_INFO: `/v3/projects/dd886458bdd6462a881bd564d172641d/users/e3b638480400423498b6ca1a539ee6d4/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:37:01.879273 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7857257c-96cd-4502-a524-2ebc6bacbf84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd886458bdd6462a881bd564d172641d, user_id=e3b638480400423498b6ca1a539ee6d4, role_id=33b8a5a8d1d643f2a98f598e6ab0a1cf)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:37:01.882027 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7857257c-96cd-4502-a524-2ebc6bacbf84 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:37:01.993316 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1277/2552] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:37:01 2021] PUT /identity/v3/projects/dd886458bdd6462a881bd564d172641d/users/e3b638480400423498b6ca1a539ee6d4/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:37:02.005053 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d11b19-6caf-4b00-843b-a33250951f4d None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:37:02.005341 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d11b19-6caf-4b00-843b-a33250951f4d None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:37:02.007426 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d11b19-6caf-4b00-843b-a33250951f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:37:02.031361 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-f3d11b19-6caf-4b00-843b-a33250951f4d None None] MFA Rules not processed for user `e3b638480400423498b6ca1a539ee6d4`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:37:02.032575 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-f3d11b19-6caf-4b00-843b-a33250951f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:37:02.094668 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1276/2553] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:37:02 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:37:02.099651 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7857257c-96cd-4502-a524-2ebc6bacbf84 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:37:02.164248 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7857257c-96cd-4502-a524-2ebc6bacbf84 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:37:02.168882 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522bfdf1-df92-4173-8686-54f8fc433db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:37:02.169601 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522bfdf1-df92-4173-8686-54f8fc433db9 admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:37:02.169877 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522bfdf1-df92-4173-8686-54f8fc433db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:37:02.170147 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522bfdf1-df92-4173-8686-54f8fc433db9 admin admin] PATH_INFO: `/v3/projects` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:37:02.170847 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522bfdf1-df92-4173-8686-54f8fc433db9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:37:02.172871 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522bfdf1-df92-4173-8686-54f8fc433db9 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:37:02.274755 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1278/2554] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:37:02 2021] POST /identity/v3/projects => generated 373 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:37:02.278872 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d11b19-6caf-4b00-843b-a33250951f4d None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:37:02.290832 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d11b19-6caf-4b00-843b-a33250951f4d None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:37:02.346338 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d208f7a-3b4d-4d10-89c5-f77f529687a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:37:02.347019 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d208f7a-3b4d-4d10-89c5-f77f529687a1 admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:37:02.347297 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d208f7a-3b4d-4d10-89c5-f77f529687a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:37:02.347568 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d208f7a-3b4d-4d10-89c5-f77f529687a1 admin admin] PATH_INFO: `/v3/users` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:37:02.348256 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d208f7a-3b4d-4d10-89c5-f77f529687a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:37:02.350289 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d208f7a-3b4d-4d10-89c5-f77f529687a1 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:37:02.445544 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1277/2555] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:37:02 2021] POST /identity/v3/users => generated 293 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:37:02.449382 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522bfdf1-df92-4173-8686-54f8fc433db9 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:37:02.459987 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522bfdf1-df92-4173-8686-54f8fc433db9 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:37:02.464669 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f1997e-7cf3-4e05-a325-d01d21a1ba17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:37:02.465326 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1997e-7cf3-4e05-a325-d01d21a1ba17 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:37:02.465603 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1997e-7cf3-4e05-a325-d01d21a1ba17 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:37:02.465873 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1997e-7cf3-4e05-a325-d01d21a1ba17 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:37:02.466603 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f1997e-7cf3-4e05-a325-d01d21a1ba17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:37:02.468187 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f1997e-7cf3-4e05-a325-d01d21a1ba17 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:37:02.478889 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1279/2556] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:37:02 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:37:02.483205 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d208f7a-3b4d-4d10-89c5-f77f529687a1 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:37:02.494056 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d208f7a-3b4d-4d10-89c5-f77f529687a1 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:37:02.499000 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a72047-6957-4ab7-83c1-cb5259dbb879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:37:02.499893 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a72047-6957-4ab7-83c1-cb5259dbb879 admin admin] REQUEST_METHOD: `PUT` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:37:02.500165 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a72047-6957-4ab7-83c1-cb5259dbb879 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:37:02.500468 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a72047-6957-4ab7-83c1-cb5259dbb879 admin admin] PATH_INFO: `/v3/projects/950e1a3980d14da5a708ab65fbae25b2/users/3b9578922a234e42ab59f0265c012b32/roles/6c54f239944d46e3b027ccce97eb8b49` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:37:02.515881 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a72047-6957-4ab7-83c1-cb5259dbb879 admin admin] RBAC: Authorizing `identity:create_grant(project_id=950e1a3980d14da5a708ab65fbae25b2, user_id=3b9578922a234e42ab59f0265c012b32, role_id=6c54f239944d46e3b027ccce97eb8b49)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:37:02.518612 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a72047-6957-4ab7-83c1-cb5259dbb879 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:37:02.600026 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1278/2557] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:37:02 2021] PUT /identity/v3/projects/950e1a3980d14da5a708ab65fbae25b2/users/3b9578922a234e42ab59f0265c012b32/roles/6c54f239944d46e3b027ccce97eb8b49 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 18:37:02.604040 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f1997e-7cf3-4e05-a325-d01d21a1ba17 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:37:02.625464 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f1997e-7cf3-4e05-a325-d01d21a1ba17 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:37:02.681899 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b22c7-70ad-4533-95a4-fc1b0e743f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:37:02.682562 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b22c7-70ad-4533-95a4-fc1b0e743f6f admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:37:02.682841 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b22c7-70ad-4533-95a4-fc1b0e743f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:37:02.683115 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b22c7-70ad-4533-95a4-fc1b0e743f6f admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:37:02.683842 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14b22c7-70ad-4533-95a4-fc1b0e743f6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:37:02.685465 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14b22c7-70ad-4533-95a4-fc1b0e743f6f admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:37:02.697547 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1280/2558] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:37:02 2021] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:37:02.701847 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a72047-6957-4ab7-83c1-cb5259dbb879 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:37:02.712237 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a72047-6957-4ab7-83c1-cb5259dbb879 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:37:02.717059 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543552c6-cdd4-4c77-b707-9781eb72c0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:37:02.717942 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543552c6-cdd4-4c77-b707-9781eb72c0f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:37:02.718215 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543552c6-cdd4-4c77-b707-9781eb72c0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:37:02.718483 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543552c6-cdd4-4c77-b707-9781eb72c0f0 admin admin] PATH_INFO: `/v3/projects/950e1a3980d14da5a708ab65fbae25b2/users/3b9578922a234e42ab59f0265c012b32/roles/6c54f239944d46e3b027ccce97eb8b49` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:37:02.720544 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543552c6-cdd4-4c77-b707-9781eb72c0f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=950e1a3980d14da5a708ab65fbae25b2, user_id=3b9578922a234e42ab59f0265c012b32, role_id=6c54f239944d46e3b027ccce97eb8b49)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:37:02.724053 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543552c6-cdd4-4c77-b707-9781eb72c0f0 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:37:02.734801 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1279/2559] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:37:02 2021] PUT /identity/v3/projects/950e1a3980d14da5a708ab65fbae25b2/users/3b9578922a234e42ab59f0265c012b32/roles/6c54f239944d46e3b027ccce97eb8b49 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:37:02.745551 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e06edc-8420-4412-b7a4-c4a3ac75a199 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:37:02.745841 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e06edc-8420-4412-b7a4-c4a3ac75a199 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:37:02.746121 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e06edc-8420-4412-b7a4-c4a3ac75a199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:37:02.773425 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-b8e06edc-8420-4412-b7a4-c4a3ac75a199 None None] MFA Rules not processed for user `3b9578922a234e42ab59f0265c012b32`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:37:02.774655 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-b8e06edc-8420-4412-b7a4-c4a3ac75a199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:37:02.844586 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1281/2560] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:37:02 2021] POST /identity/v3/auth/tokens => generated 3460 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:37:02.857126 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543552c6-cdd4-4c77-b707-9781eb72c0f0 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:37:02.861137 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-543552c6-cdd4-4c77-b707-9781eb72c0f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:37:02.921584 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543552c6-cdd4-4c77-b707-9781eb72c0f0 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:37:02.925710 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4511a52a-8ff6-4f3e-b323-f6dbf81b50b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6966ce0774f4437a9b688494e9d0574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:37:02.926358 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511a52a-8ff6-4f3e-b323-f6dbf81b50b6 service cinder] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:37:02.926639 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511a52a-8ff6-4f3e-b323-f6dbf81b50b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:37:02.926915 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511a52a-8ff6-4f3e-b323-f6dbf81b50b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:37:02.936345 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4511a52a-8ff6-4f3e-b323-f6dbf81b50b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:37:02.937855 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4511a52a-8ff6-4f3e-b323-f6dbf81b50b6 service cinder] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:37:02.947713 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1280/2561] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:37:02 2021] GET /identity/v3/auth/tokens => generated 3460 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:37:03.187637 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e06edc-8420-4412-b7a4-c4a3ac75a199 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:37:03.199162 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e06edc-8420-4412-b7a4-c4a3ac75a199 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:37:03.202791 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e40615f-0823-4310-9bed-fc205d2ccfb6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6966ce0774f4437a9b688494e9d0574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:37:03.203428 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e40615f-0823-4310-9bed-fc205d2ccfb6 service cinder] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:37:03.203704 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e40615f-0823-4310-9bed-fc205d2ccfb6 service cinder] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:37:03.203975 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e40615f-0823-4310-9bed-fc205d2ccfb6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:37:03.259886 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e40615f-0823-4310-9bed-fc205d2ccfb6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:37:03.261378 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e40615f-0823-4310-9bed-fc205d2ccfb6 service cinder] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:37:03.270969 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1282/2562] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:37:03 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:37:08.336755 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ff696-1a31-4699-9317-bfa517e26e84 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:37:08.337358 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ff696-1a31-4699-9317-bfa517e26e84 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:37:08.337358 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ff696-1a31-4699-9317-bfa517e26e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:37:08.355368 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-418ff696-1a31-4699-9317-bfa517e26e84 None None] MFA Rules not processed for user `75606513d1c04a9a8f95e0c0f60d9c11`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:37:08.356614 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-418ff696-1a31-4699-9317-bfa517e26e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:37:08.410308 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1281/2563] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:37:08 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:37:08.919178 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e40615f-0823-4310-9bed-fc205d2ccfb6 service cinder] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:37:08.921348 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-4e40615f-0823-4310-9bed-fc205d2ccfb6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:37:08.993324 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e40615f-0823-4310-9bed-fc205d2ccfb6 service cinder] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:37:08.996905 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b397fc2f-04ea-42e7-bffa-dfce340dd528 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:37:08.997555 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b397fc2f-04ea-42e7-bffa-dfce340dd528 service neutron] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:37:08.997836 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b397fc2f-04ea-42e7-bffa-dfce340dd528 service neutron] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:37:08.998112 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b397fc2f-04ea-42e7-bffa-dfce340dd528 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:37:08.999947 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-b397fc2f-04ea-42e7-bffa-dfce340dd528 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:37:09.010772 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b397fc2f-04ea-42e7-bffa-dfce340dd528 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:37:09.012221 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b397fc2f-04ea-42e7-bffa-dfce340dd528 service neutron] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:37:09.020812 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1283/2564] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:37:08 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:37:09.428170 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc595206-734d-4250-9023-0e6ed2fd7f7b None None] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:37:09.428645 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc595206-734d-4250-9023-0e6ed2fd7f7b None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:37:09.428746 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc595206-734d-4250-9023-0e6ed2fd7f7b None None] PATH_INFO: `/` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:37:09.430488 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1282/2565] 10.222.0.18 () {54 vars in 960 bytes} [Tue Oct 12 18:37:09 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 18:37:09.435942 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e3ac4-9afa-49cd-bdbd-da41d5b0b988 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:37:09.436533 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e3ac4-9afa-49cd-bdbd-da41d5b0b988 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:37:09.437170 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e3ac4-9afa-49cd-bdbd-da41d5b0b988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:37:09.477983 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-547e3ac4-9afa-49cd-bdbd-da41d5b0b988 None None] MFA Rules not processed for user `4bd99e4f2d444a388ecde7ea3cb61089`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:37:09.479207 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-547e3ac4-9afa-49cd-bdbd-da41d5b0b988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:37:09.538406 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1284/2566] 10.222.0.18 () {58 vars in 1057 bytes} [Tue Oct 12 18:37:09 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:37:09.546632 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc595206-734d-4250-9023-0e6ed2fd7f7b None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:37:09.560095 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc595206-734d-4250-9023-0e6ed2fd7f7b None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:37:09.564943 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cca40d-be38-4e13-a3dd-fb661088a770 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bd99e4f2d444a388ecde7ea3cb61089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:37:09.565559 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cca40d-be38-4e13-a3dd-fb661088a770 service placement] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:37:09.565831 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cca40d-be38-4e13-a3dd-fb661088a770 service placement] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:37:09.566096 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cca40d-be38-4e13-a3dd-fb661088a770 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:37:09.567810 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-21cca40d-be38-4e13-a3dd-fb661088a770 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:37:09.582576 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cca40d-be38-4e13-a3dd-fb661088a770 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:37:09.584236 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cca40d-be38-4e13-a3dd-fb661088a770 service placement] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:37:09.594117 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1283/2567] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:37:09 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:37:15.468705 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547e3ac4-9afa-49cd-bdbd-da41d5b0b988 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:37:15.470265 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-547e3ac4-9afa-49cd-bdbd-da41d5b0b988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:37:15.541216 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547e3ac4-9afa-49cd-bdbd-da41d5b0b988 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:37:15.546665 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a649e61-63e5-4dad-be5c-2c46ef00b99d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3417097a280b499086b36df9a2548239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:37:15.547249 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a649e61-63e5-4dad-be5c-2c46ef00b99d service nova] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:37:15.547528 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a649e61-63e5-4dad-be5c-2c46ef00b99d service nova] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:37:15.547802 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a649e61-63e5-4dad-be5c-2c46ef00b99d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:37:15.549601 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-5a649e61-63e5-4dad-be5c-2c46ef00b99d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:37:15.561885 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a649e61-63e5-4dad-be5c-2c46ef00b99d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:37:15.563476 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a649e61-63e5-4dad-be5c-2c46ef00b99d service nova] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:37:15.574732 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1285/2568] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:37:15 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:37:21.296228 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cca40d-be38-4e13-a3dd-fb661088a770 service placement] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:37:21.309243 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cca40d-be38-4e13-a3dd-fb661088a770 service placement] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:37:21.315248 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4374ad-9af0-4c1f-b859-ff90be1a9b6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3417097a280b499086b36df9a2548239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:37:21.315878 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4374ad-9af0-4c1f-b859-ff90be1a9b6d service nova] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:37:21.316152 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4374ad-9af0-4c1f-b859-ff90be1a9b6d service nova] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:37:21.316444 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4374ad-9af0-4c1f-b859-ff90be1a9b6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:37:21.318221 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-ca4374ad-9af0-4c1f-b859-ff90be1a9b6d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:37:21.331743 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4374ad-9af0-4c1f-b859-ff90be1a9b6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:37:21.333335 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4374ad-9af0-4c1f-b859-ff90be1a9b6d service nova] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:37:21.343585 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1284/2569] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:37:21 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:38:05.729822 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a649e61-63e5-4dad-be5c-2c46ef00b99d service nova] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:05.829960 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a649e61-63e5-4dad-be5c-2c46ef00b99d service nova] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:05.834661 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dc3269-fa98-4157-8088-b0da6953b439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:05.835520 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc3269-fa98-4157-8088-b0da6953b439 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:05.835799 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc3269-fa98-4157-8088-b0da6953b439 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:05.836072 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc3269-fa98-4157-8088-b0da6953b439 admin admin] PATH_INFO: `/v3/users/e3b638480400423498b6ca1a539ee6d4` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:05.837335 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dc3269-fa98-4157-8088-b0da6953b439 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3b638480400423498b6ca1a539ee6d4)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:05.839299 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dc3269-fa98-4157-8088-b0da6953b439 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:06.047833 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-83dc3269-fa98-4157-8088-b0da6953b439 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3b638480400423498b6ca1a539ee6d4'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:06.048519 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-83dc3269-fa98-4157-8088-b0da6953b439 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3b638480400423498b6ca1a539ee6d4'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:06.060364 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-83dc3269-fa98-4157-8088-b0da6953b439 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3b638480400423498b6ca1a539ee6d4'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:06.061039 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-83dc3269-fa98-4157-8088-b0da6953b439 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3b638480400423498b6ca1a539ee6d4'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:06.067519 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-83dc3269-fa98-4157-8088-b0da6953b439 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3b638480400423498b6ca1a539ee6d4'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:06.149609 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1286/2570] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:38:05 2021] DELETE /identity/v3/users/e3b638480400423498b6ca1a539ee6d4 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:38:06.154121 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11368752-5a68-45e5-8dba-47abefd84cfc None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:06.154629 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11368752-5a68-45e5-8dba-47abefd84cfc None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:06.154753 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11368752-5a68-45e5-8dba-47abefd84cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:06.201516 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-11368752-5a68-45e5-8dba-47abefd84cfc None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:38:06.202737 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-11368752-5a68-45e5-8dba-47abefd84cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:06.258051 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1285/2571] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:38:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:38:06.268726 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dc3269-fa98-4157-8088-b0da6953b439 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:06.270113 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-83dc3269-fa98-4157-8088-b0da6953b439 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:06.361195 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dc3269-fa98-4157-8088-b0da6953b439 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:06.364876 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb45c58-9976-4c1c-bbb6-99c895f7e360 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:06.365525 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb45c58-9976-4c1c-bbb6-99c895f7e360 service neutron] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:06.365808 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb45c58-9976-4c1c-bbb6-99c895f7e360 service neutron] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:06.366082 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb45c58-9976-4c1c-bbb6-99c895f7e360 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:06.375864 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb45c58-9976-4c1c-bbb6-99c895f7e360 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:06.377658 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb45c58-9976-4c1c-bbb6-99c895f7e360 service neutron] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:06.389034 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1287/2572] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:38:06 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:38:06.821646 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11368752-5a68-45e5-8dba-47abefd84cfc None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:06.823162 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-11368752-5a68-45e5-8dba-47abefd84cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:06.834623 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11368752-5a68-45e5-8dba-47abefd84cfc None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:06.840020 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fd0abc-e9f5-4c2b-8521-d8a8cb116261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:06.841132 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd0abc-e9f5-4c2b-8521-d8a8cb116261 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:06.841418 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd0abc-e9f5-4c2b-8521-d8a8cb116261 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:06.846698 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd0abc-e9f5-4c2b-8521-d8a8cb116261 admin admin] PATH_INFO: `/v3/projects/dd886458bdd6462a881bd564d172641d` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:06.846698 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fd0abc-e9f5-4c2b-8521-d8a8cb116261 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd886458bdd6462a881bd564d172641d)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:06.846698 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fd0abc-e9f5-4c2b-8521-d8a8cb116261 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:06.949999 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-89fd0abc-e9f5-4c2b-8521-d8a8cb116261 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd886458bdd6462a881bd564d172641d', 'request_id': 'req-89fd0abc-e9f5-4c2b-8521-d8a8cb116261'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:07.019544 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-89fd0abc-e9f5-4c2b-8521-d8a8cb116261 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd886458bdd6462a881bd564d172641d', 'request_id': 'req-89fd0abc-e9f5-4c2b-8521-d8a8cb116261'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:07.025996 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-89fd0abc-e9f5-4c2b-8521-d8a8cb116261 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd886458bdd6462a881bd564d172641d', 'request_id': 'req-89fd0abc-e9f5-4c2b-8521-d8a8cb116261'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:07.037364 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-89fd0abc-e9f5-4c2b-8521-d8a8cb116261 admin admin] The token cache is being invalidate because project dd886458bdd6462a881bd564d172641d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:38:07.037648 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-89fd0abc-e9f5-4c2b-8521-d8a8cb116261 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:07.038264 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-89fd0abc-e9f5-4c2b-8521-d8a8cb116261 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:07.039968 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1286/2573] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:38:06 2021] DELETE /identity/v3/projects/dd886458bdd6462a881bd564d172641d => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:38:07.046693 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb45c58-9976-4c1c-bbb6-99c895f7e360 service neutron] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:07.056659 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb45c58-9976-4c1c-bbb6-99c895f7e360 service neutron] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:07.125900 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d626cb-47ff-4027-a7d6-bae94cf0e353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:07.126718 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d626cb-47ff-4027-a7d6-bae94cf0e353 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:07.127001 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d626cb-47ff-4027-a7d6-bae94cf0e353 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:07.127276 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d626cb-47ff-4027-a7d6-bae94cf0e353 admin admin] PATH_INFO: `/v3/users/3b9578922a234e42ab59f0265c012b32` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:07.128489 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d626cb-47ff-4027-a7d6-bae94cf0e353 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b9578922a234e42ab59f0265c012b32)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:07.130409 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d626cb-47ff-4027-a7d6-bae94cf0e353 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:07.318453 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-c3d626cb-47ff-4027-a7d6-bae94cf0e353 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b9578922a234e42ab59f0265c012b32'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:07.319107 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-c3d626cb-47ff-4027-a7d6-bae94cf0e353 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b9578922a234e42ab59f0265c012b32'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:07.330965 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-c3d626cb-47ff-4027-a7d6-bae94cf0e353 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b9578922a234e42ab59f0265c012b32'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:07.331616 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-c3d626cb-47ff-4027-a7d6-bae94cf0e353 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b9578922a234e42ab59f0265c012b32'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:07.338070 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-c3d626cb-47ff-4027-a7d6-bae94cf0e353 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b9578922a234e42ab59f0265c012b32'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:07.409287 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1288/2574] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:38:07 2021] DELETE /identity/v3/users/3b9578922a234e42ab59f0265c012b32 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:38:07.785823 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fd0abc-e9f5-4c2b-8521-d8a8cb116261 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:07.787350 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-89fd0abc-e9f5-4c2b-8521-d8a8cb116261 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:07.802290 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fd0abc-e9f5-4c2b-8521-d8a8cb116261 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:07.859306 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7478e96-5da7-4637-b2d2-67a6f872aa06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:07.860162 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7478e96-5da7-4637-b2d2-67a6f872aa06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:07.860464 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7478e96-5da7-4637-b2d2-67a6f872aa06 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:07.860745 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7478e96-5da7-4637-b2d2-67a6f872aa06 admin admin] PATH_INFO: `/v3/projects/950e1a3980d14da5a708ab65fbae25b2` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:07.861924 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7478e96-5da7-4637-b2d2-67a6f872aa06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=950e1a3980d14da5a708ab65fbae25b2)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:07.863822 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7478e96-5da7-4637-b2d2-67a6f872aa06 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:07.992965 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-d7478e96-5da7-4637-b2d2-67a6f872aa06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '950e1a3980d14da5a708ab65fbae25b2', 'request_id': 'req-d7478e96-5da7-4637-b2d2-67a6f872aa06'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:08.088347 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-d7478e96-5da7-4637-b2d2-67a6f872aa06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '950e1a3980d14da5a708ab65fbae25b2', 'request_id': 'req-d7478e96-5da7-4637-b2d2-67a6f872aa06'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:08.094999 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-d7478e96-5da7-4637-b2d2-67a6f872aa06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '950e1a3980d14da5a708ab65fbae25b2', 'request_id': 'req-d7478e96-5da7-4637-b2d2-67a6f872aa06'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:08.105104 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-d7478e96-5da7-4637-b2d2-67a6f872aa06 admin admin] The token cache is being invalidate because project 950e1a3980d14da5a708ab65fbae25b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:38:08.105394 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-d7478e96-5da7-4637-b2d2-67a6f872aa06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:08.106030 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-d7478e96-5da7-4637-b2d2-67a6f872aa06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:08.108097 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1287/2575] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:38:07 2021] DELETE /identity/v3/projects/950e1a3980d14da5a708ab65fbae25b2 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:38:08.114482 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb99957-133a-4731-900e-91ee1ec0e563 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:08.114976 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb99957-133a-4731-900e-91ee1ec0e563 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:08.115083 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb99957-133a-4731-900e-91ee1ec0e563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:08.164239 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-8cb99957-133a-4731-900e-91ee1ec0e563 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:38:08.165469 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-8cb99957-133a-4731-900e-91ee1ec0e563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:08.225980 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1289/2576] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:38:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:38:08.234515 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7693d2-0e44-479f-bbc8-83cde89971e1 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:08.234897 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7693d2-0e44-479f-bbc8-83cde89971e1 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:08.235554 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7693d2-0e44-479f-bbc8-83cde89971e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:08.255755 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-1d7693d2-0e44-479f-bbc8-83cde89971e1 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:38:08.257334 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-1d7693d2-0e44-479f-bbc8-83cde89971e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:08.266013 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1288/2577] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:38:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:38:08.270049 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb99957-133a-4731-900e-91ee1ec0e563 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:08.280155 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb99957-133a-4731-900e-91ee1ec0e563 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:08.284992 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49691f64-d6a8-442d-94a0-8cef45432b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:08.285662 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49691f64-d6a8-442d-94a0-8cef45432b44 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:08.285927 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49691f64-d6a8-442d-94a0-8cef45432b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:08.286206 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49691f64-d6a8-442d-94a0-8cef45432b44 admin admin] PATH_INFO: `/v3/domains` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:08.286930 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49691f64-d6a8-442d-94a0-8cef45432b44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:38:08.287236 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49691f64-d6a8-442d-94a0-8cef45432b44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:08.288868 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49691f64-d6a8-442d-94a0-8cef45432b44 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:08.301417 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1290/2578] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 12 18:38:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:38:08.305628 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7693d2-0e44-479f-bbc8-83cde89971e1 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:08.314958 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7693d2-0e44-479f-bbc8-83cde89971e1 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:08.319695 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ad23f6-675e-43fb-831f-4ce416a68791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:08.320347 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad23f6-675e-43fb-831f-4ce416a68791 admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:08.320659 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad23f6-675e-43fb-831f-4ce416a68791 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:08.320936 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad23f6-675e-43fb-831f-4ce416a68791 admin admin] PATH_INFO: `/v3/projects` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:08.321714 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ad23f6-675e-43fb-831f-4ce416a68791 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:08.323599 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ad23f6-675e-43fb-831f-4ce416a68791 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:08.432094 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1289/2579] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:38:08 2021] POST /identity/v3/projects => generated 357 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:38:08.435984 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49691f64-d6a8-442d-94a0-8cef45432b44 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:08.445692 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49691f64-d6a8-442d-94a0-8cef45432b44 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:08.503540 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9014d788-6131-4646-a1d6-5dc5096864f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:08.504124 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9014d788-6131-4646-a1d6-5dc5096864f1 admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:08.504427 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9014d788-6131-4646-a1d6-5dc5096864f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:08.504715 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9014d788-6131-4646-a1d6-5dc5096864f1 admin admin] PATH_INFO: `/v3/users` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:08.505424 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9014d788-6131-4646-a1d6-5dc5096864f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:08.507362 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9014d788-6131-4646-a1d6-5dc5096864f1 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:08.598668 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1291/2580] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:38:08 2021] POST /identity/v3/users => generated 279 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 18:38:08.602845 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ad23f6-675e-43fb-831f-4ce416a68791 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:08.613125 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ad23f6-675e-43fb-831f-4ce416a68791 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:08.618541 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db878f9-d71a-4885-913f-d61bdcbcfff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:08.619233 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db878f9-d71a-4885-913f-d61bdcbcfff3 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:08.619515 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db878f9-d71a-4885-913f-d61bdcbcfff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:08.619791 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db878f9-d71a-4885-913f-d61bdcbcfff3 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:08.620576 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db878f9-d71a-4885-913f-d61bdcbcfff3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:08.622178 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db878f9-d71a-4885-913f-d61bdcbcfff3 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:08.633367 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1290/2581] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:38:08 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:38:08.637347 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9014d788-6131-4646-a1d6-5dc5096864f1 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:08.647808 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9014d788-6131-4646-a1d6-5dc5096864f1 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:08.652719 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40533101-9422-4d6b-b970-7d690b876102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:08.653374 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40533101-9422-4d6b-b970-7d690b876102 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:08.654332 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40533101-9422-4d6b-b970-7d690b876102 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:08.654603 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40533101-9422-4d6b-b970-7d690b876102 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:08.655328 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40533101-9422-4d6b-b970-7d690b876102 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:08.657209 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40533101-9422-4d6b-b970-7d690b876102 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:08.667086 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1292/2582] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:38:08 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:38:08.671159 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db878f9-d71a-4885-913f-d61bdcbcfff3 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:08.681052 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db878f9-d71a-4885-913f-d61bdcbcfff3 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:08.685819 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3ac80b-ae62-4687-bfa1-6644ae307117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:08.686781 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ac80b-ae62-4687-bfa1-6644ae307117 admin admin] REQUEST_METHOD: `PUT` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:08.687132 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ac80b-ae62-4687-bfa1-6644ae307117 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:08.687478 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ac80b-ae62-4687-bfa1-6644ae307117 admin admin] PATH_INFO: `/v3/projects/9f85299ab4e14a9eb3ce3c75aef40697/users/a4e3b0cd87c249309442917e56cd689c/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:08.703560 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3ac80b-ae62-4687-bfa1-6644ae307117 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f85299ab4e14a9eb3ce3c75aef40697, user_id=a4e3b0cd87c249309442917e56cd689c, role_id=33b8a5a8d1d643f2a98f598e6ab0a1cf)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:08.706290 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3ac80b-ae62-4687-bfa1-6644ae307117 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:08.826363 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1291/2583] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:38:08 2021] PUT /identity/v3/projects/9f85299ab4e14a9eb3ce3c75aef40697/users/a4e3b0cd87c249309442917e56cd689c/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:38:08.836290 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789e5b6-2bc4-43e8-92af-32d164c8395a None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:08.836615 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789e5b6-2bc4-43e8-92af-32d164c8395a None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:08.836889 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789e5b6-2bc4-43e8-92af-32d164c8395a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:08.862645 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-f789e5b6-2bc4-43e8-92af-32d164c8395a None None] MFA Rules not processed for user `a4e3b0cd87c249309442917e56cd689c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:38:08.863931 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-f789e5b6-2bc4-43e8-92af-32d164c8395a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:08.927819 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1293/2584] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:38:08 2021] POST /identity/v3/auth/tokens => generated 3377 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:38:08.932192 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3ac80b-ae62-4687-bfa1-6644ae307117 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:08.993202 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3ac80b-ae62-4687-bfa1-6644ae307117 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:08.998489 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e376bb79-9ba0-46e7-ba04-053435c45051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:08.999146 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e376bb79-9ba0-46e7-ba04-053435c45051 admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:08.999430 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e376bb79-9ba0-46e7-ba04-053435c45051 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:08.999714 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e376bb79-9ba0-46e7-ba04-053435c45051 admin admin] PATH_INFO: `/v3/projects` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:09.000448 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e376bb79-9ba0-46e7-ba04-053435c45051 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:09.002364 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e376bb79-9ba0-46e7-ba04-053435c45051 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:09.137264 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1292/2585] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:38:08 2021] POST /identity/v3/projects => generated 355 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:38:09.139444 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f789e5b6-2bc4-43e8-92af-32d164c8395a None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:09.149923 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f789e5b6-2bc4-43e8-92af-32d164c8395a None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:09.207010 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a1e77f-98d1-4893-9f6b-261cd8665b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:09.207676 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a1e77f-98d1-4893-9f6b-261cd8665b7c admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:09.207957 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a1e77f-98d1-4893-9f6b-261cd8665b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:09.208232 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a1e77f-98d1-4893-9f6b-261cd8665b7c admin admin] PATH_INFO: `/v3/users` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:09.208983 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a1e77f-98d1-4893-9f6b-261cd8665b7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:09.210906 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a1e77f-98d1-4893-9f6b-261cd8665b7c admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:09.296187 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1294/2586] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:38:09 2021] POST /identity/v3/users => generated 284 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:38:09.300094 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e376bb79-9ba0-46e7-ba04-053435c45051 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:09.318508 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a1e77f-98d1-4893-9f6b-261cd8665b7c admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:09.320650 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-f8a1e77f-98d1-4893-9f6b-261cd8665b7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:09.322420 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e376bb79-9ba0-46e7-ba04-053435c45051 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:09.339893 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e5dee3-4cdb-4107-bbc3-821c4b95fa5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:09.340692 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5dee3-4cdb-4107-bbc3-821c4b95fa5d admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:09.340884 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5dee3-4cdb-4107-bbc3-821c4b95fa5d admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:09.341191 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5dee3-4cdb-4107-bbc3-821c4b95fa5d admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:09.341933 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e5dee3-4cdb-4107-bbc3-821c4b95fa5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:09.343528 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e5dee3-4cdb-4107-bbc3-821c4b95fa5d admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:09.360136 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1293/2587] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:38:09 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 18:38:09.361179 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e5dee3-4cdb-4107-bbc3-821c4b95fa5d admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:09.371120 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e5dee3-4cdb-4107-bbc3-821c4b95fa5d admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:09.379161 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd338a8a-e1b0-49d4-9c91-64a940a177c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:09.379461 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd338a8a-e1b0-49d4-9c91-64a940a177c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:09.379722 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd338a8a-e1b0-49d4-9c91-64a940a177c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:09.380004 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd338a8a-e1b0-49d4-9c91-64a940a177c9 admin admin] PATH_INFO: `/v3/projects/1953d01121b047a08bc222985a1acfb3/users/40c2b4e51dae475bb93d5f7017f549ea/roles/6c54f239944d46e3b027ccce97eb8b49` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:09.396170 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd338a8a-e1b0-49d4-9c91-64a940a177c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1953d01121b047a08bc222985a1acfb3, user_id=40c2b4e51dae475bb93d5f7017f549ea, role_id=6c54f239944d46e3b027ccce97eb8b49)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:09.399223 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd338a8a-e1b0-49d4-9c91-64a940a177c9 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:09.409743 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a1e77f-98d1-4893-9f6b-261cd8665b7c admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:09.415495 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b23ad38-d5c1-4a49-ae1a-200ed0b705ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3417097a280b499086b36df9a2548239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:09.416233 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23ad38-d5c1-4a49-ae1a-200ed0b705ff service nova] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:09.416564 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23ad38-d5c1-4a49-ae1a-200ed0b705ff service nova] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:09.416843 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23ad38-d5c1-4a49-ae1a-200ed0b705ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:09.418707 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-2b23ad38-d5c1-4a49-ae1a-200ed0b705ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:09.432291 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b23ad38-d5c1-4a49-ae1a-200ed0b705ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:09.434027 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b23ad38-d5c1-4a49-ae1a-200ed0b705ff service nova] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:09.446542 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1295/2588] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:38:09 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:38:09.501777 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1294/2589] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:38:09 2021] PUT /identity/v3/projects/1953d01121b047a08bc222985a1acfb3/users/40c2b4e51dae475bb93d5f7017f549ea/roles/6c54f239944d46e3b027ccce97eb8b49 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:38:09.505928 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b23ad38-d5c1-4a49-ae1a-200ed0b705ff service nova] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:09.521174 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b23ad38-d5c1-4a49-ae1a-200ed0b705ff service nova] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:09.590627 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc20e06-5da6-4172-9b4f-5b30c9502d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:09.591318 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc20e06-5da6-4172-9b4f-5b30c9502d5e admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:09.595347 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc20e06-5da6-4172-9b4f-5b30c9502d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:09.595347 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc20e06-5da6-4172-9b4f-5b30c9502d5e admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:09.595347 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc20e06-5da6-4172-9b4f-5b30c9502d5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:09.595347 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc20e06-5da6-4172-9b4f-5b30c9502d5e admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:09.619617 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1296/2590] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:38:09 2021] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:38:09.620966 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd338a8a-e1b0-49d4-9c91-64a940a177c9 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:09.634864 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd338a8a-e1b0-49d4-9c91-64a940a177c9 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:09.640998 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833ddbe2-c5fe-48d8-8186-a9bb7b121d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:09.641893 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ddbe2-c5fe-48d8-8186-a9bb7b121d8b admin admin] REQUEST_METHOD: `PUT` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:09.642312 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ddbe2-c5fe-48d8-8186-a9bb7b121d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:09.642592 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ddbe2-c5fe-48d8-8186-a9bb7b121d8b admin admin] PATH_INFO: `/v3/projects/1953d01121b047a08bc222985a1acfb3/users/40c2b4e51dae475bb93d5f7017f549ea/roles/6c54f239944d46e3b027ccce97eb8b49` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:09.644646 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833ddbe2-c5fe-48d8-8186-a9bb7b121d8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1953d01121b047a08bc222985a1acfb3, user_id=40c2b4e51dae475bb93d5f7017f549ea, role_id=6c54f239944d46e3b027ccce97eb8b49)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:09.647403 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833ddbe2-c5fe-48d8-8186-a9bb7b121d8b admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:09.662258 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1295/2591] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:38:09 2021] PUT /identity/v3/projects/1953d01121b047a08bc222985a1acfb3/users/40c2b4e51dae475bb93d5f7017f549ea/roles/6c54f239944d46e3b027ccce97eb8b49 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:38:09.680159 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d4f9b3-8850-4854-a784-a4d688c03f5a None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:09.680840 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d4f9b3-8850-4854-a784-a4d688c03f5a None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:09.681268 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d4f9b3-8850-4854-a784-a4d688c03f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:09.709734 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-f7d4f9b3-8850-4854-a784-a4d688c03f5a None None] MFA Rules not processed for user `40c2b4e51dae475bb93d5f7017f549ea`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:38:09.711665 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-f7d4f9b3-8850-4854-a784-a4d688c03f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:09.808461 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1297/2592] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:38:09 2021] POST /identity/v3/auth/tokens => generated 3442 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:38:09.819415 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833ddbe2-c5fe-48d8-8186-a9bb7b121d8b admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:09.821267 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-833ddbe2-c5fe-48d8-8186-a9bb7b121d8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:09.881294 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833ddbe2-c5fe-48d8-8186-a9bb7b121d8b admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:09.885533 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70870831-a164-4265-a750-aa3e10cad6fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6966ce0774f4437a9b688494e9d0574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:09.886436 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70870831-a164-4265-a750-aa3e10cad6fe service cinder] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:09.886795 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70870831-a164-4265-a750-aa3e10cad6fe service cinder] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:09.887361 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70870831-a164-4265-a750-aa3e10cad6fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:09.899032 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70870831-a164-4265-a750-aa3e10cad6fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:09.902399 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70870831-a164-4265-a750-aa3e10cad6fe service cinder] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:09.915647 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1296/2593] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:38:09 2021] GET /identity/v3/auth/tokens => generated 3442 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:38:10.176652 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d4f9b3-8850-4854-a784-a4d688c03f5a None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:10.187024 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d4f9b3-8850-4854-a784-a4d688c03f5a None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:10.191375 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ded9ce-c206-4716-b1f0-2478f071b432 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6966ce0774f4437a9b688494e9d0574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:10.192046 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ded9ce-c206-4716-b1f0-2478f071b432 service cinder] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:10.192554 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ded9ce-c206-4716-b1f0-2478f071b432 service cinder] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:10.193187 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ded9ce-c206-4716-b1f0-2478f071b432 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:10.298404 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ded9ce-c206-4716-b1f0-2478f071b432 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:10.299889 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ded9ce-c206-4716-b1f0-2478f071b432 service cinder] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:10.312810 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1298/2594] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:38:10 2021] GET /identity/v3/auth/tokens => generated 3377 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:38:12.698796 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70870831-a164-4265-a750-aa3e10cad6fe service cinder] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:12.700830 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-70870831-a164-4265-a750-aa3e10cad6fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:12.764158 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70870831-a164-4265-a750-aa3e10cad6fe service cinder] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:12.768742 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2403fe6e-7bb4-4a89-be4e-84d03963dc4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:12.769609 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2403fe6e-7bb4-4a89-be4e-84d03963dc4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:12.769890 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2403fe6e-7bb4-4a89-be4e-84d03963dc4f admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:12.770165 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2403fe6e-7bb4-4a89-be4e-84d03963dc4f admin admin] PATH_INFO: `/v3/users/75606513d1c04a9a8f95e0c0f60d9c11` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:12.771382 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2403fe6e-7bb4-4a89-be4e-84d03963dc4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=75606513d1c04a9a8f95e0c0f60d9c11)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:12.773439 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2403fe6e-7bb4-4a89-be4e-84d03963dc4f admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:13.009384 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-2403fe6e-7bb4-4a89-be4e-84d03963dc4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75606513d1c04a9a8f95e0c0f60d9c11'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:13.016984 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-2403fe6e-7bb4-4a89-be4e-84d03963dc4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75606513d1c04a9a8f95e0c0f60d9c11'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:13.028130 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-2403fe6e-7bb4-4a89-be4e-84d03963dc4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75606513d1c04a9a8f95e0c0f60d9c11'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:13.115530 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-2403fe6e-7bb4-4a89-be4e-84d03963dc4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75606513d1c04a9a8f95e0c0f60d9c11'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:13.116143 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-2403fe6e-7bb4-4a89-be4e-84d03963dc4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75606513d1c04a9a8f95e0c0f60d9c11'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:13.122201 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1297/2595] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:38:12 2021] DELETE /identity/v3/users/75606513d1c04a9a8f95e0c0f60d9c11 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:38:13.360114 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ded9ce-c206-4716-b1f0-2478f071b432 service cinder] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:13.372018 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ded9ce-c206-4716-b1f0-2478f071b432 service cinder] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:13.430900 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf76a033-3ff2-4c23-a6e5-6ad93bbcf7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:13.431873 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf76a033-3ff2-4c23-a6e5-6ad93bbcf7fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:13.432152 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf76a033-3ff2-4c23-a6e5-6ad93bbcf7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:13.432450 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf76a033-3ff2-4c23-a6e5-6ad93bbcf7fa admin admin] PATH_INFO: `/v3/projects/9b114869544b4236a53ce1103cfc7abf` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:13.433662 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf76a033-3ff2-4c23-a6e5-6ad93bbcf7fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b114869544b4236a53ce1103cfc7abf)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:13.441684 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf76a033-3ff2-4c23-a6e5-6ad93bbcf7fa admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:13.591384 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-cf76a033-3ff2-4c23-a6e5-6ad93bbcf7fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b114869544b4236a53ce1103cfc7abf', 'request_id': 'req-cf76a033-3ff2-4c23-a6e5-6ad93bbcf7fa'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:13.597431 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-cf76a033-3ff2-4c23-a6e5-6ad93bbcf7fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b114869544b4236a53ce1103cfc7abf', 'request_id': 'req-cf76a033-3ff2-4c23-a6e5-6ad93bbcf7fa'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:13.602597 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-cf76a033-3ff2-4c23-a6e5-6ad93bbcf7fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b114869544b4236a53ce1103cfc7abf', 'request_id': 'req-cf76a033-3ff2-4c23-a6e5-6ad93bbcf7fa'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:13.686797 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-cf76a033-3ff2-4c23-a6e5-6ad93bbcf7fa admin admin] The token cache is being invalidate because project 9b114869544b4236a53ce1103cfc7abf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74005) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:38:13.687077 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-cf76a033-3ff2-4c23-a6e5-6ad93bbcf7fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:13.687819 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-cf76a033-3ff2-4c23-a6e5-6ad93bbcf7fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:13.689399 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1299/2596] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:38:13 2021] DELETE /identity/v3/projects/9b114869544b4236a53ce1103cfc7abf => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:38:13.695203 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e04de2d-9134-4597-86c1-c21f4e8fb5f8 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:13.695491 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e04de2d-9134-4597-86c1-c21f4e8fb5f8 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:13.695769 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e04de2d-9134-4597-86c1-c21f4e8fb5f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:13.715271 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-7e04de2d-9134-4597-86c1-c21f4e8fb5f8 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:38:13.717005 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-7e04de2d-9134-4597-86c1-c21f4e8fb5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:13.773647 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1298/2597] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:38:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:38:13.782378 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e67cc0-7a5f-4985-80e9-ad6f493be898 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:13.782667 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e67cc0-7a5f-4985-80e9-ad6f493be898 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:13.782945 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e67cc0-7a5f-4985-80e9-ad6f493be898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:13.801190 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-b9e67cc0-7a5f-4985-80e9-ad6f493be898 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:38:13.802391 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-b9e67cc0-7a5f-4985-80e9-ad6f493be898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:13.810211 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1300/2598] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:38:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:38:13.814410 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e04de2d-9134-4597-86c1-c21f4e8fb5f8 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:13.823911 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e04de2d-9134-4597-86c1-c21f4e8fb5f8 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:13.829333 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5647ccf-4bec-4664-88d5-af66dcbb33cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:13.830077 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5647ccf-4bec-4664-88d5-af66dcbb33cc admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:13.830361 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5647ccf-4bec-4664-88d5-af66dcbb33cc admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:13.830636 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5647ccf-4bec-4664-88d5-af66dcbb33cc admin admin] PATH_INFO: `/v3/domains` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:13.831366 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5647ccf-4bec-4664-88d5-af66dcbb33cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:38:13.831674 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5647ccf-4bec-4664-88d5-af66dcbb33cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:13.833301 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5647ccf-4bec-4664-88d5-af66dcbb33cc admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:13.845785 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1299/2599] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 12 18:38:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:38:13.850170 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e67cc0-7a5f-4985-80e9-ad6f493be898 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:13.859069 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e67cc0-7a5f-4985-80e9-ad6f493be898 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:13.863772 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4025a9-b5c4-4bdc-be65-acdff27514e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:13.864451 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4025a9-b5c4-4bdc-be65-acdff27514e5 admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:13.864737 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4025a9-b5c4-4bdc-be65-acdff27514e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:13.865010 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4025a9-b5c4-4bdc-be65-acdff27514e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:13.865846 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4025a9-b5c4-4bdc-be65-acdff27514e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:13.867606 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4025a9-b5c4-4bdc-be65-acdff27514e5 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:13.947144 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1301/2600] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:38:13 2021] POST /identity/v3/projects => generated 365 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:38:13.952053 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5647ccf-4bec-4664-88d5-af66dcbb33cc admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:13.961810 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5647ccf-4bec-4664-88d5-af66dcbb33cc admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:14.016990 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d489682a-2400-4fae-861a-d15da0354951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:14.017645 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489682a-2400-4fae-861a-d15da0354951 admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:14.017927 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489682a-2400-4fae-861a-d15da0354951 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:14.018253 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489682a-2400-4fae-861a-d15da0354951 admin admin] PATH_INFO: `/v3/users` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:14.018937 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d489682a-2400-4fae-861a-d15da0354951 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:14.020855 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d489682a-2400-4fae-861a-d15da0354951 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:14.123358 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1300/2601] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:38:13 2021] POST /identity/v3/users => generated 283 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:38:14.127900 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4025a9-b5c4-4bdc-be65-acdff27514e5 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:14.139787 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4025a9-b5c4-4bdc-be65-acdff27514e5 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:14.144424 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448efa97-d251-47aa-908e-abbb121dba10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:14.145081 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448efa97-d251-47aa-908e-abbb121dba10 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:14.145359 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448efa97-d251-47aa-908e-abbb121dba10 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:14.145631 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448efa97-d251-47aa-908e-abbb121dba10 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:14.146357 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448efa97-d251-47aa-908e-abbb121dba10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:14.148136 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448efa97-d251-47aa-908e-abbb121dba10 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:14.161318 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1302/2602] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:38:14 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 18:38:14.165311 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d489682a-2400-4fae-861a-d15da0354951 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:14.175654 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d489682a-2400-4fae-861a-d15da0354951 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:14.180696 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0c6caa-a916-4e2e-88ab-078395944f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:14.181349 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c6caa-a916-4e2e-88ab-078395944f81 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:14.181676 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c6caa-a916-4e2e-88ab-078395944f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:14.181888 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c6caa-a916-4e2e-88ab-078395944f81 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:14.182722 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0c6caa-a916-4e2e-88ab-078395944f81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:14.184241 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0c6caa-a916-4e2e-88ab-078395944f81 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:14.194394 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1301/2603] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:38:14 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:38:14.198806 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448efa97-d251-47aa-908e-abbb121dba10 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:14.209352 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448efa97-d251-47aa-908e-abbb121dba10 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:14.214118 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6700936-579a-4898-82b1-686e83db5ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:14.214983 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6700936-579a-4898-82b1-686e83db5ea5 admin admin] REQUEST_METHOD: `PUT` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:14.215259 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6700936-579a-4898-82b1-686e83db5ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:14.215528 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6700936-579a-4898-82b1-686e83db5ea5 admin admin] PATH_INFO: `/v3/projects/57f9acb6f2dd42f9845c9ab807114c30/users/8949c3bf3ff246e080118a4f9ec32fae/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:14.230455 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6700936-579a-4898-82b1-686e83db5ea5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57f9acb6f2dd42f9845c9ab807114c30, user_id=8949c3bf3ff246e080118a4f9ec32fae, role_id=33b8a5a8d1d643f2a98f598e6ab0a1cf)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:14.233161 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6700936-579a-4898-82b1-686e83db5ea5 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:14.322999 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1303/2604] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:38:14 2021] PUT /identity/v3/projects/57f9acb6f2dd42f9845c9ab807114c30/users/8949c3bf3ff246e080118a4f9ec32fae/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 18:38:14.333710 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5225a059-297d-440e-bcbb-a2179f62f14e None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:14.333998 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5225a059-297d-440e-bcbb-a2179f62f14e None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:14.334274 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5225a059-297d-440e-bcbb-a2179f62f14e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:14.359851 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-5225a059-297d-440e-bcbb-a2179f62f14e None None] MFA Rules not processed for user `8949c3bf3ff246e080118a4f9ec32fae`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:38:14.361131 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-5225a059-297d-440e-bcbb-a2179f62f14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:14.428155 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1302/2605] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:38:14 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:38:14.432861 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6700936-579a-4898-82b1-686e83db5ea5 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:14.492580 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6700936-579a-4898-82b1-686e83db5ea5 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:14.497872 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60231489-02e7-42b9-ab26-fcb35d21b4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:14.498528 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60231489-02e7-42b9-ab26-fcb35d21b4e9 admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:14.498807 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60231489-02e7-42b9-ab26-fcb35d21b4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:14.499083 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60231489-02e7-42b9-ab26-fcb35d21b4e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:14.499822 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60231489-02e7-42b9-ab26-fcb35d21b4e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:14.501767 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60231489-02e7-42b9-ab26-fcb35d21b4e9 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:14.629475 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1304/2606] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:38:14 2021] POST /identity/v3/projects => generated 365 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 18:38:14.634103 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5225a059-297d-440e-bcbb-a2179f62f14e None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:14.644572 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5225a059-297d-440e-bcbb-a2179f62f14e None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:14.700910 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb21911-223c-4e9b-8017-a09546d072ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:14.701569 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb21911-223c-4e9b-8017-a09546d072ae admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:14.701849 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb21911-223c-4e9b-8017-a09546d072ae admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:14.702121 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb21911-223c-4e9b-8017-a09546d072ae admin admin] PATH_INFO: `/v3/users` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:14.702803 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb21911-223c-4e9b-8017-a09546d072ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:14.704738 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb21911-223c-4e9b-8017-a09546d072ae admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:14.789692 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1303/2607] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:38:14 2021] POST /identity/v3/users => generated 289 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:38:14.793626 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60231489-02e7-42b9-ab26-fcb35d21b4e9 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:14.804318 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60231489-02e7-42b9-ab26-fcb35d21b4e9 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:14.809084 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8506d6-04a4-4f81-a56e-b6984e55df8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:14.810375 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8506d6-04a4-4f81-a56e-b6984e55df8d admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:14.810663 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8506d6-04a4-4f81-a56e-b6984e55df8d admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:14.810960 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8506d6-04a4-4f81-a56e-b6984e55df8d admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:14.811675 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8506d6-04a4-4f81-a56e-b6984e55df8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:14.813328 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8506d6-04a4-4f81-a56e-b6984e55df8d admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:14.823493 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1305/2608] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:38:14 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:38:14.827427 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb21911-223c-4e9b-8017-a09546d072ae admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:14.837327 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb21911-223c-4e9b-8017-a09546d072ae admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:14.841868 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ec258e-d599-4348-a95c-9cd6496a1c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:14.842743 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec258e-d599-4348-a95c-9cd6496a1c56 admin admin] REQUEST_METHOD: `PUT` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:14.843023 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec258e-d599-4348-a95c-9cd6496a1c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:14.843299 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec258e-d599-4348-a95c-9cd6496a1c56 admin admin] PATH_INFO: `/v3/projects/490e95f68c834ba9b6a52bd676e19e28/users/bcb3973bcf724947988f554bb65c7b15/roles/6c54f239944d46e3b027ccce97eb8b49` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:14.859031 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ec258e-d599-4348-a95c-9cd6496a1c56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=490e95f68c834ba9b6a52bd676e19e28, user_id=bcb3973bcf724947988f554bb65c7b15, role_id=6c54f239944d46e3b027ccce97eb8b49)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:14.861642 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ec258e-d599-4348-a95c-9cd6496a1c56 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:15.020132 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1304/2609] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:38:14 2021] PUT /identity/v3/projects/490e95f68c834ba9b6a52bd676e19e28/users/bcb3973bcf724947988f554bb65c7b15/roles/6c54f239944d46e3b027ccce97eb8b49 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 18:38:15.024335 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8506d6-04a4-4f81-a56e-b6984e55df8d admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:15.034869 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8506d6-04a4-4f81-a56e-b6984e55df8d admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:15.088450 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff9a07c-79e2-4495-a9e6-258762d49f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:15.089113 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff9a07c-79e2-4495-a9e6-258762d49f77 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:15.089392 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff9a07c-79e2-4495-a9e6-258762d49f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:15.089665 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff9a07c-79e2-4495-a9e6-258762d49f77 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:15.090422 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff9a07c-79e2-4495-a9e6-258762d49f77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:15.092563 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff9a07c-79e2-4495-a9e6-258762d49f77 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:15.101985 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1306/2610] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:38:15 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:38:15.106292 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ec258e-d599-4348-a95c-9cd6496a1c56 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:15.117005 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ec258e-d599-4348-a95c-9cd6496a1c56 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:15.121590 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16be11af-4ebf-44f3-b18f-05d6cf62fc40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:15.122459 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16be11af-4ebf-44f3-b18f-05d6cf62fc40 admin admin] REQUEST_METHOD: `PUT` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:15.122740 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16be11af-4ebf-44f3-b18f-05d6cf62fc40 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:15.123011 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16be11af-4ebf-44f3-b18f-05d6cf62fc40 admin admin] PATH_INFO: `/v3/projects/490e95f68c834ba9b6a52bd676e19e28/users/bcb3973bcf724947988f554bb65c7b15/roles/6c54f239944d46e3b027ccce97eb8b49` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:15.125010 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16be11af-4ebf-44f3-b18f-05d6cf62fc40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=490e95f68c834ba9b6a52bd676e19e28, user_id=bcb3973bcf724947988f554bb65c7b15, role_id=6c54f239944d46e3b027ccce97eb8b49)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:15.127638 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16be11af-4ebf-44f3-b18f-05d6cf62fc40 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:15.137524 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1305/2611] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:38:15 2021] PUT /identity/v3/projects/490e95f68c834ba9b6a52bd676e19e28/users/bcb3973bcf724947988f554bb65c7b15/roles/6c54f239944d46e3b027ccce97eb8b49 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:38:15.148460 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dfc46c-a531-4f77-8b47-015e3db39427 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:15.148751 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dfc46c-a531-4f77-8b47-015e3db39427 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:15.149028 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dfc46c-a531-4f77-8b47-015e3db39427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:15.175599 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-f4dfc46c-a531-4f77-8b47-015e3db39427 None None] MFA Rules not processed for user `bcb3973bcf724947988f554bb65c7b15`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:38:15.176886 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-f4dfc46c-a531-4f77-8b47-015e3db39427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:15.244871 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1307/2612] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:38:15 2021] POST /identity/v3/auth/tokens => generated 3452 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:38:15.256562 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16be11af-4ebf-44f3-b18f-05d6cf62fc40 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:15.258454 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-16be11af-4ebf-44f3-b18f-05d6cf62fc40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:15.316131 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16be11af-4ebf-44f3-b18f-05d6cf62fc40 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:15.320074 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb30941c-eb83-43d8-8004-fcb7f618ad5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6966ce0774f4437a9b688494e9d0574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:15.320773 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb30941c-eb83-43d8-8004-fcb7f618ad5b service cinder] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:15.321171 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb30941c-eb83-43d8-8004-fcb7f618ad5b service cinder] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:15.321390 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb30941c-eb83-43d8-8004-fcb7f618ad5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:15.332519 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb30941c-eb83-43d8-8004-fcb7f618ad5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:15.335134 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb30941c-eb83-43d8-8004-fcb7f618ad5b service cinder] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:15.346091 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1306/2613] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:38:15 2021] GET /identity/v3/auth/tokens => generated 3452 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:38:15.700183 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dfc46c-a531-4f77-8b47-015e3db39427 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:15.762842 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dfc46c-a531-4f77-8b47-015e3db39427 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:15.767596 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53186562-9b6f-4d06-81fc-e7708f6f83db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:15.768545 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53186562-9b6f-4d06-81fc-e7708f6f83db admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:15.768828 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53186562-9b6f-4d06-81fc-e7708f6f83db admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:15.769116 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53186562-9b6f-4d06-81fc-e7708f6f83db admin admin] PATH_INFO: `/v3/users/8949c3bf3ff246e080118a4f9ec32fae` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:15.770317 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53186562-9b6f-4d06-81fc-e7708f6f83db admin admin] RBAC: Authorizing `identity:delete_user(user_id=8949c3bf3ff246e080118a4f9ec32fae)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:15.772301 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53186562-9b6f-4d06-81fc-e7708f6f83db admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:16.164564 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-53186562-9b6f-4d06-81fc-e7708f6f83db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8949c3bf3ff246e080118a4f9ec32fae'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:16.165220 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-53186562-9b6f-4d06-81fc-e7708f6f83db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8949c3bf3ff246e080118a4f9ec32fae'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:16.176700 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-53186562-9b6f-4d06-81fc-e7708f6f83db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8949c3bf3ff246e080118a4f9ec32fae'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:16.177366 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-53186562-9b6f-4d06-81fc-e7708f6f83db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8949c3bf3ff246e080118a4f9ec32fae'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:16.183916 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-53186562-9b6f-4d06-81fc-e7708f6f83db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8949c3bf3ff246e080118a4f9ec32fae'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:16.328521 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1308/2614] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:38:15 2021] DELETE /identity/v3/users/8949c3bf3ff246e080118a4f9ec32fae => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:38:16.333076 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c656f1b9-eed3-40d7-823e-c65f99b0a389 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:16.333538 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c656f1b9-eed3-40d7-823e-c65f99b0a389 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:16.333653 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c656f1b9-eed3-40d7-823e-c65f99b0a389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:16.351627 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-c656f1b9-eed3-40d7-823e-c65f99b0a389 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:38:16.352880 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-c656f1b9-eed3-40d7-823e-c65f99b0a389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:16.408707 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1307/2615] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:38:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:38:16.418466 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53186562-9b6f-4d06-81fc-e7708f6f83db admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:16.419878 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-53186562-9b6f-4d06-81fc-e7708f6f83db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:16.475675 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53186562-9b6f-4d06-81fc-e7708f6f83db admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:16.479638 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f216801e-44f4-46f6-8048-d422e5d12dbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:16.480279 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216801e-44f4-46f6-8048-d422e5d12dbf service neutron] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:16.480597 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216801e-44f4-46f6-8048-d422e5d12dbf service neutron] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:16.480880 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216801e-44f4-46f6-8048-d422e5d12dbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:16.489985 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f216801e-44f4-46f6-8048-d422e5d12dbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:16.491442 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f216801e-44f4-46f6-8048-d422e5d12dbf service neutron] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:16.501475 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1309/2616] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:38:16 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:38:16.901392 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c656f1b9-eed3-40d7-823e-c65f99b0a389 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:16.902845 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-c656f1b9-eed3-40d7-823e-c65f99b0a389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:16.915314 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c656f1b9-eed3-40d7-823e-c65f99b0a389 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:16.925147 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84715517-9ef3-4b30-b2ed-2ec0c32d9162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:16.925791 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84715517-9ef3-4b30-b2ed-2ec0c32d9162 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:16.926372 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84715517-9ef3-4b30-b2ed-2ec0c32d9162 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:16.926697 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84715517-9ef3-4b30-b2ed-2ec0c32d9162 admin admin] PATH_INFO: `/v3/projects/57f9acb6f2dd42f9845c9ab807114c30` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:16.927868 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84715517-9ef3-4b30-b2ed-2ec0c32d9162 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57f9acb6f2dd42f9845c9ab807114c30)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:16.930279 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84715517-9ef3-4b30-b2ed-2ec0c32d9162 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:17.094039 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-84715517-9ef3-4b30-b2ed-2ec0c32d9162 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57f9acb6f2dd42f9845c9ab807114c30', 'request_id': 'req-84715517-9ef3-4b30-b2ed-2ec0c32d9162'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:17.179607 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-84715517-9ef3-4b30-b2ed-2ec0c32d9162 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57f9acb6f2dd42f9845c9ab807114c30', 'request_id': 'req-84715517-9ef3-4b30-b2ed-2ec0c32d9162'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:17.187081 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-84715517-9ef3-4b30-b2ed-2ec0c32d9162 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57f9acb6f2dd42f9845c9ab807114c30', 'request_id': 'req-84715517-9ef3-4b30-b2ed-2ec0c32d9162'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:17.197134 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-84715517-9ef3-4b30-b2ed-2ec0c32d9162 admin admin] The token cache is being invalidate because project 57f9acb6f2dd42f9845c9ab807114c30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:38:17.197420 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-84715517-9ef3-4b30-b2ed-2ec0c32d9162 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:17.200210 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-84715517-9ef3-4b30-b2ed-2ec0c32d9162 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:17.200210 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1308/2617] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:38:16 2021] DELETE /identity/v3/projects/57f9acb6f2dd42f9845c9ab807114c30 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:38:17.203724 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f216801e-44f4-46f6-8048-d422e5d12dbf service neutron] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:17.213582 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f216801e-44f4-46f6-8048-d422e5d12dbf service neutron] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:17.267979 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0236917-01f6-4b25-8a21-8f6a0026f02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:17.268885 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0236917-01f6-4b25-8a21-8f6a0026f02e admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:17.269165 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0236917-01f6-4b25-8a21-8f6a0026f02e admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:17.269440 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0236917-01f6-4b25-8a21-8f6a0026f02e admin admin] PATH_INFO: `/v3/users/bcb3973bcf724947988f554bb65c7b15` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:17.270655 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0236917-01f6-4b25-8a21-8f6a0026f02e admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcb3973bcf724947988f554bb65c7b15)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:17.272615 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0236917-01f6-4b25-8a21-8f6a0026f02e admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:17.455851 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-f0236917-01f6-4b25-8a21-8f6a0026f02e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcb3973bcf724947988f554bb65c7b15'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:17.456531 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-f0236917-01f6-4b25-8a21-8f6a0026f02e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcb3973bcf724947988f554bb65c7b15'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:17.468799 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-f0236917-01f6-4b25-8a21-8f6a0026f02e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcb3973bcf724947988f554bb65c7b15'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:17.469477 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-f0236917-01f6-4b25-8a21-8f6a0026f02e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcb3973bcf724947988f554bb65c7b15'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:17.476540 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-f0236917-01f6-4b25-8a21-8f6a0026f02e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcb3973bcf724947988f554bb65c7b15'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:17.562993 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1310/2618] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:38:17 2021] DELETE /identity/v3/users/bcb3973bcf724947988f554bb65c7b15 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:38:18.358168 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84715517-9ef3-4b30-b2ed-2ec0c32d9162 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:18.360122 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-84715517-9ef3-4b30-b2ed-2ec0c32d9162 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:18.374042 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84715517-9ef3-4b30-b2ed-2ec0c32d9162 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:18.478046 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f22ed10-d745-4bce-b8bb-d1a1c54b73f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:18.478935 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f22ed10-d745-4bce-b8bb-d1a1c54b73f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:18.479219 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f22ed10-d745-4bce-b8bb-d1a1c54b73f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:18.479496 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f22ed10-d745-4bce-b8bb-d1a1c54b73f9 admin admin] PATH_INFO: `/v3/projects/490e95f68c834ba9b6a52bd676e19e28` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:18.480858 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f22ed10-d745-4bce-b8bb-d1a1c54b73f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=490e95f68c834ba9b6a52bd676e19e28)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:18.483268 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f22ed10-d745-4bce-b8bb-d1a1c54b73f9 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:18.636759 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-8f22ed10-d745-4bce-b8bb-d1a1c54b73f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '490e95f68c834ba9b6a52bd676e19e28', 'request_id': 'req-8f22ed10-d745-4bce-b8bb-d1a1c54b73f9'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:18.711700 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-8f22ed10-d745-4bce-b8bb-d1a1c54b73f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '490e95f68c834ba9b6a52bd676e19e28', 'request_id': 'req-8f22ed10-d745-4bce-b8bb-d1a1c54b73f9'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:18.719253 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-8f22ed10-d745-4bce-b8bb-d1a1c54b73f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '490e95f68c834ba9b6a52bd676e19e28', 'request_id': 'req-8f22ed10-d745-4bce-b8bb-d1a1c54b73f9'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:18.730209 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-8f22ed10-d745-4bce-b8bb-d1a1c54b73f9 admin admin] The token cache is being invalidate because project 490e95f68c834ba9b6a52bd676e19e28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:38:18.730500 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-8f22ed10-d745-4bce-b8bb-d1a1c54b73f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:18.731185 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-8f22ed10-d745-4bce-b8bb-d1a1c54b73f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:18.733543 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1309/2619] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:38:18 2021] DELETE /identity/v3/projects/490e95f68c834ba9b6a52bd676e19e28 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:38:18.740969 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a162d2b4-8d2c-4bb1-b6ff-df19eaf3d974 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:18.741442 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a162d2b4-8d2c-4bb1-b6ff-df19eaf3d974 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:18.745204 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a162d2b4-8d2c-4bb1-b6ff-df19eaf3d974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:18.768722 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-a162d2b4-8d2c-4bb1-b6ff-df19eaf3d974 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:38:18.769943 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-a162d2b4-8d2c-4bb1-b6ff-df19eaf3d974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:18.829474 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1311/2620] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:38:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:38:18.837381 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29fa973-7104-4b6a-a859-b7b2529167fe None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:18.837665 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29fa973-7104-4b6a-a859-b7b2529167fe None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:18.837940 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29fa973-7104-4b6a-a859-b7b2529167fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:18.859891 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-b29fa973-7104-4b6a-a859-b7b2529167fe None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:38:18.859891 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-b29fa973-7104-4b6a-a859-b7b2529167fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:18.867064 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1310/2621] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:38:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:38:18.871117 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a162d2b4-8d2c-4bb1-b6ff-df19eaf3d974 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:18.881205 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a162d2b4-8d2c-4bb1-b6ff-df19eaf3d974 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:18.886010 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67b9098-1e4e-4662-af6d-44964e5e2e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:18.886856 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b9098-1e4e-4662-af6d-44964e5e2e11 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:18.887138 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b9098-1e4e-4662-af6d-44964e5e2e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:18.887490 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b9098-1e4e-4662-af6d-44964e5e2e11 admin admin] PATH_INFO: `/v3/domains` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:18.888330 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67b9098-1e4e-4662-af6d-44964e5e2e11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:38:18.888740 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67b9098-1e4e-4662-af6d-44964e5e2e11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:18.890368 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67b9098-1e4e-4662-af6d-44964e5e2e11 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:18.902533 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1312/2622] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 12 18:38:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:38:18.922040 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29fa973-7104-4b6a-a859-b7b2529167fe None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:18.931277 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29fa973-7104-4b6a-a859-b7b2529167fe None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:18.936102 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda54491-0a99-4bd3-b1e4-7616631688aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:18.936789 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda54491-0a99-4bd3-b1e4-7616631688aa admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:18.937065 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda54491-0a99-4bd3-b1e4-7616631688aa admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:18.937337 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda54491-0a99-4bd3-b1e4-7616631688aa admin admin] PATH_INFO: `/v3/projects` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:18.938028 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda54491-0a99-4bd3-b1e4-7616631688aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:18.939932 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda54491-0a99-4bd3-b1e4-7616631688aa admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:19.053986 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1311/2623] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:38:18 2021] POST /identity/v3/projects => generated 369 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:38:19.055132 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67b9098-1e4e-4662-af6d-44964e5e2e11 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:19.065194 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67b9098-1e4e-4662-af6d-44964e5e2e11 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:19.119512 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983e48b7-3abc-46fe-b933-f150ec19380a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:19.120101 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e48b7-3abc-46fe-b933-f150ec19380a admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:19.120381 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e48b7-3abc-46fe-b933-f150ec19380a admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:19.120700 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e48b7-3abc-46fe-b933-f150ec19380a admin admin] PATH_INFO: `/v3/users` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:19.121381 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983e48b7-3abc-46fe-b933-f150ec19380a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:19.123314 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983e48b7-3abc-46fe-b933-f150ec19380a admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:19.201857 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1313/2624] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:38:19 2021] POST /identity/v3/users => generated 285 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:38:19.205914 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda54491-0a99-4bd3-b1e4-7616631688aa admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:19.216496 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda54491-0a99-4bd3-b1e4-7616631688aa admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:19.221085 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53dbbfe-615d-431e-bc56-36ebbfea7757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:19.221757 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53dbbfe-615d-431e-bc56-36ebbfea7757 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:19.222011 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53dbbfe-615d-431e-bc56-36ebbfea7757 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:19.222280 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53dbbfe-615d-431e-bc56-36ebbfea7757 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:19.223002 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53dbbfe-615d-431e-bc56-36ebbfea7757 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:19.224608 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53dbbfe-615d-431e-bc56-36ebbfea7757 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:19.235350 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1312/2625] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:38:19 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:38:19.239339 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983e48b7-3abc-46fe-b933-f150ec19380a admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:19.249326 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983e48b7-3abc-46fe-b933-f150ec19380a admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:19.254151 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fa3f6f-b905-4ff0-af36-b1b6e9314df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:19.254809 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fa3f6f-b905-4ff0-af36-b1b6e9314df9 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:19.255095 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fa3f6f-b905-4ff0-af36-b1b6e9314df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:19.255435 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fa3f6f-b905-4ff0-af36-b1b6e9314df9 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:19.256172 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fa3f6f-b905-4ff0-af36-b1b6e9314df9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:19.257808 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fa3f6f-b905-4ff0-af36-b1b6e9314df9 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:19.268726 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1314/2626] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:38:19 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:38:19.276467 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53dbbfe-615d-431e-bc56-36ebbfea7757 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:19.287338 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53dbbfe-615d-431e-bc56-36ebbfea7757 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:19.292109 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbe1695-dde3-4b88-96e0-c34e82673d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:19.293106 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe1695-dde3-4b88-96e0-c34e82673d83 admin admin] REQUEST_METHOD: `PUT` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:19.293455 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe1695-dde3-4b88-96e0-c34e82673d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:19.293821 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe1695-dde3-4b88-96e0-c34e82673d83 admin admin] PATH_INFO: `/v3/projects/5704ac606c834a0b995679ab7eb7af86/users/56914835ae994a96b8162ed1ae8510e4/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:19.308066 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbe1695-dde3-4b88-96e0-c34e82673d83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5704ac606c834a0b995679ab7eb7af86, user_id=56914835ae994a96b8162ed1ae8510e4, role_id=33b8a5a8d1d643f2a98f598e6ab0a1cf)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:19.310965 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbe1695-dde3-4b88-96e0-c34e82673d83 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:19.448991 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1313/2627] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:38:19 2021] PUT /identity/v3/projects/5704ac606c834a0b995679ab7eb7af86/users/56914835ae994a96b8162ed1ae8510e4/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:38:19.454379 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa28ca2a-bedc-48bf-8144-1ff7a76f7658 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:19.454887 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa28ca2a-bedc-48bf-8144-1ff7a76f7658 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:19.455433 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa28ca2a-bedc-48bf-8144-1ff7a76f7658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:19.487558 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-aa28ca2a-bedc-48bf-8144-1ff7a76f7658 None None] MFA Rules not processed for user `56914835ae994a96b8162ed1ae8510e4`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:38:19.488962 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-aa28ca2a-bedc-48bf-8144-1ff7a76f7658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:19.555000 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1315/2628] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:38:19 2021] POST /identity/v3/auth/tokens => generated 3389 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:38:19.559300 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbe1695-dde3-4b88-96e0-c34e82673d83 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:19.620444 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbe1695-dde3-4b88-96e0-c34e82673d83 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:19.625915 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3998281b-8740-4762-b692-060d53ac60e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:19.626772 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3998281b-8740-4762-b692-060d53ac60e0 admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:19.627057 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3998281b-8740-4762-b692-060d53ac60e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:19.627337 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3998281b-8740-4762-b692-060d53ac60e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:19.628037 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3998281b-8740-4762-b692-060d53ac60e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:19.630016 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3998281b-8740-4762-b692-060d53ac60e0 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:19.726744 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1314/2629] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:38:19 2021] POST /identity/v3/projects => generated 367 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:38:19.727867 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa28ca2a-bedc-48bf-8144-1ff7a76f7658 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:19.744228 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa28ca2a-bedc-48bf-8144-1ff7a76f7658 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:19.804660 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daea1111-8650-46ee-aed5-43180eb06dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:19.805374 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea1111-8650-46ee-aed5-43180eb06dac admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:19.805658 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea1111-8650-46ee-aed5-43180eb06dac admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:19.805933 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea1111-8650-46ee-aed5-43180eb06dac admin admin] PATH_INFO: `/v3/users` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:19.806641 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daea1111-8650-46ee-aed5-43180eb06dac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:19.808643 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daea1111-8650-46ee-aed5-43180eb06dac admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:19.916796 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1316/2630] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:38:19 2021] POST /identity/v3/users => generated 290 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:38:19.921434 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3998281b-8740-4762-b692-060d53ac60e0 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:19.935979 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3998281b-8740-4762-b692-060d53ac60e0 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:19.940886 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4106c7-bedf-4c2c-89e8-30954b34369a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:19.941543 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4106c7-bedf-4c2c-89e8-30954b34369a admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:19.941863 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4106c7-bedf-4c2c-89e8-30954b34369a admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:19.942167 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4106c7-bedf-4c2c-89e8-30954b34369a admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:19.942877 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4106c7-bedf-4c2c-89e8-30954b34369a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:19.944642 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4106c7-bedf-4c2c-89e8-30954b34369a admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:19.955293 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1315/2631] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:38:19 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:38:19.959467 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daea1111-8650-46ee-aed5-43180eb06dac admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:19.970009 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daea1111-8650-46ee-aed5-43180eb06dac admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:19.974832 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c6210-fe39-4eb7-8d6a-ad20b20fb83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:19.975709 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c6210-fe39-4eb7-8d6a-ad20b20fb83a admin admin] REQUEST_METHOD: `PUT` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:19.975986 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c6210-fe39-4eb7-8d6a-ad20b20fb83a admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:19.976275 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c6210-fe39-4eb7-8d6a-ad20b20fb83a admin admin] PATH_INFO: `/v3/projects/b3de51660041445599daf374f80110e1/users/e519a0bd28aa44c695d68b804df110bf/roles/6c54f239944d46e3b027ccce97eb8b49` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:19.994541 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1c6210-fe39-4eb7-8d6a-ad20b20fb83a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3de51660041445599daf374f80110e1, user_id=e519a0bd28aa44c695d68b804df110bf, role_id=6c54f239944d46e3b027ccce97eb8b49)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:19.998344 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1c6210-fe39-4eb7-8d6a-ad20b20fb83a admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:20.089190 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1317/2632] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:38:19 2021] PUT /identity/v3/projects/b3de51660041445599daf374f80110e1/users/e519a0bd28aa44c695d68b804df110bf/roles/6c54f239944d46e3b027ccce97eb8b49 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:38:20.093161 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4106c7-bedf-4c2c-89e8-30954b34369a admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:20.102855 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4106c7-bedf-4c2c-89e8-30954b34369a admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:20.163347 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbd7bc6-52f6-4f47-a4c7-e5414e47a470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:20.164012 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd7bc6-52f6-4f47-a4c7-e5414e47a470 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:20.164325 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd7bc6-52f6-4f47-a4c7-e5414e47a470 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:20.164653 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd7bc6-52f6-4f47-a4c7-e5414e47a470 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:20.165354 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbd7bc6-52f6-4f47-a4c7-e5414e47a470 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:20.166972 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbd7bc6-52f6-4f47-a4c7-e5414e47a470 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:20.177116 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1316/2633] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:38:20 2021] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:38:20.181292 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c6210-fe39-4eb7-8d6a-ad20b20fb83a admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:20.191941 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c6210-fe39-4eb7-8d6a-ad20b20fb83a admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:20.196973 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35b3699-440b-4ea4-88c1-e8c6696a81ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:20.197881 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35b3699-440b-4ea4-88c1-e8c6696a81ef admin admin] REQUEST_METHOD: `PUT` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:20.198161 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35b3699-440b-4ea4-88c1-e8c6696a81ef admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:20.198433 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35b3699-440b-4ea4-88c1-e8c6696a81ef admin admin] PATH_INFO: `/v3/projects/b3de51660041445599daf374f80110e1/users/e519a0bd28aa44c695d68b804df110bf/roles/6c54f239944d46e3b027ccce97eb8b49` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:20.200505 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35b3699-440b-4ea4-88c1-e8c6696a81ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3de51660041445599daf374f80110e1, user_id=e519a0bd28aa44c695d68b804df110bf, role_id=6c54f239944d46e3b027ccce97eb8b49)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:20.203402 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35b3699-440b-4ea4-88c1-e8c6696a81ef admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:20.213507 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1318/2634] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:38:20 2021] PUT /identity/v3/projects/b3de51660041445599daf374f80110e1/users/e519a0bd28aa44c695d68b804df110bf/roles/6c54f239944d46e3b027ccce97eb8b49 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 18:38:20.225052 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10dbe1b-0e82-4488-bf4a-217270f1c6a3 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:20.225340 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10dbe1b-0e82-4488-bf4a-217270f1c6a3 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:20.225617 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10dbe1b-0e82-4488-bf4a-217270f1c6a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:20.252994 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-a10dbe1b-0e82-4488-bf4a-217270f1c6a3 None None] MFA Rules not processed for user `e519a0bd28aa44c695d68b804df110bf`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:38:20.254193 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-a10dbe1b-0e82-4488-bf4a-217270f1c6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:20.334628 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1317/2635] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:38:20 2021] POST /identity/v3/auth/tokens => generated 3454 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:38:20.346453 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35b3699-440b-4ea4-88c1-e8c6696a81ef admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:20.348152 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-a35b3699-440b-4ea4-88c1-e8c6696a81ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:20.402115 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35b3699-440b-4ea4-88c1-e8c6696a81ef admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:20.406559 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29416c4-0c87-4bc3-89ab-dc81645c74ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6966ce0774f4437a9b688494e9d0574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:20.407259 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29416c4-0c87-4bc3-89ab-dc81645c74ca service cinder] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:20.407540 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29416c4-0c87-4bc3-89ab-dc81645c74ca service cinder] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:20.407813 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29416c4-0c87-4bc3-89ab-dc81645c74ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:20.416962 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29416c4-0c87-4bc3-89ab-dc81645c74ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:20.418433 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29416c4-0c87-4bc3-89ab-dc81645c74ca service cinder] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:20.429761 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1319/2636] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:38:20 2021] GET /identity/v3/auth/tokens => generated 3454 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:38:23.617719 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10dbe1b-0e82-4488-bf4a-217270f1c6a3 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:23.684027 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10dbe1b-0e82-4488-bf4a-217270f1c6a3 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:23.688669 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa063708-0c73-4d46-af92-f71ad25b50d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:23.689543 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa063708-0c73-4d46-af92-f71ad25b50d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:23.689820 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa063708-0c73-4d46-af92-f71ad25b50d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:23.690100 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa063708-0c73-4d46-af92-f71ad25b50d5 admin admin] PATH_INFO: `/v3/users/56914835ae994a96b8162ed1ae8510e4` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:23.691585 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa063708-0c73-4d46-af92-f71ad25b50d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56914835ae994a96b8162ed1ae8510e4)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:23.693525 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa063708-0c73-4d46-af92-f71ad25b50d5 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:23.835759 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-aa063708-0c73-4d46-af92-f71ad25b50d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56914835ae994a96b8162ed1ae8510e4'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:23.846383 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-aa063708-0c73-4d46-af92-f71ad25b50d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56914835ae994a96b8162ed1ae8510e4'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:23.871612 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-aa063708-0c73-4d46-af92-f71ad25b50d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56914835ae994a96b8162ed1ae8510e4'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:23.956835 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-aa063708-0c73-4d46-af92-f71ad25b50d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56914835ae994a96b8162ed1ae8510e4'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:23.957405 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-aa063708-0c73-4d46-af92-f71ad25b50d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56914835ae994a96b8162ed1ae8510e4'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:23.963620 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1318/2637] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:38:23 2021] DELETE /identity/v3/users/56914835ae994a96b8162ed1ae8510e4 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:38:23.968094 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace22497-85c2-41e1-ab88-4b5ab7555b7b None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:23.968598 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace22497-85c2-41e1-ab88-4b5ab7555b7b None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:23.968711 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace22497-85c2-41e1-ab88-4b5ab7555b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:23.985828 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-ace22497-85c2-41e1-ab88-4b5ab7555b7b None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:38:23.987014 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-ace22497-85c2-41e1-ab88-4b5ab7555b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:24.048099 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1320/2638] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:38:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:38:24.056480 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa063708-0c73-4d46-af92-f71ad25b50d5 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:24.061608 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-aa063708-0c73-4d46-af92-f71ad25b50d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:24.076881 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace22497-85c2-41e1-ab88-4b5ab7555b7b None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:24.078267 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-ace22497-85c2-41e1-ab88-4b5ab7555b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:24.116204 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa063708-0c73-4d46-af92-f71ad25b50d5 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:24.119914 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51116c6-9ccc-4df0-b89b-36d54c4bbe32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:24.120590 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51116c6-9ccc-4df0-b89b-36d54c4bbe32 service neutron] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:24.120879 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51116c6-9ccc-4df0-b89b-36d54c4bbe32 service neutron] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:24.121152 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51116c6-9ccc-4df0-b89b-36d54c4bbe32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:24.130677 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51116c6-9ccc-4df0-b89b-36d54c4bbe32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:24.132126 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51116c6-9ccc-4df0-b89b-36d54c4bbe32 service neutron] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:24.134749 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace22497-85c2-41e1-ab88-4b5ab7555b7b None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:24.138579 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584fd2b2-3e17-41c7-98f6-b211503e4531 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:24.139229 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584fd2b2-3e17-41c7-98f6-b211503e4531 service neutron] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:24.139515 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584fd2b2-3e17-41c7-98f6-b211503e4531 service neutron] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:24.139795 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584fd2b2-3e17-41c7-98f6-b211503e4531 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:24.142092 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1319/2639] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:38:24 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 18:38:24.142226 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-584fd2b2-3e17-41c7-98f6-b211503e4531 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:24.154597 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584fd2b2-3e17-41c7-98f6-b211503e4531 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:24.156310 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584fd2b2-3e17-41c7-98f6-b211503e4531 service neutron] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:24.165978 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1321/2640] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:38:24 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 18:38:24.634692 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51116c6-9ccc-4df0-b89b-36d54c4bbe32 service neutron] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:24.636431 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-b51116c6-9ccc-4df0-b89b-36d54c4bbe32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:24.650862 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51116c6-9ccc-4df0-b89b-36d54c4bbe32 service neutron] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:24.656113 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3adbca6-559f-4635-baab-a82ab38b1205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:24.657054 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3adbca6-559f-4635-baab-a82ab38b1205 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:24.657334 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3adbca6-559f-4635-baab-a82ab38b1205 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:24.657604 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3adbca6-559f-4635-baab-a82ab38b1205 admin admin] PATH_INFO: `/v3/projects/5704ac606c834a0b995679ab7eb7af86` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:24.658907 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3adbca6-559f-4635-baab-a82ab38b1205 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5704ac606c834a0b995679ab7eb7af86)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:24.660846 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3adbca6-559f-4635-baab-a82ab38b1205 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:24.768788 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-c3adbca6-559f-4635-baab-a82ab38b1205 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5704ac606c834a0b995679ab7eb7af86', 'request_id': 'req-c3adbca6-559f-4635-baab-a82ab38b1205'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:24.835443 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-c3adbca6-559f-4635-baab-a82ab38b1205 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5704ac606c834a0b995679ab7eb7af86', 'request_id': 'req-c3adbca6-559f-4635-baab-a82ab38b1205'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:24.842532 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-c3adbca6-559f-4635-baab-a82ab38b1205 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5704ac606c834a0b995679ab7eb7af86', 'request_id': 'req-c3adbca6-559f-4635-baab-a82ab38b1205'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:24.852906 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-c3adbca6-559f-4635-baab-a82ab38b1205 admin admin] The token cache is being invalidate because project 5704ac606c834a0b995679ab7eb7af86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:38:24.853194 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-c3adbca6-559f-4635-baab-a82ab38b1205 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:24.853836 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-c3adbca6-559f-4635-baab-a82ab38b1205 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:24.855404 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1320/2641] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:38:24 2021] DELETE /identity/v3/projects/5704ac606c834a0b995679ab7eb7af86 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:38:24.859611 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584fd2b2-3e17-41c7-98f6-b211503e4531 service neutron] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:24.869268 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584fd2b2-3e17-41c7-98f6-b211503e4531 service neutron] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:24.929604 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4417a346-09c2-4f89-a094-f48f886bdfb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:24.930806 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4417a346-09c2-4f89-a094-f48f886bdfb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:24.931644 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4417a346-09c2-4f89-a094-f48f886bdfb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:24.931644 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4417a346-09c2-4f89-a094-f48f886bdfb4 admin admin] PATH_INFO: `/v3/users/e519a0bd28aa44c695d68b804df110bf` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:24.932962 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4417a346-09c2-4f89-a094-f48f886bdfb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e519a0bd28aa44c695d68b804df110bf)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:24.937085 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4417a346-09c2-4f89-a094-f48f886bdfb4 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:25.226497 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-4417a346-09c2-4f89-a094-f48f886bdfb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e519a0bd28aa44c695d68b804df110bf'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:25.227152 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-4417a346-09c2-4f89-a094-f48f886bdfb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e519a0bd28aa44c695d68b804df110bf'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:25.239074 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-4417a346-09c2-4f89-a094-f48f886bdfb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e519a0bd28aa44c695d68b804df110bf'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:25.239713 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-4417a346-09c2-4f89-a094-f48f886bdfb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e519a0bd28aa44c695d68b804df110bf'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:25.247060 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-4417a346-09c2-4f89-a094-f48f886bdfb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e519a0bd28aa44c695d68b804df110bf'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:25.327721 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1322/2642] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:38:24 2021] DELETE /identity/v3/users/e519a0bd28aa44c695d68b804df110bf => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:38:25.914255 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3adbca6-559f-4635-baab-a82ab38b1205 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:25.915779 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-c3adbca6-559f-4635-baab-a82ab38b1205 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:25.946290 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3adbca6-559f-4635-baab-a82ab38b1205 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:26.012772 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b60ecf2-27b7-4235-88e6-50d48afd62db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:26.013638 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60ecf2-27b7-4235-88e6-50d48afd62db admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:26.013914 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60ecf2-27b7-4235-88e6-50d48afd62db admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:26.014186 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60ecf2-27b7-4235-88e6-50d48afd62db admin admin] PATH_INFO: `/v3/projects/b3de51660041445599daf374f80110e1` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:26.015404 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b60ecf2-27b7-4235-88e6-50d48afd62db admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3de51660041445599daf374f80110e1)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:26.017846 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b60ecf2-27b7-4235-88e6-50d48afd62db admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:26.107207 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-2b60ecf2-27b7-4235-88e6-50d48afd62db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3de51660041445599daf374f80110e1', 'request_id': 'req-2b60ecf2-27b7-4235-88e6-50d48afd62db'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:26.183653 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-2b60ecf2-27b7-4235-88e6-50d48afd62db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3de51660041445599daf374f80110e1', 'request_id': 'req-2b60ecf2-27b7-4235-88e6-50d48afd62db'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:26.196418 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-2b60ecf2-27b7-4235-88e6-50d48afd62db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3de51660041445599daf374f80110e1', 'request_id': 'req-2b60ecf2-27b7-4235-88e6-50d48afd62db'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:26.213003 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-2b60ecf2-27b7-4235-88e6-50d48afd62db admin admin] The token cache is being invalidate because project b3de51660041445599daf374f80110e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:38:26.213300 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-2b60ecf2-27b7-4235-88e6-50d48afd62db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:26.213980 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-2b60ecf2-27b7-4235-88e6-50d48afd62db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:26.216085 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1321/2643] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:38:25 2021] DELETE /identity/v3/projects/b3de51660041445599daf374f80110e1 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:38:26.221820 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d7e29-f92b-475e-8de9-d493b2cb8950 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:26.222110 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d7e29-f92b-475e-8de9-d493b2cb8950 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:26.222422 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d7e29-f92b-475e-8de9-d493b2cb8950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:26.245790 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-a96d7e29-f92b-475e-8de9-d493b2cb8950 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:38:26.248067 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-a96d7e29-f92b-475e-8de9-d493b2cb8950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:26.332714 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1323/2644] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:38:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:38:26.336923 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a51e2c-df8e-435a-a31f-94d8e2a4dd09 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:26.337203 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a51e2c-df8e-435a-a31f-94d8e2a4dd09 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:26.337761 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a51e2c-df8e-435a-a31f-94d8e2a4dd09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:26.362252 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-a8a51e2c-df8e-435a-a31f-94d8e2a4dd09 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:38:26.363418 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-a8a51e2c-df8e-435a-a31f-94d8e2a4dd09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:26.372554 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1322/2645] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:38:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:38:26.376938 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d7e29-f92b-475e-8de9-d493b2cb8950 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:26.389240 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d7e29-f92b-475e-8de9-d493b2cb8950 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:26.395977 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e694cc4-cbb3-43f9-b6da-cca905625be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:26.396773 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e694cc4-cbb3-43f9-b6da-cca905625be4 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:26.397180 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e694cc4-cbb3-43f9-b6da-cca905625be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:26.397463 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e694cc4-cbb3-43f9-b6da-cca905625be4 admin admin] PATH_INFO: `/v3/domains` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:26.398214 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e694cc4-cbb3-43f9-b6da-cca905625be4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:38:26.398524 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e694cc4-cbb3-43f9-b6da-cca905625be4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:26.402077 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e694cc4-cbb3-43f9-b6da-cca905625be4 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:26.415971 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1324/2646] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 12 18:38:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:38:26.420797 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a51e2c-df8e-435a-a31f-94d8e2a4dd09 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:26.430326 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a51e2c-df8e-435a-a31f-94d8e2a4dd09 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:26.435802 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b11f61d-cdd0-46a6-9d5b-8f65b3480a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:26.437486 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b11f61d-cdd0-46a6-9d5b-8f65b3480a2e admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:26.438389 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b11f61d-cdd0-46a6-9d5b-8f65b3480a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:26.438783 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b11f61d-cdd0-46a6-9d5b-8f65b3480a2e admin admin] PATH_INFO: `/v3/projects` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:26.439611 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b11f61d-cdd0-46a6-9d5b-8f65b3480a2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:26.441711 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b11f61d-cdd0-46a6-9d5b-8f65b3480a2e admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:26.559442 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1323/2647] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:38:26 2021] POST /identity/v3/projects => generated 379 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:38:26.562479 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e694cc4-cbb3-43f9-b6da-cca905625be4 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:26.573407 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e694cc4-cbb3-43f9-b6da-cca905625be4 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:26.632595 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c06f670-c5df-4c96-be71-233c945dca7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:26.633283 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c06f670-c5df-4c96-be71-233c945dca7b admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:26.633649 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c06f670-c5df-4c96-be71-233c945dca7b admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:26.633933 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c06f670-c5df-4c96-be71-233c945dca7b admin admin] PATH_INFO: `/v3/users` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:26.634640 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c06f670-c5df-4c96-be71-233c945dca7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:26.637163 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c06f670-c5df-4c96-be71-233c945dca7b admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:26.771720 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1325/2648] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:38:26 2021] POST /identity/v3/users => generated 290 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:38:26.772984 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b11f61d-cdd0-46a6-9d5b-8f65b3480a2e admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:26.783539 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b11f61d-cdd0-46a6-9d5b-8f65b3480a2e admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:26.788115 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9cf7de-e25e-419c-b80b-aa8db2f670a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:26.788807 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9cf7de-e25e-419c-b80b-aa8db2f670a9 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:26.789088 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9cf7de-e25e-419c-b80b-aa8db2f670a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:26.789367 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9cf7de-e25e-419c-b80b-aa8db2f670a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:26.790100 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9cf7de-e25e-419c-b80b-aa8db2f670a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:26.791779 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9cf7de-e25e-419c-b80b-aa8db2f670a9 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:26.805686 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1324/2649] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:38:26 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:38:26.810930 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c06f670-c5df-4c96-be71-233c945dca7b admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:26.817246 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c06f670-c5df-4c96-be71-233c945dca7b admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:26.821880 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a807454-fd21-4277-9d3e-b53ec9599b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:26.822528 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a807454-fd21-4277-9d3e-b53ec9599b74 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:26.822810 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a807454-fd21-4277-9d3e-b53ec9599b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:26.823086 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a807454-fd21-4277-9d3e-b53ec9599b74 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:26.823873 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a807454-fd21-4277-9d3e-b53ec9599b74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:26.825505 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a807454-fd21-4277-9d3e-b53ec9599b74 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:26.835685 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1326/2650] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:38:26 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:38:26.839995 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9cf7de-e25e-419c-b80b-aa8db2f670a9 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:26.849904 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9cf7de-e25e-419c-b80b-aa8db2f670a9 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:26.854449 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e0bdd4-640c-4d99-924b-c60e8f2b4b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:26.855318 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e0bdd4-640c-4d99-924b-c60e8f2b4b7a admin admin] REQUEST_METHOD: `PUT` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:26.855599 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e0bdd4-640c-4d99-924b-c60e8f2b4b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:26.855870 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e0bdd4-640c-4d99-924b-c60e8f2b4b7a admin admin] PATH_INFO: `/v3/projects/9d50a2328d8545ecae7865f2d0686e3d/users/b7f421d2079c4643a316227d517a8a36/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:26.870307 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e0bdd4-640c-4d99-924b-c60e8f2b4b7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d50a2328d8545ecae7865f2d0686e3d, user_id=b7f421d2079c4643a316227d517a8a36, role_id=33b8a5a8d1d643f2a98f598e6ab0a1cf)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:26.873003 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e0bdd4-640c-4d99-924b-c60e8f2b4b7a admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:27.020018 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1325/2651] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:38:26 2021] PUT /identity/v3/projects/9d50a2328d8545ecae7865f2d0686e3d/users/b7f421d2079c4643a316227d517a8a36/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:38:27.034419 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2761a373-994b-4179-82bd-31198059f640 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:27.034705 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2761a373-994b-4179-82bd-31198059f640 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:27.035044 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2761a373-994b-4179-82bd-31198059f640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:27.061511 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-2761a373-994b-4179-82bd-31198059f640 None None] MFA Rules not processed for user `b7f421d2079c4643a316227d517a8a36`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:38:27.062736 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-2761a373-994b-4179-82bd-31198059f640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:27.125532 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1327/2652] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:38:27 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:38:27.130019 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e0bdd4-640c-4d99-924b-c60e8f2b4b7a admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:27.189992 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e0bdd4-640c-4d99-924b-c60e8f2b4b7a admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:27.194715 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091f771b-1172-4fec-b6aa-be12fc32fc25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:27.195366 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f771b-1172-4fec-b6aa-be12fc32fc25 admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:27.195646 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f771b-1172-4fec-b6aa-be12fc32fc25 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:27.195920 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f771b-1172-4fec-b6aa-be12fc32fc25 admin admin] PATH_INFO: `/v3/projects` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:27.196658 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091f771b-1172-4fec-b6aa-be12fc32fc25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:27.198555 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091f771b-1172-4fec-b6aa-be12fc32fc25 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:27.283734 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1326/2653] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:38:27 2021] POST /identity/v3/projects => generated 377 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:38:27.284684 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2761a373-994b-4179-82bd-31198059f640 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:27.296344 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2761a373-994b-4179-82bd-31198059f640 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:27.380187 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1675772e-7b36-4f04-b434-b05a303afc28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:27.381065 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1675772e-7b36-4f04-b434-b05a303afc28 admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:27.381455 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1675772e-7b36-4f04-b434-b05a303afc28 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:27.381837 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1675772e-7b36-4f04-b434-b05a303afc28 admin admin] PATH_INFO: `/v3/users` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:27.382678 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1675772e-7b36-4f04-b434-b05a303afc28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:27.384763 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1675772e-7b36-4f04-b434-b05a303afc28 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:27.517552 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1328/2654] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:38:27 2021] POST /identity/v3/users => generated 289 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:38:27.521495 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091f771b-1172-4fec-b6aa-be12fc32fc25 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:27.533540 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091f771b-1172-4fec-b6aa-be12fc32fc25 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:27.538549 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef09cfe-b210-4a7a-a623-903f1cb3949c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:27.539248 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef09cfe-b210-4a7a-a623-903f1cb3949c admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:27.539768 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef09cfe-b210-4a7a-a623-903f1cb3949c admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:27.539901 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef09cfe-b210-4a7a-a623-903f1cb3949c admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:27.540624 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef09cfe-b210-4a7a-a623-903f1cb3949c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:27.542231 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef09cfe-b210-4a7a-a623-903f1cb3949c admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:27.552740 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1327/2655] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:38:27 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:38:27.556732 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1675772e-7b36-4f04-b434-b05a303afc28 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:27.566616 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1675772e-7b36-4f04-b434-b05a303afc28 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:27.593957 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0826834-0c11-4037-8396-e36f9257389a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:27.595410 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0826834-0c11-4037-8396-e36f9257389a admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:27.595723 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0826834-0c11-4037-8396-e36f9257389a admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:27.596111 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0826834-0c11-4037-8396-e36f9257389a admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:27.596994 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0826834-0c11-4037-8396-e36f9257389a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:27.599126 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0826834-0c11-4037-8396-e36f9257389a admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:27.616489 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1329/2656] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:38:27 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:38:27.620194 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef09cfe-b210-4a7a-a623-903f1cb3949c admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:27.636224 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef09cfe-b210-4a7a-a623-903f1cb3949c admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:27.642360 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a893c1a-cb06-424f-8e41-0cce5d256beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:27.643562 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a893c1a-cb06-424f-8e41-0cce5d256beb admin admin] REQUEST_METHOD: `PUT` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:27.644015 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a893c1a-cb06-424f-8e41-0cce5d256beb admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:27.644519 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a893c1a-cb06-424f-8e41-0cce5d256beb admin admin] PATH_INFO: `/v3/projects/6cf40163e5cb492597ee17536869e9e6/users/1f15a4975f6942538d2fc0c3d448bac0/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:27.686354 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a893c1a-cb06-424f-8e41-0cce5d256beb admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cf40163e5cb492597ee17536869e9e6, user_id=1f15a4975f6942538d2fc0c3d448bac0, role_id=33b8a5a8d1d643f2a98f598e6ab0a1cf)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:27.689715 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a893c1a-cb06-424f-8e41-0cce5d256beb admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:27.780643 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1328/2657] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:38:27 2021] PUT /identity/v3/projects/6cf40163e5cb492597ee17536869e9e6/users/1f15a4975f6942538d2fc0c3d448bac0/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:38:27.792169 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da80c8a0-6dbf-4a1c-bf6c-e02142dec2dc None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:27.792486 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da80c8a0-6dbf-4a1c-bf6c-e02142dec2dc None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:27.792762 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da80c8a0-6dbf-4a1c-bf6c-e02142dec2dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:27.828143 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-da80c8a0-6dbf-4a1c-bf6c-e02142dec2dc None None] MFA Rules not processed for user `1f15a4975f6942538d2fc0c3d448bac0`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:38:27.830288 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-da80c8a0-6dbf-4a1c-bf6c-e02142dec2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:27.907395 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1330/2658] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:38:27 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:38:27.911783 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a893c1a-cb06-424f-8e41-0cce5d256beb admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:27.979466 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a893c1a-cb06-424f-8e41-0cce5d256beb admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:27.984320 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e01689-e255-4512-ae8d-440b40b255ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:27.985533 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e01689-e255-4512-ae8d-440b40b255ec admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:27.986384 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e01689-e255-4512-ae8d-440b40b255ec admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:27.986384 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e01689-e255-4512-ae8d-440b40b255ec admin admin] PATH_INFO: `/v3/projects` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:27.986926 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e01689-e255-4512-ae8d-440b40b255ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:27.988849 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e01689-e255-4512-ae8d-440b40b255ec admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:28.127616 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1329/2659] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:38:27 2021] POST /identity/v3/projects => generated 379 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:38:28.128752 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da80c8a0-6dbf-4a1c-bf6c-e02142dec2dc None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:28.139711 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da80c8a0-6dbf-4a1c-bf6c-e02142dec2dc None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:28.196432 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d69516-c3c7-4ef9-819a-ab9213e117cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:28.197163 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d69516-c3c7-4ef9-819a-ab9213e117cd admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:28.197451 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d69516-c3c7-4ef9-819a-ab9213e117cd admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:28.197722 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d69516-c3c7-4ef9-819a-ab9213e117cd admin admin] PATH_INFO: `/v3/users` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:28.198426 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d69516-c3c7-4ef9-819a-ab9213e117cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:28.200342 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d69516-c3c7-4ef9-819a-ab9213e117cd admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:28.302179 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1331/2660] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:38:28 2021] POST /identity/v3/users => generated 296 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:38:28.305031 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e01689-e255-4512-ae8d-440b40b255ec admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:28.316152 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e01689-e255-4512-ae8d-440b40b255ec admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:28.320913 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa05a91-b1a6-4fd2-a7ca-175305d99e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:28.321574 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa05a91-b1a6-4fd2-a7ca-175305d99e8a admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:28.321857 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa05a91-b1a6-4fd2-a7ca-175305d99e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:28.322152 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa05a91-b1a6-4fd2-a7ca-175305d99e8a admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:28.322878 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa05a91-b1a6-4fd2-a7ca-175305d99e8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:28.324515 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa05a91-b1a6-4fd2-a7ca-175305d99e8a admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:28.335400 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1330/2661] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:38:28 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:38:28.339458 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d69516-c3c7-4ef9-819a-ab9213e117cd admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:28.350476 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d69516-c3c7-4ef9-819a-ab9213e117cd admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:28.355168 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8299d2-6c73-4b22-aabb-a29fc3524e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:28.356050 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8299d2-6c73-4b22-aabb-a29fc3524e0d admin admin] REQUEST_METHOD: `PUT` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:28.360221 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8299d2-6c73-4b22-aabb-a29fc3524e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:28.360221 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8299d2-6c73-4b22-aabb-a29fc3524e0d admin admin] PATH_INFO: `/v3/projects/f29065617d854f0a991f8d5e056a5323/users/d89aff9af80c4bc4bd3f3f37e9cb5cd2/roles/6c54f239944d46e3b027ccce97eb8b49` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:28.371407 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8299d2-6c73-4b22-aabb-a29fc3524e0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f29065617d854f0a991f8d5e056a5323, user_id=d89aff9af80c4bc4bd3f3f37e9cb5cd2, role_id=6c54f239944d46e3b027ccce97eb8b49)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:28.374327 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8299d2-6c73-4b22-aabb-a29fc3524e0d admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:28.436184 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1332/2662] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:38:28 2021] PUT /identity/v3/projects/f29065617d854f0a991f8d5e056a5323/users/d89aff9af80c4bc4bd3f3f37e9cb5cd2/roles/6c54f239944d46e3b027ccce97eb8b49 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:38:28.440274 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa05a91-b1a6-4fd2-a7ca-175305d99e8a admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:28.451065 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa05a91-b1a6-4fd2-a7ca-175305d99e8a admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:28.508034 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8b54b5-1ab2-469f-a3e5-52eec8072487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:28.508797 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b54b5-1ab2-469f-a3e5-52eec8072487 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:28.509079 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b54b5-1ab2-469f-a3e5-52eec8072487 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:28.509354 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b54b5-1ab2-469f-a3e5-52eec8072487 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:28.510173 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8b54b5-1ab2-469f-a3e5-52eec8072487 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:28.511858 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8b54b5-1ab2-469f-a3e5-52eec8072487 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:28.525115 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1331/2663] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:38:28 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:38:28.526333 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8299d2-6c73-4b22-aabb-a29fc3524e0d admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:28.537356 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8299d2-6c73-4b22-aabb-a29fc3524e0d admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:28.546824 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9735cf9-4f3a-4ff6-89d3-5a815f7c5ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:28.546824 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9735cf9-4f3a-4ff6-89d3-5a815f7c5ecd admin admin] REQUEST_METHOD: `PUT` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:28.546824 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9735cf9-4f3a-4ff6-89d3-5a815f7c5ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:28.546824 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9735cf9-4f3a-4ff6-89d3-5a815f7c5ecd admin admin] PATH_INFO: `/v3/projects/f29065617d854f0a991f8d5e056a5323/users/d89aff9af80c4bc4bd3f3f37e9cb5cd2/roles/6c54f239944d46e3b027ccce97eb8b49` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:28.547319 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9735cf9-4f3a-4ff6-89d3-5a815f7c5ecd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f29065617d854f0a991f8d5e056a5323, user_id=d89aff9af80c4bc4bd3f3f37e9cb5cd2, role_id=6c54f239944d46e3b027ccce97eb8b49)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:28.550072 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9735cf9-4f3a-4ff6-89d3-5a815f7c5ecd admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:28.561040 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1333/2664] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:38:28 2021] PUT /identity/v3/projects/f29065617d854f0a991f8d5e056a5323/users/d89aff9af80c4bc4bd3f3f37e9cb5cd2/roles/6c54f239944d46e3b027ccce97eb8b49 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:38:28.571313 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90f4a77-459c-4d61-8363-03ebe6e0d691 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:28.571605 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90f4a77-459c-4d61-8363-03ebe6e0d691 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:28.571887 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90f4a77-459c-4d61-8363-03ebe6e0d691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:28.598786 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-f90f4a77-459c-4d61-8363-03ebe6e0d691 None None] MFA Rules not processed for user `d89aff9af80c4bc4bd3f3f37e9cb5cd2`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:38:28.600016 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-f90f4a77-459c-4d61-8363-03ebe6e0d691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:28.667819 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1332/2665] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:38:28 2021] POST /identity/v3/auth/tokens => generated 3466 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:38:28.679667 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9735cf9-4f3a-4ff6-89d3-5a815f7c5ecd admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:28.681485 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-c9735cf9-4f3a-4ff6-89d3-5a815f7c5ecd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:28.737247 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9735cf9-4f3a-4ff6-89d3-5a815f7c5ecd admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:28.741059 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa64b0f-7c2e-45ff-9bf2-29ba93a8f2c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6966ce0774f4437a9b688494e9d0574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:28.741858 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa64b0f-7c2e-45ff-9bf2-29ba93a8f2c8 service cinder] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:28.742144 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa64b0f-7c2e-45ff-9bf2-29ba93a8f2c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:28.742505 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa64b0f-7c2e-45ff-9bf2-29ba93a8f2c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:28.752075 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa64b0f-7c2e-45ff-9bf2-29ba93a8f2c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:28.753609 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa64b0f-7c2e-45ff-9bf2-29ba93a8f2c8 service cinder] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:28.772610 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1334/2666] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:38:28 2021] GET /identity/v3/auth/tokens => generated 3466 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:38:28.904550 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90f4a77-459c-4d61-8363-03ebe6e0d691 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:28.909187 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-f90f4a77-459c-4d61-8363-03ebe6e0d691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:28.918891 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90f4a77-459c-4d61-8363-03ebe6e0d691 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:28.922499 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254fed8-ddbe-427f-ba7a-4b3ef5b99cad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6966ce0774f4437a9b688494e9d0574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:28.923185 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254fed8-ddbe-427f-ba7a-4b3ef5b99cad service cinder] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:28.923460 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254fed8-ddbe-427f-ba7a-4b3ef5b99cad service cinder] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:28.923783 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254fed8-ddbe-427f-ba7a-4b3ef5b99cad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:28.982060 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9254fed8-ddbe-427f-ba7a-4b3ef5b99cad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:28.983522 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9254fed8-ddbe-427f-ba7a-4b3ef5b99cad service cinder] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:28.992493 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1333/2667] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:38:28 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:38:29.777509 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa64b0f-7c2e-45ff-9bf2-29ba93a8f2c8 service cinder] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:29.780420 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-4aa64b0f-7c2e-45ff-9bf2-29ba93a8f2c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:29.882816 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa64b0f-7c2e-45ff-9bf2-29ba93a8f2c8 service cinder] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:29.888304 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d0fbb1-afb3-4827-bd42-79f8f33d915b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:29.889511 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d0fbb1-afb3-4827-bd42-79f8f33d915b admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:29.889907 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d0fbb1-afb3-4827-bd42-79f8f33d915b admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:29.890251 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d0fbb1-afb3-4827-bd42-79f8f33d915b admin admin] PATH_INFO: `/v3/users/a4e3b0cd87c249309442917e56cd689c` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:29.891695 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d0fbb1-afb3-4827-bd42-79f8f33d915b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4e3b0cd87c249309442917e56cd689c)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:29.893831 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d0fbb1-afb3-4827-bd42-79f8f33d915b admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:30.075521 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-53d0fbb1-afb3-4827-bd42-79f8f33d915b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4e3b0cd87c249309442917e56cd689c'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:30.076261 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-53d0fbb1-afb3-4827-bd42-79f8f33d915b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4e3b0cd87c249309442917e56cd689c'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:30.091166 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-53d0fbb1-afb3-4827-bd42-79f8f33d915b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4e3b0cd87c249309442917e56cd689c'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:30.091903 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-53d0fbb1-afb3-4827-bd42-79f8f33d915b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4e3b0cd87c249309442917e56cd689c'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:30.100633 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-53d0fbb1-afb3-4827-bd42-79f8f33d915b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4e3b0cd87c249309442917e56cd689c'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:30.188568 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1335/2668] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:38:29 2021] DELETE /identity/v3/users/a4e3b0cd87c249309442917e56cd689c => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:38:30.190518 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e6ba22-8778-4d93-b890-900f659d3091 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:30.190987 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e6ba22-8778-4d93-b890-900f659d3091 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:30.191612 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e6ba22-8778-4d93-b890-900f659d3091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:30.210826 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-01e6ba22-8778-4d93-b890-900f659d3091 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:38:30.212050 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-01e6ba22-8778-4d93-b890-900f659d3091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:30.283074 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1334/2669] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:38:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:38:30.296671 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d0fbb1-afb3-4827-bd42-79f8f33d915b admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:30.298413 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-53d0fbb1-afb3-4827-bd42-79f8f33d915b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:30.363148 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d0fbb1-afb3-4827-bd42-79f8f33d915b admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:30.366859 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a4fcb4-9b10-468a-9ef9-a71eb98e2cc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:30.367511 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4fcb4-9b10-468a-9ef9-a71eb98e2cc7 service neutron] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:30.367794 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4fcb4-9b10-468a-9ef9-a71eb98e2cc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:30.368068 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4fcb4-9b10-468a-9ef9-a71eb98e2cc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:30.377526 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a4fcb4-9b10-468a-9ef9-a71eb98e2cc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:30.378980 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a4fcb4-9b10-468a-9ef9-a71eb98e2cc7 service neutron] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:30.388935 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1336/2670] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:38:30 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 18:38:30.861286 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e6ba22-8778-4d93-b890-900f659d3091 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:30.862816 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-01e6ba22-8778-4d93-b890-900f659d3091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:30.876044 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e6ba22-8778-4d93-b890-900f659d3091 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:30.881295 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a56da-befd-409c-8980-b1178e45a314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:30.882437 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a56da-befd-409c-8980-b1178e45a314 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:30.882911 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a56da-befd-409c-8980-b1178e45a314 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:30.883376 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a56da-befd-409c-8980-b1178e45a314 admin admin] PATH_INFO: `/v3/projects/9f85299ab4e14a9eb3ce3c75aef40697` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:30.884926 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29a56da-befd-409c-8980-b1178e45a314 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f85299ab4e14a9eb3ce3c75aef40697)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:30.887034 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29a56da-befd-409c-8980-b1178e45a314 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:31.144507 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-a29a56da-befd-409c-8980-b1178e45a314 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f85299ab4e14a9eb3ce3c75aef40697', 'request_id': 'req-a29a56da-befd-409c-8980-b1178e45a314'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:31.231406 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-a29a56da-befd-409c-8980-b1178e45a314 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f85299ab4e14a9eb3ce3c75aef40697', 'request_id': 'req-a29a56da-befd-409c-8980-b1178e45a314'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:31.239177 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-a29a56da-befd-409c-8980-b1178e45a314 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f85299ab4e14a9eb3ce3c75aef40697', 'request_id': 'req-a29a56da-befd-409c-8980-b1178e45a314'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:31.253371 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-a29a56da-befd-409c-8980-b1178e45a314 admin admin] The token cache is being invalidate because project 9f85299ab4e14a9eb3ce3c75aef40697 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:38:31.253862 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-a29a56da-befd-409c-8980-b1178e45a314 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:31.254737 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-a29a56da-befd-409c-8980-b1178e45a314 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:31.256849 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1335/2671] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:38:30 2021] DELETE /identity/v3/projects/9f85299ab4e14a9eb3ce3c75aef40697 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:38:31.260618 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a4fcb4-9b10-468a-9ef9-a71eb98e2cc7 service neutron] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:31.271506 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a4fcb4-9b10-468a-9ef9-a71eb98e2cc7 service neutron] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:31.388347 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc97ae4-c16c-43d9-81b5-2ef6f843be19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:31.389258 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc97ae4-c16c-43d9-81b5-2ef6f843be19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:31.389535 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc97ae4-c16c-43d9-81b5-2ef6f843be19 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:31.389806 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc97ae4-c16c-43d9-81b5-2ef6f843be19 admin admin] PATH_INFO: `/v3/users/40c2b4e51dae475bb93d5f7017f549ea` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:31.391197 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc97ae4-c16c-43d9-81b5-2ef6f843be19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40c2b4e51dae475bb93d5f7017f549ea)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:31.400075 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc97ae4-c16c-43d9-81b5-2ef6f843be19 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:31.648296 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-6bc97ae4-c16c-43d9-81b5-2ef6f843be19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40c2b4e51dae475bb93d5f7017f549ea'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:31.649442 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-6bc97ae4-c16c-43d9-81b5-2ef6f843be19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40c2b4e51dae475bb93d5f7017f549ea'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:31.668773 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-6bc97ae4-c16c-43d9-81b5-2ef6f843be19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40c2b4e51dae475bb93d5f7017f549ea'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:31.669502 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-6bc97ae4-c16c-43d9-81b5-2ef6f843be19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40c2b4e51dae475bb93d5f7017f549ea'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:31.679487 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-6bc97ae4-c16c-43d9-81b5-2ef6f843be19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40c2b4e51dae475bb93d5f7017f549ea'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:31.755274 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1337/2672] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:38:31 2021] DELETE /identity/v3/users/40c2b4e51dae475bb93d5f7017f549ea => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:38:31.980126 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a56da-befd-409c-8980-b1178e45a314 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:31.981695 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-a29a56da-befd-409c-8980-b1178e45a314 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:32.002058 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a56da-befd-409c-8980-b1178e45a314 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:32.057075 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db7858-6d2e-40dc-a8c1-021018fec9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:32.057944 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db7858-6d2e-40dc-a8c1-021018fec9bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:32.058235 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db7858-6d2e-40dc-a8c1-021018fec9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:32.058500 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db7858-6d2e-40dc-a8c1-021018fec9bb admin admin] PATH_INFO: `/v3/users/9a37985dd5034ceeabfa47797efba5a1` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:32.074431 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7db7858-6d2e-40dc-a8c1-021018fec9bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a37985dd5034ceeabfa47797efba5a1)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:32.076682 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7db7858-6d2e-40dc-a8c1-021018fec9bb admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:32.267413 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-d7db7858-6d2e-40dc-a8c1-021018fec9bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a37985dd5034ceeabfa47797efba5a1'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:32.274687 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-d7db7858-6d2e-40dc-a8c1-021018fec9bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a37985dd5034ceeabfa47797efba5a1'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:32.287297 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-d7db7858-6d2e-40dc-a8c1-021018fec9bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a37985dd5034ceeabfa47797efba5a1'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:32.402275 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-d7db7858-6d2e-40dc-a8c1-021018fec9bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a37985dd5034ceeabfa47797efba5a1'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:32.402825 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-d7db7858-6d2e-40dc-a8c1-021018fec9bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a37985dd5034ceeabfa47797efba5a1'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:32.409884 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1336/2673] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:38:31 2021] DELETE /identity/v3/users/9a37985dd5034ceeabfa47797efba5a1 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:38:32.446576 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc97ae4-c16c-43d9-81b5-2ef6f843be19 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:32.448156 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-6bc97ae4-c16c-43d9-81b5-2ef6f843be19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:32.461932 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc97ae4-c16c-43d9-81b5-2ef6f843be19 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:32.519407 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381df201-cf93-4ea7-88d6-213282125a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:32.520300 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381df201-cf93-4ea7-88d6-213282125a29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:32.520598 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381df201-cf93-4ea7-88d6-213282125a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:32.520871 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381df201-cf93-4ea7-88d6-213282125a29 admin admin] PATH_INFO: `/v3/projects/1953d01121b047a08bc222985a1acfb3` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:32.522066 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381df201-cf93-4ea7-88d6-213282125a29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1953d01121b047a08bc222985a1acfb3)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:32.523965 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381df201-cf93-4ea7-88d6-213282125a29 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:32.653076 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-381df201-cf93-4ea7-88d6-213282125a29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1953d01121b047a08bc222985a1acfb3', 'request_id': 'req-381df201-cf93-4ea7-88d6-213282125a29'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:32.659362 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-381df201-cf93-4ea7-88d6-213282125a29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1953d01121b047a08bc222985a1acfb3', 'request_id': 'req-381df201-cf93-4ea7-88d6-213282125a29'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:32.664746 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-381df201-cf93-4ea7-88d6-213282125a29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1953d01121b047a08bc222985a1acfb3', 'request_id': 'req-381df201-cf93-4ea7-88d6-213282125a29'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:32.677894 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db7858-6d2e-40dc-a8c1-021018fec9bb admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:32.679374 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-d7db7858-6d2e-40dc-a8c1-021018fec9bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:32.694647 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db7858-6d2e-40dc-a8c1-021018fec9bb admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:32.755830 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-381df201-cf93-4ea7-88d6-213282125a29 admin admin] The token cache is being invalidate because project 1953d01121b047a08bc222985a1acfb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74005) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:38:32.756358 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-381df201-cf93-4ea7-88d6-213282125a29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:32.757207 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-381df201-cf93-4ea7-88d6-213282125a29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:32.758886 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1338/2674] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:38:32 2021] DELETE /identity/v3/projects/1953d01121b047a08bc222985a1acfb3 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:38:32.764856 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765dd0c3-54c3-4d6f-b62b-7a26a7440b63 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:32.765216 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765dd0c3-54c3-4d6f-b62b-7a26a7440b63 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:32.765558 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765dd0c3-54c3-4d6f-b62b-7a26a7440b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:32.770258 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197eb1db-b0ee-4f1c-a308-c8de3d6a395b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:32.771182 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197eb1db-b0ee-4f1c-a308-c8de3d6a395b admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:32.771467 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197eb1db-b0ee-4f1c-a308-c8de3d6a395b admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:32.771739 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197eb1db-b0ee-4f1c-a308-c8de3d6a395b admin admin] PATH_INFO: `/v3/projects/d1b808c36ccd4256858530aedc0a6f64` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:32.785406 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-765dd0c3-54c3-4d6f-b62b-7a26a7440b63 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:38:32.786788 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-765dd0c3-54c3-4d6f-b62b-7a26a7440b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:32.791398 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197eb1db-b0ee-4f1c-a308-c8de3d6a395b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1b808c36ccd4256858530aedc0a6f64)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:32.793982 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197eb1db-b0ee-4f1c-a308-c8de3d6a395b admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:32.799390 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1339/2675] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:38:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:38:32.806943 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d5e49-3b58-44d4-9863-c54b180d478d None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:32.807231 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d5e49-3b58-44d4-9863-c54b180d478d None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:32.807503 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d5e49-3b58-44d4-9863-c54b180d478d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:32.828141 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-601d5e49-3b58-44d4-9863-c54b180d478d None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:38:32.829352 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-601d5e49-3b58-44d4-9863-c54b180d478d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:32.837341 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1340/2676] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:38:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:38:32.847498 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601d5e49-3b58-44d4-9863-c54b180d478d None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:32.856377 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601d5e49-3b58-44d4-9863-c54b180d478d None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:32.861767 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ff8757-0d19-4295-b4a1-f1780a8e4adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:32.862421 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff8757-0d19-4295-b4a1-f1780a8e4adb admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:32.862701 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff8757-0d19-4295-b4a1-f1780a8e4adb admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:32.862974 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff8757-0d19-4295-b4a1-f1780a8e4adb admin admin] PATH_INFO: `/v3/domains` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:32.863700 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ff8757-0d19-4295-b4a1-f1780a8e4adb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:38:32.864003 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ff8757-0d19-4295-b4a1-f1780a8e4adb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:32.865662 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ff8757-0d19-4295-b4a1-f1780a8e4adb admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:32.876886 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1341/2677] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 12 18:38:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:38:32.881063 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ff8757-0d19-4295-b4a1-f1780a8e4adb admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:32.890335 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ff8757-0d19-4295-b4a1-f1780a8e4adb admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:32.897521 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-197eb1db-b0ee-4f1c-a308-c8de3d6a395b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1b808c36ccd4256858530aedc0a6f64', 'request_id': 'req-197eb1db-b0ee-4f1c-a308-c8de3d6a395b'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:32.944137 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5978cb8-8d33-4b25-b712-97950d48be4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:32.944752 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5978cb8-8d33-4b25-b712-97950d48be4b admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:32.945033 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5978cb8-8d33-4b25-b712-97950d48be4b admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:32.945312 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5978cb8-8d33-4b25-b712-97950d48be4b admin admin] PATH_INFO: `/v3/projects` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:32.946001 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5978cb8-8d33-4b25-b712-97950d48be4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:32.947903 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5978cb8-8d33-4b25-b712-97950d48be4b admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:32.961053 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-197eb1db-b0ee-4f1c-a308-c8de3d6a395b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1b808c36ccd4256858530aedc0a6f64', 'request_id': 'req-197eb1db-b0ee-4f1c-a308-c8de3d6a395b'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:32.968323 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-197eb1db-b0ee-4f1c-a308-c8de3d6a395b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1b808c36ccd4256858530aedc0a6f64', 'request_id': 'req-197eb1db-b0ee-4f1c-a308-c8de3d6a395b'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:32.978962 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-197eb1db-b0ee-4f1c-a308-c8de3d6a395b admin admin] The token cache is being invalidate because project d1b808c36ccd4256858530aedc0a6f64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:38:32.979240 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-197eb1db-b0ee-4f1c-a308-c8de3d6a395b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:32.979876 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-197eb1db-b0ee-4f1c-a308-c8de3d6a395b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:32.981430 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1337/2678] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:38:32 2021] DELETE /identity/v3/projects/d1b808c36ccd4256858530aedc0a6f64 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:38:32.985838 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197eb1db-b0ee-4f1c-a308-c8de3d6a395b admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:32.987124 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-197eb1db-b0ee-4f1c-a308-c8de3d6a395b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:32.998876 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197eb1db-b0ee-4f1c-a308-c8de3d6a395b admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:33.003541 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bed6773-9dec-414a-9b0b-27e78626b514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:33.004352 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed6773-9dec-414a-9b0b-27e78626b514 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:33.004682 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed6773-9dec-414a-9b0b-27e78626b514 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:33.004955 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed6773-9dec-414a-9b0b-27e78626b514 admin admin] PATH_INFO: `/v3/users/72f30704253948c187ba4a4b0747435c` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:33.019500 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bed6773-9dec-414a-9b0b-27e78626b514 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72f30704253948c187ba4a4b0747435c)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:33.021515 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bed6773-9dec-414a-9b0b-27e78626b514 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:33.056288 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1342/2679] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:38:32 2021] POST /identity/v3/projects => generated 365 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 18:38:33.060200 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5978cb8-8d33-4b25-b712-97950d48be4b admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:33.061805 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-c5978cb8-8d33-4b25-b712-97950d48be4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:33.121715 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5978cb8-8d33-4b25-b712-97950d48be4b admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:33.127458 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6db3db-e4e4-4277-b349-5504fe0c2d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:33.128118 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6db3db-e4e4-4277-b349-5504fe0c2d55 admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:33.128409 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6db3db-e4e4-4277-b349-5504fe0c2d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:33.128694 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6db3db-e4e4-4277-b349-5504fe0c2d55 admin admin] PATH_INFO: `/v3/users` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:33.129387 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6db3db-e4e4-4277-b349-5504fe0c2d55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:33.131353 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6db3db-e4e4-4277-b349-5504fe0c2d55 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:33.203816 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-2bed6773-9dec-414a-9b0b-27e78626b514 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72f30704253948c187ba4a4b0747435c'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:33.210448 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-2bed6773-9dec-414a-9b0b-27e78626b514 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72f30704253948c187ba4a4b0747435c'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:33.222218 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-2bed6773-9dec-414a-9b0b-27e78626b514 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72f30704253948c187ba4a4b0747435c'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:33.229650 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1343/2680] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:38:33 2021] POST /identity/v3/users => generated 283 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 18:38:33.233292 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6db3db-e4e4-4277-b349-5504fe0c2d55 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:33.243260 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6db3db-e4e4-4277-b349-5504fe0c2d55 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:33.247921 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93a45b5-27fd-44d1-beb3-37a0768b2ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:33.248584 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a45b5-27fd-44d1-beb3-37a0768b2ded admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:33.248865 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a45b5-27fd-44d1-beb3-37a0768b2ded admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:33.249161 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a45b5-27fd-44d1-beb3-37a0768b2ded admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:33.249877 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93a45b5-27fd-44d1-beb3-37a0768b2ded admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:33.251483 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93a45b5-27fd-44d1-beb3-37a0768b2ded admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:33.261109 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1344/2681] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:38:33 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 18:38:33.266839 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93a45b5-27fd-44d1-beb3-37a0768b2ded admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:33.275985 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93a45b5-27fd-44d1-beb3-37a0768b2ded admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:33.280675 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0259e732-d452-4c15-b2f1-3baecda9dacc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:33.281467 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259e732-d452-4c15-b2f1-3baecda9dacc admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:33.281749 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259e732-d452-4c15-b2f1-3baecda9dacc admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:33.282576 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259e732-d452-4c15-b2f1-3baecda9dacc admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:33.283284 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0259e732-d452-4c15-b2f1-3baecda9dacc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:33.292670 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0259e732-d452-4c15-b2f1-3baecda9dacc admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:33.296783 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1345/2682] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:38:33 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 18:38:33.300737 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0259e732-d452-4c15-b2f1-3baecda9dacc admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:33.310132 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0259e732-d452-4c15-b2f1-3baecda9dacc admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:33.310683 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-2bed6773-9dec-414a-9b0b-27e78626b514 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72f30704253948c187ba4a4b0747435c'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:33.320432 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-2bed6773-9dec-414a-9b0b-27e78626b514 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72f30704253948c187ba4a4b0747435c'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:33.320563 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fbd5c8-fb65-46c5-bcbf-cfd9134e8611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:33.320563 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fbd5c8-fb65-46c5-bcbf-cfd9134e8611 admin admin] REQUEST_METHOD: `PUT` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:33.320563 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fbd5c8-fb65-46c5-bcbf-cfd9134e8611 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:33.320563 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fbd5c8-fb65-46c5-bcbf-cfd9134e8611 admin admin] PATH_INFO: `/v3/projects/2c07f0b307f741c8bf02c4cfd2287025/users/fd8326b4113d4a09afe701941e8b05f1/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:33.320946 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1338/2683] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:38:32 2021] DELETE /identity/v3/users/72f30704253948c187ba4a4b0747435c => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 18:38:33.320946 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bed6773-9dec-414a-9b0b-27e78626b514 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:33.320946 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-2bed6773-9dec-414a-9b0b-27e78626b514 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:33.333540 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fbd5c8-fb65-46c5-bcbf-cfd9134e8611 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c07f0b307f741c8bf02c4cfd2287025, user_id=fd8326b4113d4a09afe701941e8b05f1, role_id=33b8a5a8d1d643f2a98f598e6ab0a1cf)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:33.336666 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fbd5c8-fb65-46c5-bcbf-cfd9134e8611 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:33.384415 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bed6773-9dec-414a-9b0b-27e78626b514 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:33.389298 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eec9af9-83ec-4bfa-a0d9-6606c70adf06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:33.391916 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec9af9-83ec-4bfa-a0d9-6606c70adf06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:33.391916 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec9af9-83ec-4bfa-a0d9-6606c70adf06 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:33.391916 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec9af9-83ec-4bfa-a0d9-6606c70adf06 admin admin] PATH_INFO: `/v3/users/b7f421d2079c4643a316227d517a8a36` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:33.392512 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eec9af9-83ec-4bfa-a0d9-6606c70adf06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7f421d2079c4643a316227d517a8a36)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:33.394439 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eec9af9-83ec-4bfa-a0d9-6606c70adf06 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:33.414729 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1346/2684] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:38:33 2021] PUT /identity/v3/projects/2c07f0b307f741c8bf02c4cfd2287025/users/fd8326b4113d4a09afe701941e8b05f1/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 18:38:33.425033 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2529c531-c975-44b1-bd19-42c16262e1fc None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:33.425318 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2529c531-c975-44b1-bd19-42c16262e1fc None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:33.429144 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2529c531-c975-44b1-bd19-42c16262e1fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:33.451232 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-2529c531-c975-44b1-bd19-42c16262e1fc None None] MFA Rules not processed for user `fd8326b4113d4a09afe701941e8b05f1`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:38:33.452465 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-2529c531-c975-44b1-bd19-42c16262e1fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:33.513929 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1347/2685] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:38:33 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:38:33.520019 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2529c531-c975-44b1-bd19-42c16262e1fc None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:33.521533 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-2529c531-c975-44b1-bd19-42c16262e1fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:33.590795 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2529c531-c975-44b1-bd19-42c16262e1fc None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:33.590795 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bc4434-f0e6-4b06-94c3-f12a9bf8e345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:33.591476 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc4434-f0e6-4b06-94c3-f12a9bf8e345 admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:33.591476 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc4434-f0e6-4b06-94c3-f12a9bf8e345 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:33.591647 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc4434-f0e6-4b06-94c3-f12a9bf8e345 admin admin] PATH_INFO: `/v3/projects` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:33.592205 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bc4434-f0e6-4b06-94c3-f12a9bf8e345 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:33.593433 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-0eec9af9-83ec-4bfa-a0d9-6606c70adf06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7f421d2079c4643a316227d517a8a36'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:33.594190 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bc4434-f0e6-4b06-94c3-f12a9bf8e345 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:33.600749 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-0eec9af9-83ec-4bfa-a0d9-6606c70adf06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7f421d2079c4643a316227d517a8a36'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:33.612020 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-0eec9af9-83ec-4bfa-a0d9-6606c70adf06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7f421d2079c4643a316227d517a8a36'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:33.701178 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1348/2686] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:38:33 2021] POST /identity/v3/projects => generated 365 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 18:38:33.702210 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bc4434-f0e6-4b06-94c3-f12a9bf8e345 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:33.703847 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-44bc4434-f0e6-4b06-94c3-f12a9bf8e345 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:33.716746 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-0eec9af9-83ec-4bfa-a0d9-6606c70adf06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7f421d2079c4643a316227d517a8a36'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:33.717412 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-0eec9af9-83ec-4bfa-a0d9-6606c70adf06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7f421d2079c4643a316227d517a8a36'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:33.723697 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1339/2687] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:38:33 2021] DELETE /identity/v3/users/b7f421d2079c4643a316227d517a8a36 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:38:33.724492 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eec9af9-83ec-4bfa-a0d9-6606c70adf06 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:33.727710 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-0eec9af9-83ec-4bfa-a0d9-6606c70adf06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:33.773531 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bc4434-f0e6-4b06-94c3-f12a9bf8e345 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:33.789243 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eec9af9-83ec-4bfa-a0d9-6606c70adf06 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:33.794239 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd1b266-244b-45a5-abf8-f8052fa23e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:33.794895 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd1b266-244b-45a5-abf8-f8052fa23e1f admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:33.795174 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd1b266-244b-45a5-abf8-f8052fa23e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:33.795441 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd1b266-244b-45a5-abf8-f8052fa23e1f admin admin] PATH_INFO: `/v3/users` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:33.796140 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd1b266-244b-45a5-abf8-f8052fa23e1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:33.798061 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd1b266-244b-45a5-abf8-f8052fa23e1f admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:33.821327 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19750578-f551-48a0-bdb4-70ec9532a53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:33.822181 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19750578-f551-48a0-bdb4-70ec9532a53f admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:33.822525 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19750578-f551-48a0-bdb4-70ec9532a53f admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:33.822741 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19750578-f551-48a0-bdb4-70ec9532a53f admin admin] PATH_INFO: `/v3/projects/013389300c86431d9fabe0d5bc4222b0` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:33.833159 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19750578-f551-48a0-bdb4-70ec9532a53f admin admin] RBAC: Authorizing `identity:delete_project(project_id=013389300c86431d9fabe0d5bc4222b0)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:33.835085 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19750578-f551-48a0-bdb4-70ec9532a53f admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:33.899268 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1340/2688] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:38:33 2021] POST /identity/v3/users => generated 289 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:38:33.900610 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e7b3d7-c9b4-4805-9eda-58ea33d41b09 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:33.900893 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e7b3d7-c9b4-4805-9eda-58ea33d41b09 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:33.901163 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e7b3d7-c9b4-4805-9eda-58ea33d41b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:33.918036 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-59e7b3d7-c9b4-4805-9eda-58ea33d41b09 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:38:33.919207 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-59e7b3d7-c9b4-4805-9eda-58ea33d41b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:33.928857 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1341/2689] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:38:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:38:33.930874 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e7b3d7-c9b4-4805-9eda-58ea33d41b09 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:33.939506 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e7b3d7-c9b4-4805-9eda-58ea33d41b09 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:33.944031 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d387adcf-2ba7-4f55-b800-8ea3de042f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:33.944702 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d387adcf-2ba7-4f55-b800-8ea3de042f03 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:33.944978 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d387adcf-2ba7-4f55-b800-8ea3de042f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:33.945247 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d387adcf-2ba7-4f55-b800-8ea3de042f03 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:33.946104 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d387adcf-2ba7-4f55-b800-8ea3de042f03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:33.947774 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d387adcf-2ba7-4f55-b800-8ea3de042f03 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:33.958399 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1342/2690] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:38:33 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:38:33.959169 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d387adcf-2ba7-4f55-b800-8ea3de042f03 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:33.960742 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-d387adcf-2ba7-4f55-b800-8ea3de042f03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:34.014357 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d387adcf-2ba7-4f55-b800-8ea3de042f03 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:34.017999 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bd6ea8-4ec1-4044-b8b2-9c52cf0d6783 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:34.018745 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bd6ea8-4ec1-4044-b8b2-9c52cf0d6783 service neutron] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:34.019021 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bd6ea8-4ec1-4044-b8b2-9c52cf0d6783 service neutron] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:34.019292 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bd6ea8-4ec1-4044-b8b2-9c52cf0d6783 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:34.029181 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bd6ea8-4ec1-4044-b8b2-9c52cf0d6783 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:34.030652 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bd6ea8-4ec1-4044-b8b2-9c52cf0d6783 service neutron] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:34.040723 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1343/2691] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:38:33 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:38:34.041332 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bd6ea8-4ec1-4044-b8b2-9c52cf0d6783 service neutron] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:34.048803 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-19750578-f551-48a0-bdb4-70ec9532a53f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '013389300c86431d9fabe0d5bc4222b0', 'request_id': 'req-19750578-f551-48a0-bdb4-70ec9532a53f'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:34.051067 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bd6ea8-4ec1-4044-b8b2-9c52cf0d6783 service neutron] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:34.055930 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-19750578-f551-48a0-bdb4-70ec9532a53f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '013389300c86431d9fabe0d5bc4222b0', 'request_id': 'req-19750578-f551-48a0-bdb4-70ec9532a53f'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:34.062419 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-19750578-f551-48a0-bdb4-70ec9532a53f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '013389300c86431d9fabe0d5bc4222b0', 'request_id': 'req-19750578-f551-48a0-bdb4-70ec9532a53f'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:34.106174 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de13a05-87d5-4d10-9e3d-167fc565de1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:34.107057 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de13a05-87d5-4d10-9e3d-167fc565de1b admin admin] REQUEST_METHOD: `PUT` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:34.107365 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de13a05-87d5-4d10-9e3d-167fc565de1b admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:34.107639 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de13a05-87d5-4d10-9e3d-167fc565de1b admin admin] PATH_INFO: `/v3/projects/1d8b2492e39f4ae6959dfba4f99296ef/users/1783912f84e44125b2a9f8eda2474f1b/roles/6c54f239944d46e3b027ccce97eb8b49` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:34.123402 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de13a05-87d5-4d10-9e3d-167fc565de1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d8b2492e39f4ae6959dfba4f99296ef, user_id=1783912f84e44125b2a9f8eda2474f1b, role_id=6c54f239944d46e3b027ccce97eb8b49)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:34.126850 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de13a05-87d5-4d10-9e3d-167fc565de1b admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:34.161811 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-19750578-f551-48a0-bdb4-70ec9532a53f admin admin] The token cache is being invalidate because project 013389300c86431d9fabe0d5bc4222b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74005) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:38:34.162095 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-19750578-f551-48a0-bdb4-70ec9532a53f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:34.162709 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-19750578-f551-48a0-bdb4-70ec9532a53f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:34.164255 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1349/2692] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:38:33 2021] DELETE /identity/v3/projects/013389300c86431d9fabe0d5bc4222b0 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:38:34.252948 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1344/2693] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:38:34 2021] PUT /identity/v3/projects/1d8b2492e39f4ae6959dfba4f99296ef/users/1783912f84e44125b2a9f8eda2474f1b/roles/6c54f239944d46e3b027ccce97eb8b49 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:38:34.257017 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19750578-f551-48a0-bdb4-70ec9532a53f admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:34.259405 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-19750578-f551-48a0-bdb4-70ec9532a53f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:34.283849 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19750578-f551-48a0-bdb4-70ec9532a53f admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:34.356152 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efc6977-c8c0-4427-abb8-45afcda3b7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:34.356971 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc6977-c8c0-4427-abb8-45afcda3b7e9 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:34.357314 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc6977-c8c0-4427-abb8-45afcda3b7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:34.357651 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc6977-c8c0-4427-abb8-45afcda3b7e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:34.358556 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efc6977-c8c0-4427-abb8-45afcda3b7e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:34.361189 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efc6977-c8c0-4427-abb8-45afcda3b7e9 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:34.375421 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1350/2694] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:38:34 2021] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 18:38:34.376965 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de13a05-87d5-4d10-9e3d-167fc565de1b admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:34.387789 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de13a05-87d5-4d10-9e3d-167fc565de1b admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:34.393471 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2136a235-47a3-49d0-b4c9-01f2542a9cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:34.394371 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2136a235-47a3-49d0-b4c9-01f2542a9cfc admin admin] REQUEST_METHOD: `PUT` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:34.394646 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2136a235-47a3-49d0-b4c9-01f2542a9cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:34.394916 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2136a235-47a3-49d0-b4c9-01f2542a9cfc admin admin] PATH_INFO: `/v3/projects/1d8b2492e39f4ae6959dfba4f99296ef/users/1783912f84e44125b2a9f8eda2474f1b/roles/6c54f239944d46e3b027ccce97eb8b49` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:34.399578 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2136a235-47a3-49d0-b4c9-01f2542a9cfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d8b2492e39f4ae6959dfba4f99296ef, user_id=1783912f84e44125b2a9f8eda2474f1b, role_id=6c54f239944d46e3b027ccce97eb8b49)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:34.399578 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2136a235-47a3-49d0-b4c9-01f2542a9cfc admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:34.410710 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1345/2695] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:38:34 2021] PUT /identity/v3/projects/1d8b2492e39f4ae6959dfba4f99296ef/users/1783912f84e44125b2a9f8eda2474f1b/roles/6c54f239944d46e3b027ccce97eb8b49 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:38:34.420931 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d95ac9-079f-47a1-9bf6-54067cb230a6 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:34.421200 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d95ac9-079f-47a1-9bf6-54067cb230a6 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:34.421474 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d95ac9-079f-47a1-9bf6-54067cb230a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:34.448127 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-62d95ac9-079f-47a1-9bf6-54067cb230a6 None None] MFA Rules not processed for user `1783912f84e44125b2a9f8eda2474f1b`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:38:34.449392 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-62d95ac9-079f-47a1-9bf6-54067cb230a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:34.489939 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2136a235-47a3-49d0-b4c9-01f2542a9cfc admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:34.492006 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-2136a235-47a3-49d0-b4c9-01f2542a9cfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:34.520427 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1351/2696] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:38:34 2021] POST /identity/v3/auth/tokens => generated 3452 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:38:34.530846 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d95ac9-079f-47a1-9bf6-54067cb230a6 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:34.532963 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-62d95ac9-079f-47a1-9bf6-54067cb230a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:34.558290 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2136a235-47a3-49d0-b4c9-01f2542a9cfc admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:34.562986 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd0c6d-cebe-4b86-a5e1-bb2964af51a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:34.563897 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd0c6d-cebe-4b86-a5e1-bb2964af51a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:34.564176 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd0c6d-cebe-4b86-a5e1-bb2964af51a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:34.564481 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd0c6d-cebe-4b86-a5e1-bb2964af51a0 admin admin] PATH_INFO: `/v3/projects/9d50a2328d8545ecae7865f2d0686e3d` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:34.565685 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cd0c6d-cebe-4b86-a5e1-bb2964af51a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d50a2328d8545ecae7865f2d0686e3d)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:34.567587 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cd0c6d-cebe-4b86-a5e1-bb2964af51a0 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:34.588201 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d95ac9-079f-47a1-9bf6-54067cb230a6 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:34.591869 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d01bd9e-ccb8-462a-add6-e6e11361464d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6966ce0774f4437a9b688494e9d0574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:34.592537 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d01bd9e-ccb8-462a-add6-e6e11361464d service cinder] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:34.592820 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d01bd9e-ccb8-462a-add6-e6e11361464d service cinder] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:34.593095 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d01bd9e-ccb8-462a-add6-e6e11361464d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:34.602419 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d01bd9e-ccb8-462a-add6-e6e11361464d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:34.603843 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d01bd9e-ccb8-462a-add6-e6e11361464d service cinder] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:34.613742 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1352/2697] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:38:34 2021] GET /identity/v3/auth/tokens => generated 3452 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 18:38:34.676311 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-e0cd0c6d-cebe-4b86-a5e1-bb2964af51a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d50a2328d8545ecae7865f2d0686e3d', 'request_id': 'req-e0cd0c6d-cebe-4b86-a5e1-bb2964af51a0'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:34.743810 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-e0cd0c6d-cebe-4b86-a5e1-bb2964af51a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d50a2328d8545ecae7865f2d0686e3d', 'request_id': 'req-e0cd0c6d-cebe-4b86-a5e1-bb2964af51a0'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:34.750656 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-e0cd0c6d-cebe-4b86-a5e1-bb2964af51a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d50a2328d8545ecae7865f2d0686e3d', 'request_id': 'req-e0cd0c6d-cebe-4b86-a5e1-bb2964af51a0'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:34.761143 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-e0cd0c6d-cebe-4b86-a5e1-bb2964af51a0 admin admin] The token cache is being invalidate because project 9d50a2328d8545ecae7865f2d0686e3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:38:34.761427 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-e0cd0c6d-cebe-4b86-a5e1-bb2964af51a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:34.762067 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-e0cd0c6d-cebe-4b86-a5e1-bb2964af51a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:34.763589 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1346/2698] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:38:34 2021] DELETE /identity/v3/projects/9d50a2328d8545ecae7865f2d0686e3d => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:38:34.767961 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d01bd9e-ccb8-462a-add6-e6e11361464d service cinder] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:34.778036 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d01bd9e-ccb8-462a-add6-e6e11361464d service cinder] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:34.814161 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd0c6d-cebe-4b86-a5e1-bb2964af51a0 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:34.815721 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-e0cd0c6d-cebe-4b86-a5e1-bb2964af51a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:34.832075 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bb7b66-6816-4d65-b02c-6dcacf49cb73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:34.832970 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb7b66-6816-4d65-b02c-6dcacf49cb73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:34.833282 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb7b66-6816-4d65-b02c-6dcacf49cb73 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:34.833555 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb7b66-6816-4d65-b02c-6dcacf49cb73 admin admin] PATH_INFO: `/v3/users/1f15a4975f6942538d2fc0c3d448bac0` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:34.834751 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bb7b66-6816-4d65-b02c-6dcacf49cb73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f15a4975f6942538d2fc0c3d448bac0)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:34.836784 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bb7b66-6816-4d65-b02c-6dcacf49cb73 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:34.872199 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd0c6d-cebe-4b86-a5e1-bb2964af51a0 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:34.875873 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b5df68-5f52-47bf-a65b-2ea7e44edf4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6966ce0774f4437a9b688494e9d0574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:34.876542 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b5df68-5f52-47bf-a65b-2ea7e44edf4d service cinder] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:34.876825 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b5df68-5f52-47bf-a65b-2ea7e44edf4d service cinder] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:34.877094 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b5df68-5f52-47bf-a65b-2ea7e44edf4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:34.878843 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-75b5df68-5f52-47bf-a65b-2ea7e44edf4d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:34.934233 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b5df68-5f52-47bf-a65b-2ea7e44edf4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:34.935681 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b5df68-5f52-47bf-a65b-2ea7e44edf4d service cinder] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:34.944315 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1347/2699] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:38:34 2021] GET /identity/v3/auth/tokens => generated 3385 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 18:38:35.112137 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-34bb7b66-6816-4d65-b02c-6dcacf49cb73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f15a4975f6942538d2fc0c3d448bac0'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:35.112732 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-34bb7b66-6816-4d65-b02c-6dcacf49cb73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f15a4975f6942538d2fc0c3d448bac0'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:35.124430 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-34bb7b66-6816-4d65-b02c-6dcacf49cb73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f15a4975f6942538d2fc0c3d448bac0'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:35.125112 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-34bb7b66-6816-4d65-b02c-6dcacf49cb73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f15a4975f6942538d2fc0c3d448bac0'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:35.132115 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-34bb7b66-6816-4d65-b02c-6dcacf49cb73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f15a4975f6942538d2fc0c3d448bac0'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:35.224130 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1353/2700] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:38:34 2021] DELETE /identity/v3/users/1f15a4975f6942538d2fc0c3d448bac0 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:38:35.666751 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b5df68-5f52-47bf-a65b-2ea7e44edf4d service cinder] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:35.668193 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-75b5df68-5f52-47bf-a65b-2ea7e44edf4d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:35.682672 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b5df68-5f52-47bf-a65b-2ea7e44edf4d service cinder] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:35.738763 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d362aae-60a2-4bd0-8e63-aad1497713b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:35.739608 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d362aae-60a2-4bd0-8e63-aad1497713b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:35.739889 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d362aae-60a2-4bd0-8e63-aad1497713b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:35.740165 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d362aae-60a2-4bd0-8e63-aad1497713b0 admin admin] PATH_INFO: `/v3/projects/6cf40163e5cb492597ee17536869e9e6` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:35.741380 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d362aae-60a2-4bd0-8e63-aad1497713b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cf40163e5cb492597ee17536869e9e6)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:35.743270 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d362aae-60a2-4bd0-8e63-aad1497713b0 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:35.875349 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-4d362aae-60a2-4bd0-8e63-aad1497713b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cf40163e5cb492597ee17536869e9e6', 'request_id': 'req-4d362aae-60a2-4bd0-8e63-aad1497713b0'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:35.951264 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-4d362aae-60a2-4bd0-8e63-aad1497713b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cf40163e5cb492597ee17536869e9e6', 'request_id': 'req-4d362aae-60a2-4bd0-8e63-aad1497713b0'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:35.957998 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-4d362aae-60a2-4bd0-8e63-aad1497713b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cf40163e5cb492597ee17536869e9e6', 'request_id': 'req-4d362aae-60a2-4bd0-8e63-aad1497713b0'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:35.967972 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-4d362aae-60a2-4bd0-8e63-aad1497713b0 admin admin] The token cache is being invalidate because project 6cf40163e5cb492597ee17536869e9e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:38:35.968253 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-4d362aae-60a2-4bd0-8e63-aad1497713b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:35.968898 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-4d362aae-60a2-4bd0-8e63-aad1497713b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:35.970972 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1348/2701] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:38:35 2021] DELETE /identity/v3/projects/6cf40163e5cb492597ee17536869e9e6 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:38:35.975048 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bb7b66-6816-4d65-b02c-6dcacf49cb73 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:35.976586 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-34bb7b66-6816-4d65-b02c-6dcacf49cb73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:35.989767 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bb7b66-6816-4d65-b02c-6dcacf49cb73 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:36.043162 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a6bcd-e547-4c90-a16d-0fe30c85edfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:36.044031 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a6bcd-e547-4c90-a16d-0fe30c85edfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:36.044314 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a6bcd-e547-4c90-a16d-0fe30c85edfe admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:36.044619 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a6bcd-e547-4c90-a16d-0fe30c85edfe admin admin] PATH_INFO: `/v3/users/d89aff9af80c4bc4bd3f3f37e9cb5cd2` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:36.045809 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3a6bcd-e547-4c90-a16d-0fe30c85edfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=d89aff9af80c4bc4bd3f3f37e9cb5cd2)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:36.048380 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3a6bcd-e547-4c90-a16d-0fe30c85edfe admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:36.236238 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-fd3a6bcd-e547-4c90-a16d-0fe30c85edfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd89aff9af80c4bc4bd3f3f37e9cb5cd2'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:36.236838 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-fd3a6bcd-e547-4c90-a16d-0fe30c85edfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd89aff9af80c4bc4bd3f3f37e9cb5cd2'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:36.253393 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-fd3a6bcd-e547-4c90-a16d-0fe30c85edfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd89aff9af80c4bc4bd3f3f37e9cb5cd2'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:36.254079 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-fd3a6bcd-e547-4c90-a16d-0fe30c85edfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd89aff9af80c4bc4bd3f3f37e9cb5cd2'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:36.260638 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-fd3a6bcd-e547-4c90-a16d-0fe30c85edfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd89aff9af80c4bc4bd3f3f37e9cb5cd2'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:36.343050 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1354/2702] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:38:35 2021] DELETE /identity/v3/users/d89aff9af80c4bc4bd3f3f37e9cb5cd2 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:38:36.809394 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d362aae-60a2-4bd0-8e63-aad1497713b0 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:36.810788 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-4d362aae-60a2-4bd0-8e63-aad1497713b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:36.823460 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d362aae-60a2-4bd0-8e63-aad1497713b0 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:36.893047 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d6be68-bd0c-47e3-8a90-c64215b3e123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:36.893904 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6be68-bd0c-47e3-8a90-c64215b3e123 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:36.898656 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6be68-bd0c-47e3-8a90-c64215b3e123 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:36.898656 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6be68-bd0c-47e3-8a90-c64215b3e123 admin admin] PATH_INFO: `/v3/projects/f29065617d854f0a991f8d5e056a5323` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:36.898656 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d6be68-bd0c-47e3-8a90-c64215b3e123 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f29065617d854f0a991f8d5e056a5323)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:36.898656 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d6be68-bd0c-47e3-8a90-c64215b3e123 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:37.121531 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-11d6be68-bd0c-47e3-8a90-c64215b3e123 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f29065617d854f0a991f8d5e056a5323', 'request_id': 'req-11d6be68-bd0c-47e3-8a90-c64215b3e123'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:37.230905 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-11d6be68-bd0c-47e3-8a90-c64215b3e123 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f29065617d854f0a991f8d5e056a5323', 'request_id': 'req-11d6be68-bd0c-47e3-8a90-c64215b3e123'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:37.237475 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-11d6be68-bd0c-47e3-8a90-c64215b3e123 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f29065617d854f0a991f8d5e056a5323', 'request_id': 'req-11d6be68-bd0c-47e3-8a90-c64215b3e123'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:37.247528 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-11d6be68-bd0c-47e3-8a90-c64215b3e123 admin admin] The token cache is being invalidate because project f29065617d854f0a991f8d5e056a5323 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:38:37.247814 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-11d6be68-bd0c-47e3-8a90-c64215b3e123 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:37.248468 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-11d6be68-bd0c-47e3-8a90-c64215b3e123 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:37.249998 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1349/2703] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:38:36 2021] DELETE /identity/v3/projects/f29065617d854f0a991f8d5e056a5323 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:38:37.256588 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021dbddd-b35e-45e7-b85d-8cbbc02ac69d None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:37.257060 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021dbddd-b35e-45e7-b85d-8cbbc02ac69d None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:37.257158 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021dbddd-b35e-45e7-b85d-8cbbc02ac69d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:37.275442 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-021dbddd-b35e-45e7-b85d-8cbbc02ac69d None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:38:37.278925 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-021dbddd-b35e-45e7-b85d-8cbbc02ac69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:37.333640 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1355/2704] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:38:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:38:37.343089 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a91ada-d746-4c15-8992-b62618c2f1e1 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:37.343375 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a91ada-d746-4c15-8992-b62618c2f1e1 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:37.343655 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a91ada-d746-4c15-8992-b62618c2f1e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:37.361823 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-a8a91ada-d746-4c15-8992-b62618c2f1e1 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:38:37.363024 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-a8a91ada-d746-4c15-8992-b62618c2f1e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:37.371409 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1350/2705] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:38:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:38:37.379949 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021dbddd-b35e-45e7-b85d-8cbbc02ac69d None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:37.389666 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021dbddd-b35e-45e7-b85d-8cbbc02ac69d None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:37.395006 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda8b511-e011-42d2-bf0f-3ad78ed70e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:37.395656 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8b511-e011-42d2-bf0f-3ad78ed70e9e admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:37.395943 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8b511-e011-42d2-bf0f-3ad78ed70e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:37.396221 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8b511-e011-42d2-bf0f-3ad78ed70e9e admin admin] PATH_INFO: `/v3/domains` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:37.396994 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda8b511-e011-42d2-bf0f-3ad78ed70e9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:38:37.397304 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda8b511-e011-42d2-bf0f-3ad78ed70e9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:37.398900 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda8b511-e011-42d2-bf0f-3ad78ed70e9e admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:37.410839 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1356/2706] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 12 18:38:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:38:37.415287 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a91ada-d746-4c15-8992-b62618c2f1e1 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:37.424702 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a91ada-d746-4c15-8992-b62618c2f1e1 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:37.429489 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7119176-8dac-49dd-a660-95fbacf3ef7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:37.430127 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7119176-8dac-49dd-a660-95fbacf3ef7b admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:37.430409 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7119176-8dac-49dd-a660-95fbacf3ef7b admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:37.430679 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7119176-8dac-49dd-a660-95fbacf3ef7b admin admin] PATH_INFO: `/v3/projects` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:37.431408 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7119176-8dac-49dd-a660-95fbacf3ef7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:37.433364 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7119176-8dac-49dd-a660-95fbacf3ef7b admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:37.529262 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1351/2707] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:38:37 2021] POST /identity/v3/projects => generated 369 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:38:37.533775 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda8b511-e011-42d2-bf0f-3ad78ed70e9e admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:37.543577 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda8b511-e011-42d2-bf0f-3ad78ed70e9e admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:37.597031 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c98006d-4927-4e62-9612-1734129817e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:37.597686 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c98006d-4927-4e62-9612-1734129817e8 admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:37.597968 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c98006d-4927-4e62-9612-1734129817e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:37.598242 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c98006d-4927-4e62-9612-1734129817e8 admin admin] PATH_INFO: `/v3/users` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:37.598946 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c98006d-4927-4e62-9612-1734129817e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:37.600963 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c98006d-4927-4e62-9612-1734129817e8 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:37.695108 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1357/2708] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:38:37 2021] POST /identity/v3/users => generated 285 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 18:38:37.698948 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7119176-8dac-49dd-a660-95fbacf3ef7b admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:37.709591 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7119176-8dac-49dd-a660-95fbacf3ef7b admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:37.714217 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26e4551-d9ea-49be-9d0b-09f593d676d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:37.714913 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e4551-d9ea-49be-9d0b-09f593d676d9 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:37.715196 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e4551-d9ea-49be-9d0b-09f593d676d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:37.715471 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e4551-d9ea-49be-9d0b-09f593d676d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:37.716201 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26e4551-d9ea-49be-9d0b-09f593d676d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:37.717825 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26e4551-d9ea-49be-9d0b-09f593d676d9 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:37.728004 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1352/2709] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:38:37 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:38:37.731819 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c98006d-4927-4e62-9612-1734129817e8 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:37.741965 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c98006d-4927-4e62-9612-1734129817e8 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:37.747875 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d169730-ba26-4d88-82e0-f78abc66848c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:37.748553 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d169730-ba26-4d88-82e0-f78abc66848c admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:37.748836 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d169730-ba26-4d88-82e0-f78abc66848c admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:37.749104 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d169730-ba26-4d88-82e0-f78abc66848c admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:37.749824 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d169730-ba26-4d88-82e0-f78abc66848c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:37.752035 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d169730-ba26-4d88-82e0-f78abc66848c admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:37.761593 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1358/2710] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:38:37 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 18:38:37.765678 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26e4551-d9ea-49be-9d0b-09f593d676d9 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:37.775422 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26e4551-d9ea-49be-9d0b-09f593d676d9 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:37.780003 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a370cb7-bfb3-42cc-a803-fc385da878d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:37.781157 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a370cb7-bfb3-42cc-a803-fc385da878d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:37.781451 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a370cb7-bfb3-42cc-a803-fc385da878d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:37.781725 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a370cb7-bfb3-42cc-a803-fc385da878d4 admin admin] PATH_INFO: `/v3/projects/df7695557664485ab89be0e688121e85/users/a45d307917cd4726a66c39f1d3ebd505/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:37.795864 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a370cb7-bfb3-42cc-a803-fc385da878d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df7695557664485ab89be0e688121e85, user_id=a45d307917cd4726a66c39f1d3ebd505, role_id=33b8a5a8d1d643f2a98f598e6ab0a1cf)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:37.799221 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a370cb7-bfb3-42cc-a803-fc385da878d4 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:37.859079 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1353/2711] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:38:37 2021] PUT /identity/v3/projects/df7695557664485ab89be0e688121e85/users/a45d307917cd4726a66c39f1d3ebd505/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 18:38:37.870663 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850407e5-4194-45e1-acdc-94cef511d689 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:37.870950 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850407e5-4194-45e1-acdc-94cef511d689 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:37.871226 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850407e5-4194-45e1-acdc-94cef511d689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:37.899638 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-850407e5-4194-45e1-acdc-94cef511d689 None None] MFA Rules not processed for user `a45d307917cd4726a66c39f1d3ebd505`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:38:37.900881 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-850407e5-4194-45e1-acdc-94cef511d689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:37.963086 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1359/2712] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:38:37 2021] POST /identity/v3/auth/tokens => generated 3389 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:38:37.976611 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a370cb7-bfb3-42cc-a803-fc385da878d4 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:37.978322 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-1a370cb7-bfb3-42cc-a803-fc385da878d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:38.035380 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a370cb7-bfb3-42cc-a803-fc385da878d4 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:38.039048 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea461ea-ce64-47bd-bc5e-ff61a3984f17 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a3d3e5a5cfc4ac3afcece4e55f23552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:38.039708 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea461ea-ce64-47bd-bc5e-ff61a3984f17 service glance] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:38.040015 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea461ea-ce64-47bd-bc5e-ff61a3984f17 service glance] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:38.040288 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea461ea-ce64-47bd-bc5e-ff61a3984f17 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:38.048806 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea461ea-ce64-47bd-bc5e-ff61a3984f17 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:38.050229 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea461ea-ce64-47bd-bc5e-ff61a3984f17 service glance] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:38.059269 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1354/2713] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:38:37 2021] GET /identity/v3/auth/tokens => generated 3389 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:38:38.677447 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850407e5-4194-45e1-acdc-94cef511d689 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:38.679018 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-850407e5-4194-45e1-acdc-94cef511d689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:38.740159 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850407e5-4194-45e1-acdc-94cef511d689 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:38.745560 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c61148-63c9-478b-ab47-8eccbbb4b7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:38.746411 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c61148-63c9-478b-ab47-8eccbbb4b7bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:38.746689 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c61148-63c9-478b-ab47-8eccbbb4b7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:38.746957 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c61148-63c9-478b-ab47-8eccbbb4b7bc admin admin] PATH_INFO: `/v3/users/fd8326b4113d4a09afe701941e8b05f1` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:38.748158 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c61148-63c9-478b-ab47-8eccbbb4b7bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd8326b4113d4a09afe701941e8b05f1)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:38.750090 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c61148-63c9-478b-ab47-8eccbbb4b7bc admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:39.020542 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-19c61148-63c9-478b-ab47-8eccbbb4b7bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd8326b4113d4a09afe701941e8b05f1'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:39.021205 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-19c61148-63c9-478b-ab47-8eccbbb4b7bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd8326b4113d4a09afe701941e8b05f1'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:39.032985 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-19c61148-63c9-478b-ab47-8eccbbb4b7bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd8326b4113d4a09afe701941e8b05f1'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:39.033631 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-19c61148-63c9-478b-ab47-8eccbbb4b7bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd8326b4113d4a09afe701941e8b05f1'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:39.040132 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-19c61148-63c9-478b-ab47-8eccbbb4b7bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd8326b4113d4a09afe701941e8b05f1'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:39.145994 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1360/2714] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:38:38 2021] DELETE /identity/v3/users/fd8326b4113d4a09afe701941e8b05f1 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:38:39.150647 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9536f78d-89ed-4351-862a-f408eac0bc3c None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:39.151117 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9536f78d-89ed-4351-862a-f408eac0bc3c None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:39.151216 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9536f78d-89ed-4351-862a-f408eac0bc3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:39.172685 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-9536f78d-89ed-4351-862a-f408eac0bc3c None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:38:39.172685 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-9536f78d-89ed-4351-862a-f408eac0bc3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:39.227638 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1355/2715] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:38:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:38:39.237901 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c61148-63c9-478b-ab47-8eccbbb4b7bc admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:39.239359 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-19c61148-63c9-478b-ab47-8eccbbb4b7bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:39.297526 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c61148-63c9-478b-ab47-8eccbbb4b7bc admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:39.302148 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ea4469-ad76-4a5c-aa4a-149b19eaa61f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:39.302792 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea4469-ad76-4a5c-aa4a-149b19eaa61f service neutron] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:39.303072 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea4469-ad76-4a5c-aa4a-149b19eaa61f service neutron] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:39.303343 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea4469-ad76-4a5c-aa4a-149b19eaa61f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:39.315332 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ea4469-ad76-4a5c-aa4a-149b19eaa61f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:39.316808 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ea4469-ad76-4a5c-aa4a-149b19eaa61f service neutron] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:39.330090 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1361/2716] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:38:39 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:38:39.754566 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9536f78d-89ed-4351-862a-f408eac0bc3c None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:39.756071 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-9536f78d-89ed-4351-862a-f408eac0bc3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:39.770372 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9536f78d-89ed-4351-862a-f408eac0bc3c None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:39.775134 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d398919a-037b-41dc-aaeb-25e8889057fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:39.776696 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d398919a-037b-41dc-aaeb-25e8889057fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:39.777057 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d398919a-037b-41dc-aaeb-25e8889057fb admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:39.777445 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d398919a-037b-41dc-aaeb-25e8889057fb admin admin] PATH_INFO: `/v3/projects/2c07f0b307f741c8bf02c4cfd2287025` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:39.778734 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d398919a-037b-41dc-aaeb-25e8889057fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c07f0b307f741c8bf02c4cfd2287025)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:39.780661 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d398919a-037b-41dc-aaeb-25e8889057fb admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:39.880537 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-d398919a-037b-41dc-aaeb-25e8889057fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c07f0b307f741c8bf02c4cfd2287025', 'request_id': 'req-d398919a-037b-41dc-aaeb-25e8889057fb'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:39.945322 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-d398919a-037b-41dc-aaeb-25e8889057fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c07f0b307f741c8bf02c4cfd2287025', 'request_id': 'req-d398919a-037b-41dc-aaeb-25e8889057fb'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:39.952202 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-d398919a-037b-41dc-aaeb-25e8889057fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c07f0b307f741c8bf02c4cfd2287025', 'request_id': 'req-d398919a-037b-41dc-aaeb-25e8889057fb'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:39.963327 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-d398919a-037b-41dc-aaeb-25e8889057fb admin admin] The token cache is being invalidate because project 2c07f0b307f741c8bf02c4cfd2287025 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:38:39.963607 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-d398919a-037b-41dc-aaeb-25e8889057fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:39.964257 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-d398919a-037b-41dc-aaeb-25e8889057fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:39.966424 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1356/2717] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:38:39 2021] DELETE /identity/v3/projects/2c07f0b307f741c8bf02c4cfd2287025 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:38:39.971347 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ea4469-ad76-4a5c-aa4a-149b19eaa61f service neutron] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:39.984974 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ea4469-ad76-4a5c-aa4a-149b19eaa61f service neutron] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:40.043137 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cefce2-648c-4197-94cc-6a5eaf0790f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:40.044016 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cefce2-648c-4197-94cc-6a5eaf0790f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:40.044297 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cefce2-648c-4197-94cc-6a5eaf0790f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:40.044606 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cefce2-648c-4197-94cc-6a5eaf0790f9 admin admin] PATH_INFO: `/v3/users/1783912f84e44125b2a9f8eda2474f1b` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:40.045841 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cefce2-648c-4197-94cc-6a5eaf0790f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1783912f84e44125b2a9f8eda2474f1b)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:40.047783 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cefce2-648c-4197-94cc-6a5eaf0790f9 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:40.208477 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-80cefce2-648c-4197-94cc-6a5eaf0790f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1783912f84e44125b2a9f8eda2474f1b'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:40.209135 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-80cefce2-648c-4197-94cc-6a5eaf0790f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1783912f84e44125b2a9f8eda2474f1b'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:40.221824 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-80cefce2-648c-4197-94cc-6a5eaf0790f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1783912f84e44125b2a9f8eda2474f1b'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:40.222562 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-80cefce2-648c-4197-94cc-6a5eaf0790f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1783912f84e44125b2a9f8eda2474f1b'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:40.229068 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-80cefce2-648c-4197-94cc-6a5eaf0790f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1783912f84e44125b2a9f8eda2474f1b'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:40.333052 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1362/2718] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:38:39 2021] DELETE /identity/v3/users/1783912f84e44125b2a9f8eda2474f1b => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:38:40.725282 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d398919a-037b-41dc-aaeb-25e8889057fb admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:40.727010 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-d398919a-037b-41dc-aaeb-25e8889057fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:40.741913 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d398919a-037b-41dc-aaeb-25e8889057fb admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:40.800726 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb613d0-3e34-4bf2-abba-ac3389afcce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:40.801584 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb613d0-3e34-4bf2-abba-ac3389afcce5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:40.801871 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb613d0-3e34-4bf2-abba-ac3389afcce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:40.802146 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb613d0-3e34-4bf2-abba-ac3389afcce5 admin admin] PATH_INFO: `/v3/projects/1d8b2492e39f4ae6959dfba4f99296ef` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:40.803344 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb613d0-3e34-4bf2-abba-ac3389afcce5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d8b2492e39f4ae6959dfba4f99296ef)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:40.805290 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb613d0-3e34-4bf2-abba-ac3389afcce5 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:40.899282 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-6eb613d0-3e34-4bf2-abba-ac3389afcce5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d8b2492e39f4ae6959dfba4f99296ef', 'request_id': 'req-6eb613d0-3e34-4bf2-abba-ac3389afcce5'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:41.031335 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-6eb613d0-3e34-4bf2-abba-ac3389afcce5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d8b2492e39f4ae6959dfba4f99296ef', 'request_id': 'req-6eb613d0-3e34-4bf2-abba-ac3389afcce5'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:41.038258 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-6eb613d0-3e34-4bf2-abba-ac3389afcce5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d8b2492e39f4ae6959dfba4f99296ef', 'request_id': 'req-6eb613d0-3e34-4bf2-abba-ac3389afcce5'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:41.050206 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-6eb613d0-3e34-4bf2-abba-ac3389afcce5 admin admin] The token cache is being invalidate because project 1d8b2492e39f4ae6959dfba4f99296ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:38:41.050488 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-6eb613d0-3e34-4bf2-abba-ac3389afcce5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:41.051160 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-6eb613d0-3e34-4bf2-abba-ac3389afcce5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:41.052928 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1357/2719] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:38:40 2021] DELETE /identity/v3/projects/1d8b2492e39f4ae6959dfba4f99296ef => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:38:41.061632 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9c25e-5bb4-4448-95fb-4c7aa9b959f7 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:41.062166 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9c25e-5bb4-4448-95fb-4c7aa9b959f7 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:41.062266 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9c25e-5bb4-4448-95fb-4c7aa9b959f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:41.080817 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-ede9c25e-5bb4-4448-95fb-4c7aa9b959f7 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:38:41.082445 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-ede9c25e-5bb4-4448-95fb-4c7aa9b959f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:41.139032 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1363/2720] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:38:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:38:41.146958 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9e8f9-1bcd-49db-9112-2f6ef01618a7 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:41.147242 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9e8f9-1bcd-49db-9112-2f6ef01618a7 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:41.147510 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9e8f9-1bcd-49db-9112-2f6ef01618a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:41.168341 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-7ab9e8f9-1bcd-49db-9112-2f6ef01618a7 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:38:41.169741 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-7ab9e8f9-1bcd-49db-9112-2f6ef01618a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:41.178657 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1358/2721] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:38:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:38:41.182858 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede9c25e-5bb4-4448-95fb-4c7aa9b959f7 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:41.192232 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede9c25e-5bb4-4448-95fb-4c7aa9b959f7 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:41.196830 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fc7fa5-2e99-4089-ac0f-1697a0754dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:41.197471 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc7fa5-2e99-4089-ac0f-1697a0754dd5 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:41.197748 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc7fa5-2e99-4089-ac0f-1697a0754dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:41.198020 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc7fa5-2e99-4089-ac0f-1697a0754dd5 admin admin] PATH_INFO: `/v3/domains` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:41.198739 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fc7fa5-2e99-4089-ac0f-1697a0754dd5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:38:41.199245 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fc7fa5-2e99-4089-ac0f-1697a0754dd5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:41.200655 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fc7fa5-2e99-4089-ac0f-1697a0754dd5 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:41.212292 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1364/2722] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 12 18:38:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:38:41.216649 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab9e8f9-1bcd-49db-9112-2f6ef01618a7 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:41.226561 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab9e8f9-1bcd-49db-9112-2f6ef01618a7 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:41.231590 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ec242-aae4-4868-8168-50286df945e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:41.232493 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ec242-aae4-4868-8168-50286df945e8 admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:41.232712 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ec242-aae4-4868-8168-50286df945e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:41.232995 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ec242-aae4-4868-8168-50286df945e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:41.233703 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779ec242-aae4-4868-8168-50286df945e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:41.236385 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779ec242-aae4-4868-8168-50286df945e8 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:41.346105 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1359/2723] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:38:41 2021] POST /identity/v3/projects => generated 391 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:38:41.350414 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fc7fa5-2e99-4089-ac0f-1697a0754dd5 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:41.360422 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fc7fa5-2e99-4089-ac0f-1697a0754dd5 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:41.419336 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ea95fa-b50d-40e6-9dda-3969a6c268b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:41.419914 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea95fa-b50d-40e6-9dda-3969a6c268b2 admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:41.420191 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea95fa-b50d-40e6-9dda-3969a6c268b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:41.420563 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea95fa-b50d-40e6-9dda-3969a6c268b2 admin admin] PATH_INFO: `/v3/users` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:41.421265 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ea95fa-b50d-40e6-9dda-3969a6c268b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:41.423868 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ea95fa-b50d-40e6-9dda-3969a6c268b2 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:41.523918 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1365/2724] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:38:41 2021] POST /identity/v3/users => generated 296 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:38:41.527930 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ec242-aae4-4868-8168-50286df945e8 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:41.539051 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ec242-aae4-4868-8168-50286df945e8 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:41.543739 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db634d0b-5e2d-48ee-b114-d94670c82742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:41.544388 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db634d0b-5e2d-48ee-b114-d94670c82742 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:41.544699 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db634d0b-5e2d-48ee-b114-d94670c82742 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:41.544971 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db634d0b-5e2d-48ee-b114-d94670c82742 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:41.545723 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db634d0b-5e2d-48ee-b114-d94670c82742 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:41.547304 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db634d0b-5e2d-48ee-b114-d94670c82742 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:41.558060 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1360/2725] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:38:41 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 18:38:41.562032 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ea95fa-b50d-40e6-9dda-3969a6c268b2 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:41.571882 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ea95fa-b50d-40e6-9dda-3969a6c268b2 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:41.576767 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda6c3cc-7d69-478d-aed1-f065ef5acd33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:41.577415 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6c3cc-7d69-478d-aed1-f065ef5acd33 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:41.577698 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6c3cc-7d69-478d-aed1-f065ef5acd33 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:41.577976 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6c3cc-7d69-478d-aed1-f065ef5acd33 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:41.578712 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda6c3cc-7d69-478d-aed1-f065ef5acd33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:41.580860 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda6c3cc-7d69-478d-aed1-f065ef5acd33 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:41.590968 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1366/2726] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:38:41 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:38:41.595752 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db634d0b-5e2d-48ee-b114-d94670c82742 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:41.605687 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db634d0b-5e2d-48ee-b114-d94670c82742 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:41.610325 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bffed8-2d98-4d3d-800b-f1b74406a523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:41.611198 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bffed8-2d98-4d3d-800b-f1b74406a523 admin admin] REQUEST_METHOD: `PUT` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:41.611500 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bffed8-2d98-4d3d-800b-f1b74406a523 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:41.611779 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bffed8-2d98-4d3d-800b-f1b74406a523 admin admin] PATH_INFO: `/v3/projects/30037f7278fc46ddac1e10166a9be899/users/61f92ebe8a374c06bd9c00562a68a427/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:41.627141 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bffed8-2d98-4d3d-800b-f1b74406a523 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30037f7278fc46ddac1e10166a9be899, user_id=61f92ebe8a374c06bd9c00562a68a427, role_id=33b8a5a8d1d643f2a98f598e6ab0a1cf)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:41.629859 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bffed8-2d98-4d3d-800b-f1b74406a523 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:41.711612 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1361/2727] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:38:41 2021] PUT /identity/v3/projects/30037f7278fc46ddac1e10166a9be899/users/61f92ebe8a374c06bd9c00562a68a427/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:38:41.723766 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2057d28d-8432-4888-b4e8-4283eaea70df None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:41.724051 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2057d28d-8432-4888-b4e8-4283eaea70df None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:41.724328 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2057d28d-8432-4888-b4e8-4283eaea70df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:41.750326 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-2057d28d-8432-4888-b4e8-4283eaea70df None None] MFA Rules not processed for user `61f92ebe8a374c06bd9c00562a68a427`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:38:41.751631 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-2057d28d-8432-4888-b4e8-4283eaea70df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:41.815204 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1367/2728] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:38:41 2021] POST /identity/v3/auth/tokens => generated 3411 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:38:41.819716 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bffed8-2d98-4d3d-800b-f1b74406a523 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:41.880307 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bffed8-2d98-4d3d-800b-f1b74406a523 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:41.884876 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec079b-d72a-46ff-bfab-53ad281121c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:41.885550 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec079b-d72a-46ff-bfab-53ad281121c9 admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:41.885826 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec079b-d72a-46ff-bfab-53ad281121c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:41.886096 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec079b-d72a-46ff-bfab-53ad281121c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:41.886794 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cec079b-d72a-46ff-bfab-53ad281121c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:41.888712 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cec079b-d72a-46ff-bfab-53ad281121c9 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:41.992912 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1362/2729] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:38:41 2021] POST /identity/v3/projects => generated 391 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 18:38:41.999203 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2057d28d-8432-4888-b4e8-4283eaea70df None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:42.010440 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2057d28d-8432-4888-b4e8-4283eaea70df None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:42.066209 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97989265-42a7-462e-86ec-c03ec3d4f778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:42.066896 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97989265-42a7-462e-86ec-c03ec3d4f778 admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:42.067153 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97989265-42a7-462e-86ec-c03ec3d4f778 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:42.067430 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97989265-42a7-462e-86ec-c03ec3d4f778 admin admin] PATH_INFO: `/v3/users` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:42.068127 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97989265-42a7-462e-86ec-c03ec3d4f778 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:42.070146 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97989265-42a7-462e-86ec-c03ec3d4f778 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:42.173825 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1368/2730] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:38:41 2021] POST /identity/v3/users => generated 302 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:38:42.178411 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec079b-d72a-46ff-bfab-53ad281121c9 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:42.188652 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec079b-d72a-46ff-bfab-53ad281121c9 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:42.193536 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af4c3d1-0346-4f9a-9dbb-ab6f0175f562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:42.194204 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af4c3d1-0346-4f9a-9dbb-ab6f0175f562 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:42.194482 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af4c3d1-0346-4f9a-9dbb-ab6f0175f562 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:42.194751 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af4c3d1-0346-4f9a-9dbb-ab6f0175f562 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:42.195523 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af4c3d1-0346-4f9a-9dbb-ab6f0175f562 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:42.197152 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af4c3d1-0346-4f9a-9dbb-ab6f0175f562 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:42.208238 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1363/2731] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:38:42 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:38:42.212692 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97989265-42a7-462e-86ec-c03ec3d4f778 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:42.224894 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97989265-42a7-462e-86ec-c03ec3d4f778 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:42.229511 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60d7689-1457-4aaa-8145-3e478c087556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:42.230397 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60d7689-1457-4aaa-8145-3e478c087556 admin admin] REQUEST_METHOD: `PUT` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:42.230677 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60d7689-1457-4aaa-8145-3e478c087556 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:42.230952 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60d7689-1457-4aaa-8145-3e478c087556 admin admin] PATH_INFO: `/v3/projects/541de87852db45ffa446e7096eec0a58/users/3359070bef6e4bc5a82773198602347c/roles/6c54f239944d46e3b027ccce97eb8b49` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:42.245465 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60d7689-1457-4aaa-8145-3e478c087556 admin admin] RBAC: Authorizing `identity:create_grant(project_id=541de87852db45ffa446e7096eec0a58, user_id=3359070bef6e4bc5a82773198602347c, role_id=6c54f239944d46e3b027ccce97eb8b49)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:42.249222 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60d7689-1457-4aaa-8145-3e478c087556 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:42.336003 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1369/2732] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:38:42 2021] PUT /identity/v3/projects/541de87852db45ffa446e7096eec0a58/users/3359070bef6e4bc5a82773198602347c/roles/6c54f239944d46e3b027ccce97eb8b49 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:38:42.339913 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af4c3d1-0346-4f9a-9dbb-ab6f0175f562 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:42.350282 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af4c3d1-0346-4f9a-9dbb-ab6f0175f562 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:42.409977 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c95ba78-4e83-4d27-a721-fc041c3c5c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:42.410641 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c95ba78-4e83-4d27-a721-fc041c3c5c31 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:42.410921 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c95ba78-4e83-4d27-a721-fc041c3c5c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:42.411192 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c95ba78-4e83-4d27-a721-fc041c3c5c31 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:42.411919 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c95ba78-4e83-4d27-a721-fc041c3c5c31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:42.413602 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c95ba78-4e83-4d27-a721-fc041c3c5c31 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:42.423274 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1364/2733] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:38:42 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:38:42.427292 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60d7689-1457-4aaa-8145-3e478c087556 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:42.437110 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60d7689-1457-4aaa-8145-3e478c087556 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:42.441648 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a0fee-9c08-42bc-b531-5810fdb85ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:42.442511 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a0fee-9c08-42bc-b531-5810fdb85ff2 admin admin] REQUEST_METHOD: `PUT` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:42.442792 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a0fee-9c08-42bc-b531-5810fdb85ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:42.443063 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a0fee-9c08-42bc-b531-5810fdb85ff2 admin admin] PATH_INFO: `/v3/projects/541de87852db45ffa446e7096eec0a58/users/3359070bef6e4bc5a82773198602347c/roles/6c54f239944d46e3b027ccce97eb8b49` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:42.445032 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603a0fee-9c08-42bc-b531-5810fdb85ff2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=541de87852db45ffa446e7096eec0a58, user_id=3359070bef6e4bc5a82773198602347c, role_id=6c54f239944d46e3b027ccce97eb8b49)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:42.447713 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603a0fee-9c08-42bc-b531-5810fdb85ff2 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:42.459703 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1370/2734] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:38:42 2021] PUT /identity/v3/projects/541de87852db45ffa446e7096eec0a58/users/3359070bef6e4bc5a82773198602347c/roles/6c54f239944d46e3b027ccce97eb8b49 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:38:42.469725 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d371e0-6a49-472b-afae-3dda70762825 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:42.470015 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d371e0-6a49-472b-afae-3dda70762825 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:42.479681 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d371e0-6a49-472b-afae-3dda70762825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:42.496338 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-34d371e0-6a49-472b-afae-3dda70762825 None None] MFA Rules not processed for user `3359070bef6e4bc5a82773198602347c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:38:42.497604 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-34d371e0-6a49-472b-afae-3dda70762825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:42.565382 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1365/2735] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:38:42 2021] POST /identity/v3/auth/tokens => generated 3478 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:38:42.575616 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a0fee-9c08-42bc-b531-5810fdb85ff2 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:42.577441 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-603a0fee-9c08-42bc-b531-5810fdb85ff2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:42.633542 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a0fee-9c08-42bc-b531-5810fdb85ff2 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:42.637291 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee046877-886a-4c01-bdfe-a9b359b0b9e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6966ce0774f4437a9b688494e9d0574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:42.637935 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee046877-886a-4c01-bdfe-a9b359b0b9e2 service cinder] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:42.638219 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee046877-886a-4c01-bdfe-a9b359b0b9e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:42.638495 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee046877-886a-4c01-bdfe-a9b359b0b9e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:42.648538 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee046877-886a-4c01-bdfe-a9b359b0b9e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:42.649979 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee046877-886a-4c01-bdfe-a9b359b0b9e2 service cinder] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:42.659457 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1371/2736] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:38:42 2021] GET /identity/v3/auth/tokens => generated 3478 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:38:42.701680 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d371e0-6a49-472b-afae-3dda70762825 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:42.703051 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-34d371e0-6a49-472b-afae-3dda70762825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:42.715315 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d371e0-6a49-472b-afae-3dda70762825 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:42.719047 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382aaa6b-af09-4f83-bff6-276500b15eb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6966ce0774f4437a9b688494e9d0574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:42.719681 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382aaa6b-af09-4f83-bff6-276500b15eb2 service cinder] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:42.719965 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382aaa6b-af09-4f83-bff6-276500b15eb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:42.720238 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382aaa6b-af09-4f83-bff6-276500b15eb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:42.775279 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382aaa6b-af09-4f83-bff6-276500b15eb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:42.776767 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382aaa6b-af09-4f83-bff6-276500b15eb2 service cinder] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:42.785872 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1366/2737] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:38:42 2021] GET /identity/v3/auth/tokens => generated 3411 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 18:38:47.420576 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee046877-886a-4c01-bdfe-a9b359b0b9e2 service cinder] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:47.482247 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee046877-886a-4c01-bdfe-a9b359b0b9e2 service cinder] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:47.486649 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2306c7b8-5955-48a9-a3d8-aeb66eb78e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:47.487499 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306c7b8-5955-48a9-a3d8-aeb66eb78e49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:47.487774 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306c7b8-5955-48a9-a3d8-aeb66eb78e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:47.488045 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306c7b8-5955-48a9-a3d8-aeb66eb78e49 admin admin] PATH_INFO: `/v3/users/61f92ebe8a374c06bd9c00562a68a427` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:47.489276 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2306c7b8-5955-48a9-a3d8-aeb66eb78e49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61f92ebe8a374c06bd9c00562a68a427)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:47.491956 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2306c7b8-5955-48a9-a3d8-aeb66eb78e49 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:47.632109 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-2306c7b8-5955-48a9-a3d8-aeb66eb78e49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61f92ebe8a374c06bd9c00562a68a427'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:47.632936 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-2306c7b8-5955-48a9-a3d8-aeb66eb78e49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61f92ebe8a374c06bd9c00562a68a427'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:47.646412 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-2306c7b8-5955-48a9-a3d8-aeb66eb78e49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61f92ebe8a374c06bd9c00562a68a427'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:47.647115 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-2306c7b8-5955-48a9-a3d8-aeb66eb78e49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61f92ebe8a374c06bd9c00562a68a427'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:47.653590 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-2306c7b8-5955-48a9-a3d8-aeb66eb78e49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61f92ebe8a374c06bd9c00562a68a427'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:47.728373 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1372/2738] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:38:47 2021] DELETE /identity/v3/users/61f92ebe8a374c06bd9c00562a68a427 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:38:47.733240 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9374861b-9a66-4fee-8441-b452d1043f8c None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:47.733697 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9374861b-9a66-4fee-8441-b452d1043f8c None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:47.733797 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9374861b-9a66-4fee-8441-b452d1043f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:47.751694 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-9374861b-9a66-4fee-8441-b452d1043f8c None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:38:47.752924 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-9374861b-9a66-4fee-8441-b452d1043f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:47.809791 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1367/2739] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:38:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:38:47.821268 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2306c7b8-5955-48a9-a3d8-aeb66eb78e49 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:47.822853 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-2306c7b8-5955-48a9-a3d8-aeb66eb78e49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:47.880163 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2306c7b8-5955-48a9-a3d8-aeb66eb78e49 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:47.884214 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff8d6ce-79fa-4b2f-a960-4e7f933f7e79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:47.885009 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff8d6ce-79fa-4b2f-a960-4e7f933f7e79 service neutron] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:47.885295 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff8d6ce-79fa-4b2f-a960-4e7f933f7e79 service neutron] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:47.885568 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff8d6ce-79fa-4b2f-a960-4e7f933f7e79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:47.895874 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff8d6ce-79fa-4b2f-a960-4e7f933f7e79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:47.897347 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff8d6ce-79fa-4b2f-a960-4e7f933f7e79 service neutron] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:47.907757 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1373/2740] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:38:47 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:38:48.318529 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9374861b-9a66-4fee-8441-b452d1043f8c None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:48.319961 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-9374861b-9a66-4fee-8441-b452d1043f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:48.332266 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9374861b-9a66-4fee-8441-b452d1043f8c None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:48.336942 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccf9df1-df41-49d5-86fb-9005f49125a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:48.337798 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf9df1-df41-49d5-86fb-9005f49125a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:48.338078 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf9df1-df41-49d5-86fb-9005f49125a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:48.338375 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf9df1-df41-49d5-86fb-9005f49125a0 admin admin] PATH_INFO: `/v3/projects/30037f7278fc46ddac1e10166a9be899` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:48.339785 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccf9df1-df41-49d5-86fb-9005f49125a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30037f7278fc46ddac1e10166a9be899)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:48.341780 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccf9df1-df41-49d5-86fb-9005f49125a0 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:48.436845 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-4ccf9df1-df41-49d5-86fb-9005f49125a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30037f7278fc46ddac1e10166a9be899', 'request_id': 'req-4ccf9df1-df41-49d5-86fb-9005f49125a0'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:48.493457 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-4ccf9df1-df41-49d5-86fb-9005f49125a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30037f7278fc46ddac1e10166a9be899', 'request_id': 'req-4ccf9df1-df41-49d5-86fb-9005f49125a0'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:48.500200 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-4ccf9df1-df41-49d5-86fb-9005f49125a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30037f7278fc46ddac1e10166a9be899', 'request_id': 'req-4ccf9df1-df41-49d5-86fb-9005f49125a0'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:48.511047 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-4ccf9df1-df41-49d5-86fb-9005f49125a0 admin admin] The token cache is being invalidate because project 30037f7278fc46ddac1e10166a9be899 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:38:48.511332 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-4ccf9df1-df41-49d5-86fb-9005f49125a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:48.511987 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-4ccf9df1-df41-49d5-86fb-9005f49125a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:48.513565 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1368/2741] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:38:48 2021] DELETE /identity/v3/projects/30037f7278fc46ddac1e10166a9be899 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:38:48.518016 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff8d6ce-79fa-4b2f-a960-4e7f933f7e79 service neutron] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:48.528240 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff8d6ce-79fa-4b2f-a960-4e7f933f7e79 service neutron] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:48.585233 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a5c182-1d44-46b9-a745-dc3c93c75d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:48.586096 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5c182-1d44-46b9-a745-dc3c93c75d23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:48.586378 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5c182-1d44-46b9-a745-dc3c93c75d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:48.586755 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5c182-1d44-46b9-a745-dc3c93c75d23 admin admin] PATH_INFO: `/v3/users/3359070bef6e4bc5a82773198602347c` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:48.587995 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a5c182-1d44-46b9-a745-dc3c93c75d23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3359070bef6e4bc5a82773198602347c)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:48.590432 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a5c182-1d44-46b9-a745-dc3c93c75d23 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:48.820839 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-e1a5c182-1d44-46b9-a745-dc3c93c75d23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3359070bef6e4bc5a82773198602347c'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:48.821501 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-e1a5c182-1d44-46b9-a745-dc3c93c75d23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3359070bef6e4bc5a82773198602347c'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:48.832743 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-e1a5c182-1d44-46b9-a745-dc3c93c75d23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3359070bef6e4bc5a82773198602347c'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:48.833540 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-e1a5c182-1d44-46b9-a745-dc3c93c75d23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3359070bef6e4bc5a82773198602347c'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:48.843099 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-e1a5c182-1d44-46b9-a745-dc3c93c75d23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3359070bef6e4bc5a82773198602347c'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:48.957268 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1374/2742] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:38:48 2021] DELETE /identity/v3/users/3359070bef6e4bc5a82773198602347c => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:38:49.306684 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccf9df1-df41-49d5-86fb-9005f49125a0 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:49.308172 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-4ccf9df1-df41-49d5-86fb-9005f49125a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:49.334410 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccf9df1-df41-49d5-86fb-9005f49125a0 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:49.396027 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8844b5-fb74-4298-8c45-e58155bc3155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:49.396941 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8844b5-fb74-4298-8c45-e58155bc3155 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:49.397221 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8844b5-fb74-4298-8c45-e58155bc3155 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:49.397488 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8844b5-fb74-4298-8c45-e58155bc3155 admin admin] PATH_INFO: `/v3/projects/541de87852db45ffa446e7096eec0a58` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:49.398668 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8844b5-fb74-4298-8c45-e58155bc3155 admin admin] RBAC: Authorizing `identity:delete_project(project_id=541de87852db45ffa446e7096eec0a58)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:49.400633 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8844b5-fb74-4298-8c45-e58155bc3155 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:49.482208 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-fe8844b5-fb74-4298-8c45-e58155bc3155 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '541de87852db45ffa446e7096eec0a58', 'request_id': 'req-fe8844b5-fb74-4298-8c45-e58155bc3155'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:49.560944 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-fe8844b5-fb74-4298-8c45-e58155bc3155 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '541de87852db45ffa446e7096eec0a58', 'request_id': 'req-fe8844b5-fb74-4298-8c45-e58155bc3155'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:49.567589 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-fe8844b5-fb74-4298-8c45-e58155bc3155 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '541de87852db45ffa446e7096eec0a58', 'request_id': 'req-fe8844b5-fb74-4298-8c45-e58155bc3155'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:49.577730 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-fe8844b5-fb74-4298-8c45-e58155bc3155 admin admin] The token cache is being invalidate because project 541de87852db45ffa446e7096eec0a58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:38:49.578016 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-fe8844b5-fb74-4298-8c45-e58155bc3155 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:49.578744 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-fe8844b5-fb74-4298-8c45-e58155bc3155 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:49.580443 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1369/2743] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:38:49 2021] DELETE /identity/v3/projects/541de87852db45ffa446e7096eec0a58 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:38:49.587007 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbbfce3-b616-48b9-abb0-27fdacd85120 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:49.587520 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbbfce3-b616-48b9-abb0-27fdacd85120 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:49.587638 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbbfce3-b616-48b9-abb0-27fdacd85120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:49.605847 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-5dbbfce3-b616-48b9-abb0-27fdacd85120 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:38:49.607118 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-5dbbfce3-b616-48b9-abb0-27fdacd85120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:49.666902 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1375/2744] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:38:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:38:49.674617 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04690a88-cb82-404e-931c-caf2dccc4844 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:49.674909 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04690a88-cb82-404e-931c-caf2dccc4844 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:49.675188 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04690a88-cb82-404e-931c-caf2dccc4844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:49.693469 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-04690a88-cb82-404e-931c-caf2dccc4844 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:38:49.694700 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-04690a88-cb82-404e-931c-caf2dccc4844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:49.702559 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1370/2745] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:38:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:38:49.707265 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbbfce3-b616-48b9-abb0-27fdacd85120 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:49.716799 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbbfce3-b616-48b9-abb0-27fdacd85120 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:49.721382 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88ac406-c426-440c-a784-209d83697197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:49.722024 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ac406-c426-440c-a784-209d83697197 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:49.722310 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ac406-c426-440c-a784-209d83697197 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:49.723159 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ac406-c426-440c-a784-209d83697197 admin admin] PATH_INFO: `/v3/domains` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:49.723967 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88ac406-c426-440c-a784-209d83697197 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:38:49.724292 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88ac406-c426-440c-a784-209d83697197 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:49.725960 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88ac406-c426-440c-a784-209d83697197 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:49.737865 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1376/2746] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 12 18:38:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:38:49.742212 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04690a88-cb82-404e-931c-caf2dccc4844 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:49.751197 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04690a88-cb82-404e-931c-caf2dccc4844 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:49.755918 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde29da-924c-4da2-89df-ab8866e98601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:49.756605 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde29da-924c-4da2-89df-ab8866e98601 admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:49.756897 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde29da-924c-4da2-89df-ab8866e98601 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:49.757173 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde29da-924c-4da2-89df-ab8866e98601 admin admin] PATH_INFO: `/v3/projects` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:49.757955 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dde29da-924c-4da2-89df-ab8866e98601 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:49.759892 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dde29da-924c-4da2-89df-ab8866e98601 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:49.867965 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1371/2747] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:38:49 2021] POST /identity/v3/projects => generated 389 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 18:38:49.870868 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88ac406-c426-440c-a784-209d83697197 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:49.880710 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88ac406-c426-440c-a784-209d83697197 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:49.940003 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88611cb7-5740-4c12-8667-7640f9440862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:49.940853 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88611cb7-5740-4c12-8667-7640f9440862 admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:49.941226 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88611cb7-5740-4c12-8667-7640f9440862 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:49.941543 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88611cb7-5740-4c12-8667-7640f9440862 admin admin] PATH_INFO: `/v3/users` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:49.942329 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88611cb7-5740-4c12-8667-7640f9440862 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:49.944497 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88611cb7-5740-4c12-8667-7640f9440862 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:50.071851 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1377/2748] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:38:49 2021] POST /identity/v3/users => generated 295 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:38:50.076355 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde29da-924c-4da2-89df-ab8866e98601 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:50.087611 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde29da-924c-4da2-89df-ab8866e98601 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:50.092288 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51943e4b-1c51-4aa5-b405-99bf8abbddad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:50.092978 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51943e4b-1c51-4aa5-b405-99bf8abbddad admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:50.093259 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51943e4b-1c51-4aa5-b405-99bf8abbddad admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:50.093533 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51943e4b-1c51-4aa5-b405-99bf8abbddad admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:50.094280 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51943e4b-1c51-4aa5-b405-99bf8abbddad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:50.095873 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51943e4b-1c51-4aa5-b405-99bf8abbddad admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:50.106298 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1372/2749] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:38:50 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:38:50.112021 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88611cb7-5740-4c12-8667-7640f9440862 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:50.122085 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88611cb7-5740-4c12-8667-7640f9440862 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:50.126631 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ea6b53-5bb0-4618-b6bc-d3295e8b38a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:50.127290 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ea6b53-5bb0-4618-b6bc-d3295e8b38a9 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:50.127599 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ea6b53-5bb0-4618-b6bc-d3295e8b38a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:50.127877 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ea6b53-5bb0-4618-b6bc-d3295e8b38a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:50.129161 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ea6b53-5bb0-4618-b6bc-d3295e8b38a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:50.130739 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ea6b53-5bb0-4618-b6bc-d3295e8b38a9 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:50.140298 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1378/2750] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:38:50 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:38:50.146953 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51943e4b-1c51-4aa5-b405-99bf8abbddad admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:50.157438 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51943e4b-1c51-4aa5-b405-99bf8abbddad admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:50.161986 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8813052-2022-4d37-9b54-45ab17612170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:50.162862 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8813052-2022-4d37-9b54-45ab17612170 admin admin] REQUEST_METHOD: `PUT` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:50.163142 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8813052-2022-4d37-9b54-45ab17612170 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:50.163418 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8813052-2022-4d37-9b54-45ab17612170 admin admin] PATH_INFO: `/v3/projects/7e47937bfb2b4ba98e5b3fce862ae384/users/0ba2200b51574c739fe311075f240538/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:50.177471 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8813052-2022-4d37-9b54-45ab17612170 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e47937bfb2b4ba98e5b3fce862ae384, user_id=0ba2200b51574c739fe311075f240538, role_id=33b8a5a8d1d643f2a98f598e6ab0a1cf)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:50.180169 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8813052-2022-4d37-9b54-45ab17612170 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:50.254713 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1373/2751] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:38:50 2021] PUT /identity/v3/projects/7e47937bfb2b4ba98e5b3fce862ae384/users/0ba2200b51574c739fe311075f240538/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:38:50.265722 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2529fbd9-31fb-44aa-b336-5de73f87dc1d None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:50.266010 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2529fbd9-31fb-44aa-b336-5de73f87dc1d None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:50.266328 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2529fbd9-31fb-44aa-b336-5de73f87dc1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:50.294256 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-2529fbd9-31fb-44aa-b336-5de73f87dc1d None None] MFA Rules not processed for user `0ba2200b51574c739fe311075f240538`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:38:50.295449 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-2529fbd9-31fb-44aa-b336-5de73f87dc1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:50.359939 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1379/2752] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:38:50 2021] POST /identity/v3/auth/tokens => generated 3409 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:38:50.364633 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8813052-2022-4d37-9b54-45ab17612170 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:50.424026 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8813052-2022-4d37-9b54-45ab17612170 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:50.429215 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da7b1de-5263-459f-b5f7-7dbe600606f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:50.429864 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7b1de-5263-459f-b5f7-7dbe600606f8 admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:50.430143 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7b1de-5263-459f-b5f7-7dbe600606f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:50.430415 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7b1de-5263-459f-b5f7-7dbe600606f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:50.431113 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da7b1de-5263-459f-b5f7-7dbe600606f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:50.433052 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da7b1de-5263-459f-b5f7-7dbe600606f8 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:50.558460 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1374/2753] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:38:50 2021] POST /identity/v3/projects => generated 389 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 18:38:50.562247 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2529fbd9-31fb-44aa-b336-5de73f87dc1d None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:50.573696 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2529fbd9-31fb-44aa-b336-5de73f87dc1d None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:50.626030 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74581bbc-6951-4763-ae5e-10b6480d7c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:50.626691 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74581bbc-6951-4763-ae5e-10b6480d7c44 admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:50.626974 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74581bbc-6951-4763-ae5e-10b6480d7c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:50.627244 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74581bbc-6951-4763-ae5e-10b6480d7c44 admin admin] PATH_INFO: `/v3/users` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:50.627964 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74581bbc-6951-4763-ae5e-10b6480d7c44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:50.630626 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74581bbc-6951-4763-ae5e-10b6480d7c44 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:50.739968 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1380/2754] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:38:50 2021] POST /identity/v3/users => generated 301 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 18:38:50.743881 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da7b1de-5263-459f-b5f7-7dbe600606f8 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:50.755139 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da7b1de-5263-459f-b5f7-7dbe600606f8 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:50.759689 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f21d3b4-8cee-4e63-9a7c-0e1dd0b242d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:50.760363 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f21d3b4-8cee-4e63-9a7c-0e1dd0b242d8 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:50.760670 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f21d3b4-8cee-4e63-9a7c-0e1dd0b242d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:50.761367 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f21d3b4-8cee-4e63-9a7c-0e1dd0b242d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:50.761772 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f21d3b4-8cee-4e63-9a7c-0e1dd0b242d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:50.763344 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f21d3b4-8cee-4e63-9a7c-0e1dd0b242d8 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:50.773751 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1375/2755] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:38:50 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:38:50.777773 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74581bbc-6951-4763-ae5e-10b6480d7c44 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:50.788511 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74581bbc-6951-4763-ae5e-10b6480d7c44 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:50.793176 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9bc3f2-f4a4-4ef4-8fc8-5cda247df8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:50.794111 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9bc3f2-f4a4-4ef4-8fc8-5cda247df8e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:50.794390 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9bc3f2-f4a4-4ef4-8fc8-5cda247df8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:50.794662 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9bc3f2-f4a4-4ef4-8fc8-5cda247df8e2 admin admin] PATH_INFO: `/v3/projects/af5a57476543470a89c80b1b4a4feb5e/users/975fb7d5580d43eb925f24ad386316b5/roles/6c54f239944d46e3b027ccce97eb8b49` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:50.816001 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9bc3f2-f4a4-4ef4-8fc8-5cda247df8e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af5a57476543470a89c80b1b4a4feb5e, user_id=975fb7d5580d43eb925f24ad386316b5, role_id=6c54f239944d46e3b027ccce97eb8b49)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:50.819466 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9bc3f2-f4a4-4ef4-8fc8-5cda247df8e2 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:50.887079 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1381/2756] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:38:50 2021] PUT /identity/v3/projects/af5a57476543470a89c80b1b4a4feb5e/users/975fb7d5580d43eb925f24ad386316b5/roles/6c54f239944d46e3b027ccce97eb8b49 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:38:50.890963 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f21d3b4-8cee-4e63-9a7c-0e1dd0b242d8 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:50.901009 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f21d3b4-8cee-4e63-9a7c-0e1dd0b242d8 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:50.975826 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff260270-08de-48fe-8b15-bcd0eb14d3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:50.976539 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff260270-08de-48fe-8b15-bcd0eb14d3b7 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:50.976821 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff260270-08de-48fe-8b15-bcd0eb14d3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:50.977096 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff260270-08de-48fe-8b15-bcd0eb14d3b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:50.977896 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff260270-08de-48fe-8b15-bcd0eb14d3b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:50.979483 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff260270-08de-48fe-8b15-bcd0eb14d3b7 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:50.994247 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1376/2757] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:38:50 2021] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:38:50.998172 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9bc3f2-f4a4-4ef4-8fc8-5cda247df8e2 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:51.008829 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9bc3f2-f4a4-4ef4-8fc8-5cda247df8e2 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:51.013588 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414a008f-6ee9-4784-90db-6e283204d175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:51.014462 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414a008f-6ee9-4784-90db-6e283204d175 admin admin] REQUEST_METHOD: `PUT` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:51.017245 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414a008f-6ee9-4784-90db-6e283204d175 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:51.017245 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414a008f-6ee9-4784-90db-6e283204d175 admin admin] PATH_INFO: `/v3/projects/af5a57476543470a89c80b1b4a4feb5e/users/975fb7d5580d43eb925f24ad386316b5/roles/6c54f239944d46e3b027ccce97eb8b49` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:51.017245 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414a008f-6ee9-4784-90db-6e283204d175 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af5a57476543470a89c80b1b4a4feb5e, user_id=975fb7d5580d43eb925f24ad386316b5, role_id=6c54f239944d46e3b027ccce97eb8b49)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:51.019959 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414a008f-6ee9-4784-90db-6e283204d175 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:51.030927 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1382/2758] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:38:50 2021] PUT /identity/v3/projects/af5a57476543470a89c80b1b4a4feb5e/users/975fb7d5580d43eb925f24ad386316b5/roles/6c54f239944d46e3b027ccce97eb8b49 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:38:51.042155 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf5fd5f-b891-4a15-b230-e8a33dc37306 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:51.042441 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf5fd5f-b891-4a15-b230-e8a33dc37306 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:51.042793 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf5fd5f-b891-4a15-b230-e8a33dc37306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:51.071153 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-aaf5fd5f-b891-4a15-b230-e8a33dc37306 None None] MFA Rules not processed for user `975fb7d5580d43eb925f24ad386316b5`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:38:51.072345 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-aaf5fd5f-b891-4a15-b230-e8a33dc37306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:51.143090 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1377/2759] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:38:51 2021] POST /identity/v3/auth/tokens => generated 3476 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:38:51.153516 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414a008f-6ee9-4784-90db-6e283204d175 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:51.155274 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-414a008f-6ee9-4784-90db-6e283204d175 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:51.216421 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414a008f-6ee9-4784-90db-6e283204d175 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:51.221373 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffa6ee5-c18c-40e1-a31f-7cd1de3e1a8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6966ce0774f4437a9b688494e9d0574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:51.222041 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa6ee5-c18c-40e1-a31f-7cd1de3e1a8f service cinder] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:51.222901 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa6ee5-c18c-40e1-a31f-7cd1de3e1a8f service cinder] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:51.223189 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa6ee5-c18c-40e1-a31f-7cd1de3e1a8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:51.232476 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffa6ee5-c18c-40e1-a31f-7cd1de3e1a8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:51.234039 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffa6ee5-c18c-40e1-a31f-7cd1de3e1a8f service cinder] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:51.243666 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1383/2760] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:38:51 2021] GET /identity/v3/auth/tokens => generated 3476 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:38:51.383873 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf5fd5f-b891-4a15-b230-e8a33dc37306 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:51.449056 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf5fd5f-b891-4a15-b230-e8a33dc37306 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:51.453936 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4926c463-1a67-416b-9635-579abf0035b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:51.454798 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4926c463-1a67-416b-9635-579abf0035b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:51.455070 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4926c463-1a67-416b-9635-579abf0035b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:51.455337 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4926c463-1a67-416b-9635-579abf0035b2 admin admin] PATH_INFO: `/v3/users/0ba2200b51574c739fe311075f240538` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:51.456586 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4926c463-1a67-416b-9635-579abf0035b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ba2200b51574c739fe311075f240538)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:51.459018 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4926c463-1a67-416b-9635-579abf0035b2 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:51.614777 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-4926c463-1a67-416b-9635-579abf0035b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ba2200b51574c739fe311075f240538'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:51.621701 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-4926c463-1a67-416b-9635-579abf0035b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ba2200b51574c739fe311075f240538'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:51.633728 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-4926c463-1a67-416b-9635-579abf0035b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ba2200b51574c739fe311075f240538'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:51.687508 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-4926c463-1a67-416b-9635-579abf0035b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ba2200b51574c739fe311075f240538'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:51.688119 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-4926c463-1a67-416b-9635-579abf0035b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ba2200b51574c739fe311075f240538'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:51.694477 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1378/2761] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:38:51 2021] DELETE /identity/v3/users/0ba2200b51574c739fe311075f240538 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:38:51.699010 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbbfd7-6eee-43c4-b4a5-4a0d2a4d8f86 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:51.699487 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbbfd7-6eee-43c4-b4a5-4a0d2a4d8f86 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:51.699605 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbbfd7-6eee-43c4-b4a5-4a0d2a4d8f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:51.718385 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-e3bbbfd7-6eee-43c4-b4a5-4a0d2a4d8f86 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:38:51.719569 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-e3bbbfd7-6eee-43c4-b4a5-4a0d2a4d8f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:51.774403 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1384/2762] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:38:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:38:51.784246 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4926c463-1a67-416b-9635-579abf0035b2 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:51.785862 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-4926c463-1a67-416b-9635-579abf0035b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:51.840209 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4926c463-1a67-416b-9635-579abf0035b2 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:51.843938 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8b1f94-0e2c-4cf6-9dda-6fe65052f0d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:51.844599 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b1f94-0e2c-4cf6-9dda-6fe65052f0d0 service neutron] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:51.844888 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b1f94-0e2c-4cf6-9dda-6fe65052f0d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:51.845163 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b1f94-0e2c-4cf6-9dda-6fe65052f0d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:51.853922 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8b1f94-0e2c-4cf6-9dda-6fe65052f0d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:51.857692 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8b1f94-0e2c-4cf6-9dda-6fe65052f0d0 service neutron] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:51.864615 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1379/2763] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:38:51 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:38:52.351340 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bbbfd7-6eee-43c4-b4a5-4a0d2a4d8f86 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:52.353438 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-e3bbbfd7-6eee-43c4-b4a5-4a0d2a4d8f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:52.367295 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bbbfd7-6eee-43c4-b4a5-4a0d2a4d8f86 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:52.372495 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408bc68e-1935-44ac-9e66-bba200c5ae75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:52.373424 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408bc68e-1935-44ac-9e66-bba200c5ae75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:52.373766 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408bc68e-1935-44ac-9e66-bba200c5ae75 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:52.374114 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408bc68e-1935-44ac-9e66-bba200c5ae75 admin admin] PATH_INFO: `/v3/projects/7e47937bfb2b4ba98e5b3fce862ae384` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:52.375970 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408bc68e-1935-44ac-9e66-bba200c5ae75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e47937bfb2b4ba98e5b3fce862ae384)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:52.378480 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408bc68e-1935-44ac-9e66-bba200c5ae75 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:52.475878 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-408bc68e-1935-44ac-9e66-bba200c5ae75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e47937bfb2b4ba98e5b3fce862ae384', 'request_id': 'req-408bc68e-1935-44ac-9e66-bba200c5ae75'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:52.481878 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-408bc68e-1935-44ac-9e66-bba200c5ae75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e47937bfb2b4ba98e5b3fce862ae384', 'request_id': 'req-408bc68e-1935-44ac-9e66-bba200c5ae75'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:52.486993 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-408bc68e-1935-44ac-9e66-bba200c5ae75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e47937bfb2b4ba98e5b3fce862ae384', 'request_id': 'req-408bc68e-1935-44ac-9e66-bba200c5ae75'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:52.531819 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-408bc68e-1935-44ac-9e66-bba200c5ae75 admin admin] The token cache is being invalidate because project 7e47937bfb2b4ba98e5b3fce862ae384 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74005) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:38:52.532097 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-408bc68e-1935-44ac-9e66-bba200c5ae75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:52.532739 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-408bc68e-1935-44ac-9e66-bba200c5ae75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:52.534236 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1385/2764] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:38:52 2021] DELETE /identity/v3/projects/7e47937bfb2b4ba98e5b3fce862ae384 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:38:52.538848 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8b1f94-0e2c-4cf6-9dda-6fe65052f0d0 service neutron] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:52.548342 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8b1f94-0e2c-4cf6-9dda-6fe65052f0d0 service neutron] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:52.601505 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e696577-ea61-43e7-ac7c-90d41044af43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:52.602365 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e696577-ea61-43e7-ac7c-90d41044af43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:52.602645 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e696577-ea61-43e7-ac7c-90d41044af43 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:52.602915 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e696577-ea61-43e7-ac7c-90d41044af43 admin admin] PATH_INFO: `/v3/users/975fb7d5580d43eb925f24ad386316b5` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:52.604113 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e696577-ea61-43e7-ac7c-90d41044af43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=975fb7d5580d43eb925f24ad386316b5)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:52.606065 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e696577-ea61-43e7-ac7c-90d41044af43 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:52.751893 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-3e696577-ea61-43e7-ac7c-90d41044af43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '975fb7d5580d43eb925f24ad386316b5'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:52.758500 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-3e696577-ea61-43e7-ac7c-90d41044af43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '975fb7d5580d43eb925f24ad386316b5'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:52.770517 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-3e696577-ea61-43e7-ac7c-90d41044af43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '975fb7d5580d43eb925f24ad386316b5'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:52.818925 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-3e696577-ea61-43e7-ac7c-90d41044af43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '975fb7d5580d43eb925f24ad386316b5'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:52.819533 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-3e696577-ea61-43e7-ac7c-90d41044af43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '975fb7d5580d43eb925f24ad386316b5'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:52.825450 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1380/2765] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:38:52 2021] DELETE /identity/v3/users/975fb7d5580d43eb925f24ad386316b5 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:38:53.259538 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408bc68e-1935-44ac-9e66-bba200c5ae75 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:53.260988 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-408bc68e-1935-44ac-9e66-bba200c5ae75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:53.274907 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408bc68e-1935-44ac-9e66-bba200c5ae75 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:53.328563 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8812b674-49fb-4b3f-9930-e6d1c6a4d3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:53.329416 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8812b674-49fb-4b3f-9930-e6d1c6a4d3c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:53.329702 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8812b674-49fb-4b3f-9930-e6d1c6a4d3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:53.329977 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8812b674-49fb-4b3f-9930-e6d1c6a4d3c1 admin admin] PATH_INFO: `/v3/projects/af5a57476543470a89c80b1b4a4feb5e` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:53.331162 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8812b674-49fb-4b3f-9930-e6d1c6a4d3c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af5a57476543470a89c80b1b4a4feb5e)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:53.333715 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8812b674-49fb-4b3f-9930-e6d1c6a4d3c1 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:53.435446 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-8812b674-49fb-4b3f-9930-e6d1c6a4d3c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af5a57476543470a89c80b1b4a4feb5e', 'request_id': 'req-8812b674-49fb-4b3f-9930-e6d1c6a4d3c1'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:53.442008 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-8812b674-49fb-4b3f-9930-e6d1c6a4d3c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af5a57476543470a89c80b1b4a4feb5e', 'request_id': 'req-8812b674-49fb-4b3f-9930-e6d1c6a4d3c1'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:53.447433 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-8812b674-49fb-4b3f-9930-e6d1c6a4d3c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af5a57476543470a89c80b1b4a4feb5e', 'request_id': 'req-8812b674-49fb-4b3f-9930-e6d1c6a4d3c1'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:53.506549 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-8812b674-49fb-4b3f-9930-e6d1c6a4d3c1 admin admin] The token cache is being invalidate because project af5a57476543470a89c80b1b4a4feb5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74005) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:38:53.506549 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-8812b674-49fb-4b3f-9930-e6d1c6a4d3c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:53.506549 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-8812b674-49fb-4b3f-9930-e6d1c6a4d3c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:38:53.507187 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1386/2766] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:38:53 2021] DELETE /identity/v3/projects/af5a57476543470a89c80b1b4a4feb5e => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:38:53.514130 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45a2ad-303a-4880-95d0-971665015aa7 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:53.514478 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45a2ad-303a-4880-95d0-971665015aa7 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:53.514761 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45a2ad-303a-4880-95d0-971665015aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:53.536638 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-1c45a2ad-303a-4880-95d0-971665015aa7 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:38:53.537768 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-1c45a2ad-303a-4880-95d0-971665015aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:53.594971 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1381/2767] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:38:53 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:38:53.604917 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b32b611-5b80-44df-ba82-8ee4134b6655 None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:53.605204 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b32b611-5b80-44df-ba82-8ee4134b6655 None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:53.605477 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b32b611-5b80-44df-ba82-8ee4134b6655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:53.624142 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-2b32b611-5b80-44df-ba82-8ee4134b6655 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:38:53.625395 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-2b32b611-5b80-44df-ba82-8ee4134b6655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:53.633969 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1387/2768] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:38:53 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:38:53.638131 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c45a2ad-303a-4880-95d0-971665015aa7 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:53.647834 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c45a2ad-303a-4880-95d0-971665015aa7 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:53.652492 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e310e64-2c19-4cd2-a9bd-09caa381b7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:53.653147 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e310e64-2c19-4cd2-a9bd-09caa381b7e7 admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:53.653433 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e310e64-2c19-4cd2-a9bd-09caa381b7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:53.653722 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e310e64-2c19-4cd2-a9bd-09caa381b7e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:53.654491 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e310e64-2c19-4cd2-a9bd-09caa381b7e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:38:53.654797 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e310e64-2c19-4cd2-a9bd-09caa381b7e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:53.656686 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e310e64-2c19-4cd2-a9bd-09caa381b7e7 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:53.668050 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1382/2769] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 12 18:38:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 18:38:53.676389 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b32b611-5b80-44df-ba82-8ee4134b6655 None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:53.685822 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b32b611-5b80-44df-ba82-8ee4134b6655 None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:53.690535 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56107cea-fb5e-4ab1-b255-194a3019884e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:53.691735 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56107cea-fb5e-4ab1-b255-194a3019884e admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:53.692015 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56107cea-fb5e-4ab1-b255-194a3019884e admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:53.692288 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56107cea-fb5e-4ab1-b255-194a3019884e admin admin] PATH_INFO: `/v3/projects` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:53.693017 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56107cea-fb5e-4ab1-b255-194a3019884e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:53.694922 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56107cea-fb5e-4ab1-b255-194a3019884e admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:53.790597 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1388/2770] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:38:53 2021] POST /identity/v3/projects => generated 373 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:38:53.794835 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e310e64-2c19-4cd2-a9bd-09caa381b7e7 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:53.805429 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e310e64-2c19-4cd2-a9bd-09caa381b7e7 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:53.859357 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc186a1b-6583-45e8-8929-4905c1f336ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:53.860013 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc186a1b-6583-45e8-8929-4905c1f336ba admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:53.860292 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc186a1b-6583-45e8-8929-4905c1f336ba admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:53.860599 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc186a1b-6583-45e8-8929-4905c1f336ba admin admin] PATH_INFO: `/v3/users` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:53.861301 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc186a1b-6583-45e8-8929-4905c1f336ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:53.863961 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc186a1b-6583-45e8-8929-4905c1f336ba admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:53.966918 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1383/2771] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:38:53 2021] POST /identity/v3/users => generated 287 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 18:38:53.971072 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56107cea-fb5e-4ab1-b255-194a3019884e admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:53.981890 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56107cea-fb5e-4ab1-b255-194a3019884e admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:53.986494 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634d05a9-fd5b-4114-b9dd-a20a34a635e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:53.987134 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d05a9-fd5b-4114-b9dd-a20a34a635e0 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:53.987413 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d05a9-fd5b-4114-b9dd-a20a34a635e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:53.987684 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d05a9-fd5b-4114-b9dd-a20a34a635e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:53.989100 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634d05a9-fd5b-4114-b9dd-a20a34a635e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:53.990678 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634d05a9-fd5b-4114-b9dd-a20a34a635e0 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:54.000777 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1389/2772] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:38:53 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:38:54.004745 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc186a1b-6583-45e8-8929-4905c1f336ba admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:54.014618 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc186a1b-6583-45e8-8929-4905c1f336ba admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:54.019293 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1161e72f-a6c6-4a38-aacd-9a0ef5c78b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:54.019942 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1161e72f-a6c6-4a38-aacd-9a0ef5c78b7b admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:54.020223 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1161e72f-a6c6-4a38-aacd-9a0ef5c78b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:54.020533 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1161e72f-a6c6-4a38-aacd-9a0ef5c78b7b admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:54.021265 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1161e72f-a6c6-4a38-aacd-9a0ef5c78b7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:54.022879 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1161e72f-a6c6-4a38-aacd-9a0ef5c78b7b admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:54.033177 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1384/2773] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:38:54 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:38:54.037843 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634d05a9-fd5b-4114-b9dd-a20a34a635e0 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:54.047549 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634d05a9-fd5b-4114-b9dd-a20a34a635e0 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:54.052955 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80c9be8-4c1f-4d2f-b682-287aa0674a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:54.053876 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c9be8-4c1f-4d2f-b682-287aa0674a96 admin admin] REQUEST_METHOD: `PUT` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:54.054159 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c9be8-4c1f-4d2f-b682-287aa0674a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:54.054434 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c9be8-4c1f-4d2f-b682-287aa0674a96 admin admin] PATH_INFO: `/v3/projects/de4e840d77e543a5b8086a8ea2388d0d/users/9299d54930d64d41ae33bab98ca7fd41/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:54.068270 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80c9be8-4c1f-4d2f-b682-287aa0674a96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de4e840d77e543a5b8086a8ea2388d0d, user_id=9299d54930d64d41ae33bab98ca7fd41, role_id=33b8a5a8d1d643f2a98f598e6ab0a1cf)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:54.070951 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80c9be8-4c1f-4d2f-b682-287aa0674a96 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:54.138501 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1390/2774] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:38:54 2021] PUT /identity/v3/projects/de4e840d77e543a5b8086a8ea2388d0d/users/9299d54930d64d41ae33bab98ca7fd41/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:38:54.154421 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb0b6e3-47f2-4f8b-8895-82f38ba20a4c None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:54.154742 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb0b6e3-47f2-4f8b-8895-82f38ba20a4c None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:54.155023 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb0b6e3-47f2-4f8b-8895-82f38ba20a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:54.181677 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-acb0b6e3-47f2-4f8b-8895-82f38ba20a4c None None] MFA Rules not processed for user `9299d54930d64d41ae33bab98ca7fd41`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:38:54.182877 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-acb0b6e3-47f2-4f8b-8895-82f38ba20a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:54.245216 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1385/2775] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:38:54 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:38:54.254825 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80c9be8-4c1f-4d2f-b682-287aa0674a96 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:38:54.256524 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-b80c9be8-4c1f-4d2f-b682-287aa0674a96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:54.310554 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80c9be8-4c1f-4d2f-b682-287aa0674a96 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:38:54.314203 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a82c7fe-ab88-471a-97c9-fa0997714238 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6966ce0774f4437a9b688494e9d0574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:38:54.314835 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a82c7fe-ab88-471a-97c9-fa0997714238 service cinder] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:54.315117 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a82c7fe-ab88-471a-97c9-fa0997714238 service cinder] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:54.315390 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a82c7fe-ab88-471a-97c9-fa0997714238 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:54.323435 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a82c7fe-ab88-471a-97c9-fa0997714238 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:38:54.324896 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a82c7fe-ab88-471a-97c9-fa0997714238 service cinder] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:38:54.333901 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1391/2776] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:38:54 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:38:57.170137 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b7bac2-78e4-4b98-9720-29e62356fa99 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:38:57.170615 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b7bac2-78e4-4b98-9720-29e62356fa99 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:38:57.170713 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b7bac2-78e4-4b98-9720-29e62356fa99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:38:57.187701 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-c4b7bac2-78e4-4b98-9720-29e62356fa99 None None] MFA Rules not processed for user `9299d54930d64d41ae33bab98ca7fd41`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:38:57.188923 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-c4b7bac2-78e4-4b98-9720-29e62356fa99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:38:57.195608 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1386/2777] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:38:57 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 26 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:39:15.550379 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a82c7fe-ab88-471a-97c9-fa0997714238 service cinder] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:39:15.551874 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-7a82c7fe-ab88-471a-97c9-fa0997714238 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:39:15.612253 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a82c7fe-ab88-471a-97c9-fa0997714238 service cinder] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:39:15.617851 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37889142-c9da-49f0-8151-cc3110b56760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:39:15.618773 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37889142-c9da-49f0-8151-cc3110b56760 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:39:15.618992 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37889142-c9da-49f0-8151-cc3110b56760 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:39:15.619266 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37889142-c9da-49f0-8151-cc3110b56760 admin admin] PATH_INFO: `/v3/users/a45d307917cd4726a66c39f1d3ebd505` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:39:15.620474 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37889142-c9da-49f0-8151-cc3110b56760 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a45d307917cd4726a66c39f1d3ebd505)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:39:15.622398 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37889142-c9da-49f0-8151-cc3110b56760 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:39:15.847477 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-37889142-c9da-49f0-8151-cc3110b56760 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a45d307917cd4726a66c39f1d3ebd505'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:39:15.848155 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-37889142-c9da-49f0-8151-cc3110b56760 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a45d307917cd4726a66c39f1d3ebd505'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:39:15.859895 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-37889142-c9da-49f0-8151-cc3110b56760 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a45d307917cd4726a66c39f1d3ebd505'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:39:15.860568 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-37889142-c9da-49f0-8151-cc3110b56760 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a45d307917cd4726a66c39f1d3ebd505'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:39:15.867654 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-37889142-c9da-49f0-8151-cc3110b56760 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a45d307917cd4726a66c39f1d3ebd505'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:39:15.954835 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1392/2778] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:39:15 2021] DELETE /identity/v3/users/a45d307917cd4726a66c39f1d3ebd505 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:39:15.959261 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7fca2c-6165-4f41-a330-b6e47105d533 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:39:15.959720 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7fca2c-6165-4f41-a330-b6e47105d533 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:39:15.959819 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7fca2c-6165-4f41-a330-b6e47105d533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:39:15.978638 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-3a7fca2c-6165-4f41-a330-b6e47105d533 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:39:15.979825 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-3a7fca2c-6165-4f41-a330-b6e47105d533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:39:16.035962 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1387/2779] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:39:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 18:39:16.047189 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37889142-c9da-49f0-8151-cc3110b56760 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:39:16.048631 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-37889142-c9da-49f0-8151-cc3110b56760 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:39:16.102856 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37889142-c9da-49f0-8151-cc3110b56760 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:39:16.106445 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496c1ddb-2a2b-4ec3-a018-d1ea2392f394 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:39:16.107072 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c1ddb-2a2b-4ec3-a018-d1ea2392f394 service neutron] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:39:16.107403 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c1ddb-2a2b-4ec3-a018-d1ea2392f394 service neutron] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:39:16.107706 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c1ddb-2a2b-4ec3-a018-d1ea2392f394 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:39:16.117139 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496c1ddb-2a2b-4ec3-a018-d1ea2392f394 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:39:16.118567 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496c1ddb-2a2b-4ec3-a018-d1ea2392f394 service neutron] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:39:16.127813 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1393/2780] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:39:16 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:39:16.523558 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7fca2c-6165-4f41-a330-b6e47105d533 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:39:16.526230 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-3a7fca2c-6165-4f41-a330-b6e47105d533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:39:16.547585 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7fca2c-6165-4f41-a330-b6e47105d533 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:39:16.559306 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2245d96e-7f76-46c5-b513-41c52a116592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:39:16.559306 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245d96e-7f76-46c5-b513-41c52a116592 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:39:16.559306 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245d96e-7f76-46c5-b513-41c52a116592 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:39:16.559306 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245d96e-7f76-46c5-b513-41c52a116592 admin admin] PATH_INFO: `/v3/projects/df7695557664485ab89be0e688121e85` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:39:16.559670 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2245d96e-7f76-46c5-b513-41c52a116592 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df7695557664485ab89be0e688121e85)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:39:16.559670 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2245d96e-7f76-46c5-b513-41c52a116592 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:39:16.694283 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-2245d96e-7f76-46c5-b513-41c52a116592 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df7695557664485ab89be0e688121e85', 'request_id': 'req-2245d96e-7f76-46c5-b513-41c52a116592'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:39:16.761006 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-2245d96e-7f76-46c5-b513-41c52a116592 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df7695557664485ab89be0e688121e85', 'request_id': 'req-2245d96e-7f76-46c5-b513-41c52a116592'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:39:16.767159 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-2245d96e-7f76-46c5-b513-41c52a116592 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df7695557664485ab89be0e688121e85', 'request_id': 'req-2245d96e-7f76-46c5-b513-41c52a116592'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:39:16.777527 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-2245d96e-7f76-46c5-b513-41c52a116592 admin admin] The token cache is being invalidate because project df7695557664485ab89be0e688121e85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:39:16.777809 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-2245d96e-7f76-46c5-b513-41c52a116592 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:39:16.778427 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-2245d96e-7f76-46c5-b513-41c52a116592 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:39:16.779934 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1388/2781] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:39:16 2021] DELETE /identity/v3/projects/df7695557664485ab89be0e688121e85 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:39:16.786137 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c298e-bf7e-4122-9423-9e307512db7a None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:39:16.786596 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c298e-bf7e-4122-9423-9e307512db7a None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:39:16.788225 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c298e-bf7e-4122-9423-9e307512db7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:39:16.805237 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-b87c298e-bf7e-4122-9423-9e307512db7a None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:39:16.806440 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-b87c298e-bf7e-4122-9423-9e307512db7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:39:16.862708 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1394/2782] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:39:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:39:16.871204 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8440e-83ef-4d46-b66f-4db561617ba7 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:39:16.871481 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8440e-83ef-4d46-b66f-4db561617ba7 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:39:16.871752 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8440e-83ef-4d46-b66f-4db561617ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:39:16.890291 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-c7c8440e-83ef-4d46-b66f-4db561617ba7 None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:39:16.891495 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-c7c8440e-83ef-4d46-b66f-4db561617ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:39:16.900059 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1389/2783] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:39:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:39:16.904198 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87c298e-bf7e-4122-9423-9e307512db7a None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:39:16.913933 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87c298e-bf7e-4122-9423-9e307512db7a None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:39:16.918553 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f44c89c-1195-40f5-87df-2b56165499c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:39:16.919217 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f44c89c-1195-40f5-87df-2b56165499c2 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:39:16.919478 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f44c89c-1195-40f5-87df-2b56165499c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:39:16.919752 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f44c89c-1195-40f5-87df-2b56165499c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:39:16.920512 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f44c89c-1195-40f5-87df-2b56165499c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=74005) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 18:39:16.920816 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f44c89c-1195-40f5-87df-2b56165499c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:39:16.922408 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f44c89c-1195-40f5-87df-2b56165499c2 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:39:16.933995 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1395/2784] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 12 18:39:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 18:39:16.938409 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c8440e-83ef-4d46-b66f-4db561617ba7 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:39:16.948721 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c8440e-83ef-4d46-b66f-4db561617ba7 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:39:16.952894 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87448569-004d-4b8b-b616-9179d23964b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:39:16.953576 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87448569-004d-4b8b-b616-9179d23964b9 admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:39:16.953854 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87448569-004d-4b8b-b616-9179d23964b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:39:16.954126 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87448569-004d-4b8b-b616-9179d23964b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:39:16.954831 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87448569-004d-4b8b-b616-9179d23964b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:39:16.956761 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87448569-004d-4b8b-b616-9179d23964b9 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:39:17.078903 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1390/2785] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:39:16 2021] POST /identity/v3/projects => generated 383 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:39:17.083014 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f44c89c-1195-40f5-87df-2b56165499c2 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:39:17.093087 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f44c89c-1195-40f5-87df-2b56165499c2 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:39:17.147419 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a25958-235b-4e35-93b6-aee395596bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:39:17.148111 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a25958-235b-4e35-93b6-aee395596bbc admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:39:17.148392 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a25958-235b-4e35-93b6-aee395596bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:39:17.148711 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a25958-235b-4e35-93b6-aee395596bbc admin admin] PATH_INFO: `/v3/users` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:39:17.149439 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a25958-235b-4e35-93b6-aee395596bbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:39:17.151353 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a25958-235b-4e35-93b6-aee395596bbc admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:39:17.235312 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1396/2786] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:39:17 2021] POST /identity/v3/users => generated 292 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 18:39:17.239242 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87448569-004d-4b8b-b616-9179d23964b9 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:39:17.249805 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87448569-004d-4b8b-b616-9179d23964b9 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:39:17.254301 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c738db1-1d0d-4f88-87e9-373ccade8e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:39:17.254954 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c738db1-1d0d-4f88-87e9-373ccade8e8c admin admin] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:39:17.255229 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c738db1-1d0d-4f88-87e9-373ccade8e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:39:17.255502 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c738db1-1d0d-4f88-87e9-373ccade8e8c admin admin] PATH_INFO: `/v3/roles` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:39:17.256886 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c738db1-1d0d-4f88-87e9-373ccade8e8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:39:17.262495 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c738db1-1d0d-4f88-87e9-373ccade8e8c admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:39:17.269346 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1391/2787] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:39:17 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:39:17.273046 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a25958-235b-4e35-93b6-aee395596bbc admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:39:17.283885 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a25958-235b-4e35-93b6-aee395596bbc admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:39:17.288938 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e268390-b5e8-40a8-9c62-bcc8c49f39f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:39:17.292048 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e268390-b5e8-40a8-9c62-bcc8c49f39f2 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:39:17.292048 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e268390-b5e8-40a8-9c62-bcc8c49f39f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:39:17.292048 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e268390-b5e8-40a8-9c62-bcc8c49f39f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:39:17.292048 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e268390-b5e8-40a8-9c62-bcc8c49f39f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:39:17.295285 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e268390-b5e8-40a8-9c62-bcc8c49f39f2 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:39:17.310433 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1397/2788] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:39:17 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 18:39:17.311583 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c738db1-1d0d-4f88-87e9-373ccade8e8c admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:39:17.323310 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c738db1-1d0d-4f88-87e9-373ccade8e8c admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:39:17.333538 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee84049-2135-4cf6-93c5-0dceea9486cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:39:17.338397 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee84049-2135-4cf6-93c5-0dceea9486cc admin admin] REQUEST_METHOD: `PUT` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:39:17.338397 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee84049-2135-4cf6-93c5-0dceea9486cc admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:39:17.338397 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee84049-2135-4cf6-93c5-0dceea9486cc admin admin] PATH_INFO: `/v3/projects/8636fe098af34b33b41c75cf2f0072d5/users/80631cd055354ed8ba8fa7888e4e319c/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:39:17.356515 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee84049-2135-4cf6-93c5-0dceea9486cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=8636fe098af34b33b41c75cf2f0072d5, user_id=80631cd055354ed8ba8fa7888e4e319c, role_id=33b8a5a8d1d643f2a98f598e6ab0a1cf)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:39:17.359186 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee84049-2135-4cf6-93c5-0dceea9486cc admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:39:17.512058 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1392/2789] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:39:17 2021] PUT /identity/v3/projects/8636fe098af34b33b41c75cf2f0072d5/users/80631cd055354ed8ba8fa7888e4e319c/roles/33b8a5a8d1d643f2a98f598e6ab0a1cf => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:39:17.517095 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d89cdd9-e60b-46d4-85bc-28aae9ef81ff None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:39:17.517386 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d89cdd9-e60b-46d4-85bc-28aae9ef81ff None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:39:17.517666 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d89cdd9-e60b-46d4-85bc-28aae9ef81ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:39:17.535576 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-3d89cdd9-e60b-46d4-85bc-28aae9ef81ff None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:39:17.536751 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-3d89cdd9-e60b-46d4-85bc-28aae9ef81ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:39:17.596040 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1398/2790] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:39:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:39:17.606375 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee84049-2135-4cf6-93c5-0dceea9486cc admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:39:17.616051 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-eee84049-2135-4cf6-93c5-0dceea9486cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:39:17.666109 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee84049-2135-4cf6-93c5-0dceea9486cc admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:39:17.669806 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cb79c1-df27-4f28-95f6-6f7adf70621b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:39:17.670440 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb79c1-df27-4f28-95f6-6f7adf70621b service neutron] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:39:17.670716 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb79c1-df27-4f28-95f6-6f7adf70621b service neutron] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:39:17.670985 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb79c1-df27-4f28-95f6-6f7adf70621b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:39:17.680364 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cb79c1-df27-4f28-95f6-6f7adf70621b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:39:17.681847 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cb79c1-df27-4f28-95f6-6f7adf70621b service neutron] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:39:17.691274 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1393/2791] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:39:17 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:39:17.722046 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d89cdd9-e60b-46d4-85bc-28aae9ef81ff None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:39:17.723420 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-3d89cdd9-e60b-46d4-85bc-28aae9ef81ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:39:17.813039 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d89cdd9-e60b-46d4-85bc-28aae9ef81ff None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:39:17.818471 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6504fb-1196-40fa-8c30-8a9fbd59f188 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bd99e4f2d444a388ecde7ea3cb61089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:39:17.819195 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6504fb-1196-40fa-8c30-8a9fbd59f188 service placement] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:39:17.819565 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6504fb-1196-40fa-8c30-8a9fbd59f188 service placement] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:39:17.819846 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6504fb-1196-40fa-8c30-8a9fbd59f188 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:39:17.821735 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-0f6504fb-1196-40fa-8c30-8a9fbd59f188 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:39:17.833566 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6504fb-1196-40fa-8c30-8a9fbd59f188 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:39:17.835664 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6504fb-1196-40fa-8c30-8a9fbd59f188 service placement] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:39:17.845711 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1399/2792] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:39:17 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:39:19.069524 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e361f671-be75-4e35-bedf-c172547bbdb2 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:39:19.075827 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e361f671-be75-4e35-bedf-c172547bbdb2 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:39:19.075827 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e361f671-be75-4e35-bedf-c172547bbdb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:39:19.128039 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-e361f671-be75-4e35-bedf-c172547bbdb2 None None] MFA Rules not processed for user `8f6a3a7064754fb79a0a06b3ad4a7d05`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:39:19.129282 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-e361f671-be75-4e35-bedf-c172547bbdb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:39:19.205953 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1394/2793] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Oct 12 18:39:19 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:39:19.349542 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6504fb-1196-40fa-8c30-8a9fbd59f188 service placement] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:39:19.351001 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-0f6504fb-1196-40fa-8c30-8a9fbd59f188 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:39:19.445727 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6504fb-1196-40fa-8c30-8a9fbd59f188 service placement] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:39:19.450743 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4387d1b-52c9-400c-a8b9-364eae2f51e5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f527f925af24eba8cabffe457fceb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:39:19.451383 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4387d1b-52c9-400c-a8b9-364eae2f51e5 service swift] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:39:19.451664 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4387d1b-52c9-400c-a8b9-364eae2f51e5 service swift] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:39:19.451937 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4387d1b-52c9-400c-a8b9-364eae2f51e5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:39:19.460029 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4387d1b-52c9-400c-a8b9-364eae2f51e5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:39:19.461660 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4387d1b-52c9-400c-a8b9-364eae2f51e5 service swift] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:39:19.469704 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1400/2794] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Oct 12 18:39:19 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 18:39:20.650824 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ccfe4-11c6-4d16-9741-bff28f0d7cc0 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:39:20.651339 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ccfe4-11c6-4d16-9741-bff28f0d7cc0 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:39:20.651823 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ccfe4-11c6-4d16-9741-bff28f0d7cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:39:20.681200 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-506ccfe4-11c6-4d16-9741-bff28f0d7cc0 None None] MFA Rules not processed for user `8f6a3a7064754fb79a0a06b3ad4a7d05`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:39:20.682416 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-506ccfe4-11c6-4d16-9741-bff28f0d7cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:39:20.703464 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1395/2795] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Oct 12 18:39:20 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:39:20.708014 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4387d1b-52c9-400c-a8b9-364eae2f51e5 service swift] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:39:20.725511 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4387d1b-52c9-400c-a8b9-364eae2f51e5 service swift] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:39:20.731762 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8255e09c-a731-4ef8-a7fe-c9f364227297 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f527f925af24eba8cabffe457fceb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:39:20.732548 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8255e09c-a731-4ef8-a7fe-c9f364227297 service swift] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:39:20.732906 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8255e09c-a731-4ef8-a7fe-c9f364227297 service swift] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:39:20.733257 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8255e09c-a731-4ef8-a7fe-c9f364227297 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:39:20.744273 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8255e09c-a731-4ef8-a7fe-c9f364227297 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:39:20.747221 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8255e09c-a731-4ef8-a7fe-c9f364227297 service swift] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:39:20.758452 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1401/2796] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Oct 12 18:39:20 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 12 18:39:21.365506 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c9111-e139-429c-bd0e-045c9cb34d0f None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:39:21.365787 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c9111-e139-429c-bd0e-045c9cb34d0f None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:39:21.366260 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c9111-e139-429c-bd0e-045c9cb34d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:39:21.385354 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-d21c9111-e139-429c-bd0e-045c9cb34d0f None None] MFA Rules not processed for user `8f6a3a7064754fb79a0a06b3ad4a7d05`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:39:21.386598 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-d21c9111-e139-429c-bd0e-045c9cb34d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:39:21.394730 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1396/2797] 10.222.0.18 () {58 vars in 967 bytes} [Tue Oct 12 18:39:21 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:39:21.408546 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8255e09c-a731-4ef8-a7fe-c9f364227297 service swift] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:39:21.420444 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8255e09c-a731-4ef8-a7fe-c9f364227297 service swift] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:39:21.426244 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2db77e6-f2db-441e-a9ba-9395a70dde4d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f527f925af24eba8cabffe457fceb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:39:21.427141 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db77e6-f2db-441e-a9ba-9395a70dde4d service swift] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:39:21.428016 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db77e6-f2db-441e-a9ba-9395a70dde4d service swift] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:39:21.428649 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db77e6-f2db-441e-a9ba-9395a70dde4d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:39:21.437501 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2db77e6-f2db-441e-a9ba-9395a70dde4d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:39:21.439516 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2db77e6-f2db-441e-a9ba-9395a70dde4d service swift] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:39:21.448937 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1402/2798] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Oct 12 18:39:21 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 18:39:23.190511 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd215dab-9f63-4d5a-9982-a399291722f2 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:39:23.191424 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd215dab-9f63-4d5a-9982-a399291722f2 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:39:23.191706 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd215dab-9f63-4d5a-9982-a399291722f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:39:23.221566 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-fd215dab-9f63-4d5a-9982-a399291722f2 None None] MFA Rules not processed for user `80631cd055354ed8ba8fa7888e4e319c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:39:23.222791 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-fd215dab-9f63-4d5a-9982-a399291722f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:39:23.305300 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1397/2799] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:39:23 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:39:23.309869 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2db77e6-f2db-441e-a9ba-9395a70dde4d service swift] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:39:23.321060 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2db77e6-f2db-441e-a9ba-9395a70dde4d service swift] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:39:23.326531 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54757f4-ec0e-411b-a684-56d3cd95c62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:39:23.327466 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54757f4-ec0e-411b-a684-56d3cd95c62a admin admin] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:39:23.327820 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54757f4-ec0e-411b-a684-56d3cd95c62a admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:39:23.328104 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54757f4-ec0e-411b-a684-56d3cd95c62a admin admin] PATH_INFO: `/v3/projects` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:39:23.328855 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54757f4-ec0e-411b-a684-56d3cd95c62a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:39:23.330775 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54757f4-ec0e-411b-a684-56d3cd95c62a admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:39:23.403095 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1403/2800] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Oct 12 18:39:23 2021] POST /identity/v3/projects => generated 385 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 18:39:23.407581 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd215dab-9f63-4d5a-9982-a399291722f2 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:39:23.419309 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd215dab-9f63-4d5a-9982-a399291722f2 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:39:23.476785 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3e86e7-edc7-4f7e-9d6a-b93e57c1ae1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:39:23.480644 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e86e7-edc7-4f7e-9d6a-b93e57c1ae1a admin admin] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:39:23.480644 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e86e7-edc7-4f7e-9d6a-b93e57c1ae1a admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:39:23.480644 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e86e7-edc7-4f7e-9d6a-b93e57c1ae1a admin admin] PATH_INFO: `/v3/users` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:39:23.480644 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3e86e7-edc7-4f7e-9d6a-b93e57c1ae1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:39:23.481044 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3e86e7-edc7-4f7e-9d6a-b93e57c1ae1a admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:39:23.585194 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1398/2801] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Oct 12 18:39:23 2021] POST /identity/v3/users => generated 299 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 18:39:23.589727 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54757f4-ec0e-411b-a684-56d3cd95c62a admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:39:23.600108 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54757f4-ec0e-411b-a684-56d3cd95c62a admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:39:23.605057 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e18c88-6a5c-4353-9632-50a595d87aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:39:23.605876 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e18c88-6a5c-4353-9632-50a595d87aaf admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:39:23.606160 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e18c88-6a5c-4353-9632-50a595d87aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:39:23.606435 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e18c88-6a5c-4353-9632-50a595d87aaf admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:39:23.607563 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e18c88-6a5c-4353-9632-50a595d87aaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:39:23.608872 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e18c88-6a5c-4353-9632-50a595d87aaf admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:39:23.620952 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1404/2802] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:39:23 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:39:23.625307 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3e86e7-edc7-4f7e-9d6a-b93e57c1ae1a admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:39:23.635210 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3e86e7-edc7-4f7e-9d6a-b93e57c1ae1a admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:39:23.639988 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ec1ade-6481-4ab5-a964-c9fb5814b11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:39:23.640900 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ec1ade-6481-4ab5-a964-c9fb5814b11d admin admin] REQUEST_METHOD: `PUT` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:39:23.641179 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ec1ade-6481-4ab5-a964-c9fb5814b11d admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:39:23.641453 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ec1ade-6481-4ab5-a964-c9fb5814b11d admin admin] PATH_INFO: `/v3/projects/1865fa2ebc104ef69e8ba3fbb30bf125/users/6d407660f2614242a7c34ec39258b0f9/roles/6c54f239944d46e3b027ccce97eb8b49` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:39:23.655670 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ec1ade-6481-4ab5-a964-c9fb5814b11d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1865fa2ebc104ef69e8ba3fbb30bf125, user_id=6d407660f2614242a7c34ec39258b0f9, role_id=6c54f239944d46e3b027ccce97eb8b49)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:39:23.658670 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ec1ade-6481-4ab5-a964-c9fb5814b11d admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:39:23.711174 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1399/2803] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:39:23 2021] PUT /identity/v3/projects/1865fa2ebc104ef69e8ba3fbb30bf125/users/6d407660f2614242a7c34ec39258b0f9/roles/6c54f239944d46e3b027ccce97eb8b49 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:39:23.715287 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e18c88-6a5c-4353-9632-50a595d87aaf admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:39:23.725718 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e18c88-6a5c-4353-9632-50a595d87aaf admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:39:23.781044 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0399ada7-37a3-4cec-897c-6567d7956071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:39:23.782158 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0399ada7-37a3-4cec-897c-6567d7956071 admin admin] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:39:23.782443 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0399ada7-37a3-4cec-897c-6567d7956071 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:39:23.782722 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0399ada7-37a3-4cec-897c-6567d7956071 admin admin] PATH_INFO: `/v3/roles` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:39:23.783466 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0399ada7-37a3-4cec-897c-6567d7956071 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:39:23.785188 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0399ada7-37a3-4cec-897c-6567d7956071 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:39:23.796065 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1405/2804] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Oct 12 18:39:23 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 18:39:23.800459 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ec1ade-6481-4ab5-a964-c9fb5814b11d admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:39:23.810570 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ec1ade-6481-4ab5-a964-c9fb5814b11d admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:39:23.815225 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29c2a18-a4eb-4672-a572-2a19c9a5a590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:39:23.816151 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c2a18-a4eb-4672-a572-2a19c9a5a590 admin admin] REQUEST_METHOD: `PUT` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:39:23.816376 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c2a18-a4eb-4672-a572-2a19c9a5a590 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:39:23.816682 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c2a18-a4eb-4672-a572-2a19c9a5a590 admin admin] PATH_INFO: `/v3/projects/1865fa2ebc104ef69e8ba3fbb30bf125/users/6d407660f2614242a7c34ec39258b0f9/roles/6c54f239944d46e3b027ccce97eb8b49` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:39:23.818642 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29c2a18-a4eb-4672-a572-2a19c9a5a590 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1865fa2ebc104ef69e8ba3fbb30bf125, user_id=6d407660f2614242a7c34ec39258b0f9, role_id=6c54f239944d46e3b027ccce97eb8b49)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:39:23.821308 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29c2a18-a4eb-4672-a572-2a19c9a5a590 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:39:23.831368 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1400/2805] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Oct 12 18:39:23 2021] PUT /identity/v3/projects/1865fa2ebc104ef69e8ba3fbb30bf125/users/6d407660f2614242a7c34ec39258b0f9/roles/6c54f239944d46e3b027ccce97eb8b49 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:39:24.316195 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0399ada7-37a3-4cec-897c-6567d7956071 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:39:24.325368 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-0399ada7-37a3-4cec-897c-6567d7956071 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:39:24.332114 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0399ada7-37a3-4cec-897c-6567d7956071 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:39:24.392577 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12d1c9c-142d-4515-a6af-196a0a3b86ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:39:24.394100 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d1c9c-142d-4515-a6af-196a0a3b86ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:39:24.394100 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d1c9c-142d-4515-a6af-196a0a3b86ae admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:39:24.394299 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d1c9c-142d-4515-a6af-196a0a3b86ae admin admin] PATH_INFO: `/v3/users/9299d54930d64d41ae33bab98ca7fd41` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:39:24.395407 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12d1c9c-142d-4515-a6af-196a0a3b86ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=9299d54930d64d41ae33bab98ca7fd41)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:39:24.397608 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12d1c9c-142d-4515-a6af-196a0a3b86ae admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:39:24.627338 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-a12d1c9c-142d-4515-a6af-196a0a3b86ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9299d54930d64d41ae33bab98ca7fd41'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:39:24.627338 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-a12d1c9c-142d-4515-a6af-196a0a3b86ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9299d54930d64d41ae33bab98ca7fd41'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:39:24.636011 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-a12d1c9c-142d-4515-a6af-196a0a3b86ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9299d54930d64d41ae33bab98ca7fd41'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:39:24.636999 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-a12d1c9c-142d-4515-a6af-196a0a3b86ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9299d54930d64d41ae33bab98ca7fd41'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:39:24.644042 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-a12d1c9c-142d-4515-a6af-196a0a3b86ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9299d54930d64d41ae33bab98ca7fd41'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:39:24.748695 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1406/2806] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:39:24 2021] DELETE /identity/v3/users/9299d54930d64d41ae33bab98ca7fd41 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:39:24.753171 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd38ffc1-fa57-4b1f-8d00-8f9e870c7dea None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:39:24.753702 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd38ffc1-fa57-4b1f-8d00-8f9e870c7dea None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:39:24.753702 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd38ffc1-fa57-4b1f-8d00-8f9e870c7dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:39:24.771169 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-dd38ffc1-fa57-4b1f-8d00-8f9e870c7dea None None] MFA Rules not processed for user `31651079c8d04df8a5fb70d40851475c`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:39:24.772922 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-dd38ffc1-fa57-4b1f-8d00-8f9e870c7dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:39:24.851101 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1401/2807] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:39:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:39:24.861909 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12d1c9c-142d-4515-a6af-196a0a3b86ae admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:39:24.863399 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-a12d1c9c-142d-4515-a6af-196a0a3b86ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:39:24.931126 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12d1c9c-142d-4515-a6af-196a0a3b86ae admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:39:24.935826 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78c2bd8-7540-4506-95c7-a036dfff173c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:39:24.936637 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c2bd8-7540-4506-95c7-a036dfff173c service neutron] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:39:24.937045 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c2bd8-7540-4506-95c7-a036dfff173c service neutron] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:39:24.937966 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c2bd8-7540-4506-95c7-a036dfff173c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:39:24.948540 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78c2bd8-7540-4506-95c7-a036dfff173c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:39:24.949996 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78c2bd8-7540-4506-95c7-a036dfff173c service neutron] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:39:24.961894 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1407/2808] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:39:24 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:39:25.216285 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd38ffc1-fa57-4b1f-8d00-8f9e870c7dea None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:39:25.218163 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-dd38ffc1-fa57-4b1f-8d00-8f9e870c7dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:39:25.239652 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd38ffc1-fa57-4b1f-8d00-8f9e870c7dea None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:39:25.253492 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cbd72a-bdc2-4601-ada8-7f1980032d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:39:25.254448 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbd72a-bdc2-4601-ada8-7f1980032d42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:39:25.258186 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbd72a-bdc2-4601-ada8-7f1980032d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:39:25.258511 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbd72a-bdc2-4601-ada8-7f1980032d42 admin admin] PATH_INFO: `/v3/projects/de4e840d77e543a5b8086a8ea2388d0d` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:39:25.260772 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cbd72a-bdc2-4601-ada8-7f1980032d42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de4e840d77e543a5b8086a8ea2388d0d)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:39:25.262777 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cbd72a-bdc2-4601-ada8-7f1980032d42 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:39:25.412541 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-f3cbd72a-bdc2-4601-ada8-7f1980032d42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de4e840d77e543a5b8086a8ea2388d0d', 'request_id': 'req-f3cbd72a-bdc2-4601-ada8-7f1980032d42'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:39:25.476218 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-f3cbd72a-bdc2-4601-ada8-7f1980032d42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de4e840d77e543a5b8086a8ea2388d0d', 'request_id': 'req-f3cbd72a-bdc2-4601-ada8-7f1980032d42'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:39:25.487476 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-f3cbd72a-bdc2-4601-ada8-7f1980032d42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de4e840d77e543a5b8086a8ea2388d0d', 'request_id': 'req-f3cbd72a-bdc2-4601-ada8-7f1980032d42'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:39:25.517809 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-f3cbd72a-bdc2-4601-ada8-7f1980032d42 admin admin] The token cache is being invalidate because project de4e840d77e543a5b8086a8ea2388d0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:39:25.518085 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-f3cbd72a-bdc2-4601-ada8-7f1980032d42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:39:25.518957 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-f3cbd72a-bdc2-4601-ada8-7f1980032d42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:39:25.522130 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1402/2809] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:39:25 2021] DELETE /identity/v3/projects/de4e840d77e543a5b8086a8ea2388d0d => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:39:29.494590 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e829b1-465b-4ccd-95b3-c445d461ab7f None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:39:29.495106 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e829b1-465b-4ccd-95b3-c445d461ab7f None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:39:29.495417 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e829b1-465b-4ccd-95b3-c445d461ab7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:39:29.522392 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-77e829b1-465b-4ccd-95b3-c445d461ab7f None None] MFA Rules not processed for user `6d407660f2614242a7c34ec39258b0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:39:29.523539 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-77e829b1-465b-4ccd-95b3-c445d461ab7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:39:29.594539 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1408/2810] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:39:29 2021] POST /identity/v3/auth/tokens => generated 3472 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:39:29.607931 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cbd72a-bdc2-4601-ada8-7f1980032d42 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:39:29.609467 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-f3cbd72a-bdc2-4601-ada8-7f1980032d42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:39:29.669898 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cbd72a-bdc2-4601-ada8-7f1980032d42 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:39:29.685141 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06f5222-97f2-43f8-9350-dd7dcc3107ef service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a3d3e5a5cfc4ac3afcece4e55f23552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:39:29.686102 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f5222-97f2-43f8-9350-dd7dcc3107ef service glance] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:39:29.686446 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f5222-97f2-43f8-9350-dd7dcc3107ef service glance] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:39:29.686726 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f5222-97f2-43f8-9350-dd7dcc3107ef service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:39:29.688613 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-d06f5222-97f2-43f8-9350-dd7dcc3107ef service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:39:29.759669 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06f5222-97f2-43f8-9350-dd7dcc3107ef service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:39:29.761175 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06f5222-97f2-43f8-9350-dd7dcc3107ef service glance] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:39:29.770650 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1403/2811] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:39:29 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:39:30.113172 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb16f5c-3095-4c19-87f5-deee4380d7ee None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:39:30.113470 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb16f5c-3095-4c19-87f5-deee4380d7ee None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:39:30.113758 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb16f5c-3095-4c19-87f5-deee4380d7ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:39:30.133628 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-4eb16f5c-3095-4c19-87f5-deee4380d7ee None None] MFA Rules not processed for user `8f6a3a7064754fb79a0a06b3ad4a7d05`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:39:30.134858 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-4eb16f5c-3095-4c19-87f5-deee4380d7ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:39:30.190052 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1409/2812] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Oct 12 18:39:30 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:39:30.203659 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06f5222-97f2-43f8-9350-dd7dcc3107ef service glance] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:39:30.205092 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-d06f5222-97f2-43f8-9350-dd7dcc3107ef service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:39:30.275553 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06f5222-97f2-43f8-9350-dd7dcc3107ef service glance] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:39:30.281765 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0def4e50-ee22-4b28-801a-4f0e2ff4a865 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f527f925af24eba8cabffe457fceb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:39:30.282420 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def4e50-ee22-4b28-801a-4f0e2ff4a865 service swift] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:39:30.282745 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def4e50-ee22-4b28-801a-4f0e2ff4a865 service swift] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:39:30.282990 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def4e50-ee22-4b28-801a-4f0e2ff4a865 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:39:30.291793 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0def4e50-ee22-4b28-801a-4f0e2ff4a865 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:39:30.293419 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0def4e50-ee22-4b28-801a-4f0e2ff4a865 service swift] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:39:30.301886 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1404/2813] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Oct 12 18:39:30 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 18:39:40.564533 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f1567-3cc8-4641-807c-2f8396abb49b None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:39:40.565042 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f1567-3cc8-4641-807c-2f8396abb49b None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:39:40.565198 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f1567-3cc8-4641-807c-2f8396abb49b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:39:40.581757 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-be9f1567-3cc8-4641-807c-2f8396abb49b None None] MFA Rules not processed for user `80631cd055354ed8ba8fa7888e4e319c`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:39:40.582973 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-be9f1567-3cc8-4641-807c-2f8396abb49b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:39:40.589853 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1410/2814] 10.222.0.18 () {58 vars in 957 bytes} [Tue Oct 12 18:39:40 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 26 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:39:44.583380 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ea4d0-dcea-4bef-a703-036913792f01 None None] REQUEST_METHOD: `POST` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:39:44.583872 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ea4d0-dcea-4bef-a703-036913792f01 None None] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:39:44.583993 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ea4d0-dcea-4bef-a703-036913792f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:39:44.601518 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.auth.core [None req-6a4ea4d0-dcea-4bef-a703-036913792f01 None None] MFA Rules not processed for user `8f6a3a7064754fb79a0a06b3ad4a7d05`. Rule list: `[]` (Enabled: `True`). {{(pid=74006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:39:44.602779 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-6a4ea4d0-dcea-4bef-a703-036913792f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:39:44.609982 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1405/2815] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Oct 12 18:39:44 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:39:44.625868 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f1567-3cc8-4641-807c-2f8396abb49b None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:39:44.639272 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f1567-3cc8-4641-807c-2f8396abb49b None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:39:44.644454 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb11f24-66dc-4ccb-8221-e1c18a10f837 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f527f925af24eba8cabffe457fceb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:39:44.645180 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb11f24-66dc-4ccb-8221-e1c18a10f837 service swift] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:39:44.645537 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb11f24-66dc-4ccb-8221-e1c18a10f837 service swift] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:39:44.645888 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb11f24-66dc-4ccb-8221-e1c18a10f837 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:39:44.654645 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb11f24-66dc-4ccb-8221-e1c18a10f837 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:39:44.656258 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb11f24-66dc-4ccb-8221-e1c18a10f837 service swift] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:39:44.664484 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1411/2816] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Oct 12 18:39:44 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 12 18:40:16.479361 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4ea4d0-dcea-4bef-a703-036913792f01 None None] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:40:16.481267 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-6a4ea4d0-dcea-4bef-a703-036913792f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:40:16.534008 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4ea4d0-dcea-4bef-a703-036913792f01 None None] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:40:16.537656 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6363b68c-82bd-4eea-9ee0-b060f240c576 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:40:16.538287 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6363b68c-82bd-4eea-9ee0-b060f240c576 service neutron] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:40:16.538591 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6363b68c-82bd-4eea-9ee0-b060f240c576 service neutron] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:40:16.538866 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6363b68c-82bd-4eea-9ee0-b060f240c576 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:40:16.548328 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6363b68c-82bd-4eea-9ee0-b060f240c576 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:40:16.549808 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6363b68c-82bd-4eea-9ee0-b060f240c576 service neutron] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:40:16.559607 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1406/2817] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:40:16 2021] GET /identity/v3/auth/tokens => generated 3472 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:41:19.559234 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb11f24-66dc-4ccb-8221-e1c18a10f837 service swift] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:41:19.569059 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb11f24-66dc-4ccb-8221-e1c18a10f837 service swift] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:41:19.573115 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7639c1-9b50-4077-83a9-f6e6272df5ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:41:19.573373 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7639c1-9b50-4077-83a9-f6e6272df5ea service neutron] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:41:19.573605 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7639c1-9b50-4077-83a9-f6e6272df5ea service neutron] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:41:19.573874 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7639c1-9b50-4077-83a9-f6e6272df5ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:41:19.575601 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-3a7639c1-9b50-4077-83a9-f6e6272df5ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:41:19.639684 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6363b68c-82bd-4eea-9ee0-b060f240c576 service neutron] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:41:19.641112 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-6363b68c-82bd-4eea-9ee0-b060f240c576 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:41:19.653353 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6363b68c-82bd-4eea-9ee0-b060f240c576 service neutron] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:41:19.660713 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7639c1-9b50-4077-83a9-f6e6272df5ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:41:19.660899 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce4e468-9e9d-485a-9820-4fc1e3ce5f99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:41:19.660899 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4e468-9e9d-485a-9820-4fc1e3ce5f99 service neutron] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:41:19.661138 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7639c1-9b50-4077-83a9-f6e6272df5ea service neutron] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:41:19.661242 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4e468-9e9d-485a-9820-4fc1e3ce5f99 service neutron] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:41:19.661242 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4e468-9e9d-485a-9820-4fc1e3ce5f99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:41:19.661242 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-6ce4e468-9e9d-485a-9820-4fc1e3ce5f99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:41:19.670330 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce4e468-9e9d-485a-9820-4fc1e3ce5f99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:41:19.671825 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce4e468-9e9d-485a-9820-4fc1e3ce5f99 service neutron] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:41:19.678565 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1412/2818] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:41:19 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:41:19.680977 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1407/2819] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:41:19 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 18:41:20.848475 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7639c1-9b50-4077-83a9-f6e6272df5ea service neutron] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:41:20.857072 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7639c1-9b50-4077-83a9-f6e6272df5ea service neutron] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:41:20.860647 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6621902e-e05e-41f3-9c5e-5e6ffca972f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1ea6f47a7c41aba102ad481f5ad5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:41:20.861273 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6621902e-e05e-41f3-9c5e-5e6ffca972f7 service neutron] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:41:20.861551 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6621902e-e05e-41f3-9c5e-5e6ffca972f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:41:20.861820 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6621902e-e05e-41f3-9c5e-5e6ffca972f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:41:20.863542 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-6621902e-e05e-41f3-9c5e-5e6ffca972f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:41:20.876379 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6621902e-e05e-41f3-9c5e-5e6ffca972f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:41:20.877820 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6621902e-e05e-41f3-9c5e-5e6ffca972f7 service neutron] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:41:20.888909 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1413/2820] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:41:20 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:42:35.254734 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce4e468-9e9d-485a-9820-4fc1e3ce5f99 service neutron] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:42:35.256274 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-6ce4e468-9e9d-485a-9820-4fc1e3ce5f99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:42:35.277869 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce4e468-9e9d-485a-9820-4fc1e3ce5f99 service neutron] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:42:35.286149 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e798dd4-ece9-4937-9280-6ef89343815d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3417097a280b499086b36df9a2548239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:42:35.286928 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e798dd4-ece9-4937-9280-6ef89343815d service nova] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:42:35.287276 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e798dd4-ece9-4937-9280-6ef89343815d service nova] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:42:35.287714 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e798dd4-ece9-4937-9280-6ef89343815d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:42:35.290005 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-0e798dd4-ece9-4937-9280-6ef89343815d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:42:35.304801 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e798dd4-ece9-4937-9280-6ef89343815d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:42:35.311876 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e798dd4-ece9-4937-9280-6ef89343815d service nova] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:42:35.329413 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1408/2821] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:42:35 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 18:42:43.049054 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76f5ff-f97e-4f8b-917a-906cf61841bb None None] REQUEST_METHOD: `POST` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:42:43.049558 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76f5ff-f97e-4f8b-917a-906cf61841bb None None] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:42:43.049672 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76f5ff-f97e-4f8b-917a-906cf61841bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:42:43.066913 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.auth.core [None req-0d76f5ff-f97e-4f8b-917a-906cf61841bb None None] MFA Rules not processed for user `8f6a3a7064754fb79a0a06b3ad4a7d05`. Rule list: `[]` (Enabled: `True`). {{(pid=74005) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 18:42:43.068107 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-0d76f5ff-f97e-4f8b-917a-906cf61841bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:42:43.075249 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1414/2822] 10.222.0.18 () {58 vars in 967 bytes} [Tue Oct 12 18:42:43 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 18:42:43.115750 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e798dd4-ece9-4937-9280-6ef89343815d service nova] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:42:43.126840 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e798dd4-ece9-4937-9280-6ef89343815d service nova] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:42:43.131851 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb391c0-0481-4114-881c-6cd652e7bf5b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f527f925af24eba8cabffe457fceb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:42:43.132522 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb391c0-0481-4114-881c-6cd652e7bf5b service swift] REQUEST_METHOD: `GET` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:42:43.132807 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb391c0-0481-4114-881c-6cd652e7bf5b service swift] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:42:43.133082 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb391c0-0481-4114-881c-6cd652e7bf5b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:42:43.141079 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb391c0-0481-4114-881c-6cd652e7bf5b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:42:43.142645 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb391c0-0481-4114-881c-6cd652e7bf5b service swift] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:42:43.150434 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1409/2823] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Oct 12 18:42:43 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 18:42:51.177763 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d76f5ff-f97e-4f8b-917a-906cf61841bb None None] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:42:51.177763 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-0d76f5ff-f97e-4f8b-917a-906cf61841bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:42:51.259370 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d76f5ff-f97e-4f8b-917a-906cf61841bb None None] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:42:51.263895 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fb15ea-2a66-48ea-877d-a0dd05917ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:42:51.270773 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb15ea-2a66-48ea-877d-a0dd05917ab4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:42:51.270773 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb15ea-2a66-48ea-877d-a0dd05917ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:42:51.270773 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb15ea-2a66-48ea-877d-a0dd05917ab4 admin admin] PATH_INFO: `/v3/users/80631cd055354ed8ba8fa7888e4e319c` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:42:51.270773 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fb15ea-2a66-48ea-877d-a0dd05917ab4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80631cd055354ed8ba8fa7888e4e319c)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:42:51.270773 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fb15ea-2a66-48ea-877d-a0dd05917ab4 admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:42:51.461285 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-e2fb15ea-2a66-48ea-877d-a0dd05917ab4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80631cd055354ed8ba8fa7888e4e319c'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:42:51.461845 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-e2fb15ea-2a66-48ea-877d-a0dd05917ab4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80631cd055354ed8ba8fa7888e4e319c'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:42:51.472988 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-e2fb15ea-2a66-48ea-877d-a0dd05917ab4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80631cd055354ed8ba8fa7888e4e319c'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:42:51.473712 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-e2fb15ea-2a66-48ea-877d-a0dd05917ab4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80631cd055354ed8ba8fa7888e4e319c'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:42:51.480314 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-e2fb15ea-2a66-48ea-877d-a0dd05917ab4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80631cd055354ed8ba8fa7888e4e319c'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:42:51.533499 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1415/2824] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:42:51 2021] DELETE /identity/v3/users/80631cd055354ed8ba8fa7888e4e319c => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:42:51.775444 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb391c0-0481-4114-881c-6cd652e7bf5b service swift] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:42:51.786475 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb391c0-0481-4114-881c-6cd652e7bf5b service swift] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:42:51.840640 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc72c2f-d6d0-48b8-bc9b-e14203ab8a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:42:51.841489 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc72c2f-d6d0-48b8-bc9b-e14203ab8a76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:42:51.841765 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc72c2f-d6d0-48b8-bc9b-e14203ab8a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:42:51.842036 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc72c2f-d6d0-48b8-bc9b-e14203ab8a76 admin admin] PATH_INFO: `/v3/projects/8636fe098af34b33b41c75cf2f0072d5` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:42:51.843700 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc72c2f-d6d0-48b8-bc9b-e14203ab8a76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8636fe098af34b33b41c75cf2f0072d5)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:42:51.845607 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc72c2f-d6d0-48b8-bc9b-e14203ab8a76 admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:42:51.961002 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-2bc72c2f-d6d0-48b8-bc9b-e14203ab8a76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8636fe098af34b33b41c75cf2f0072d5', 'request_id': 'req-2bc72c2f-d6d0-48b8-bc9b-e14203ab8a76'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:42:52.042084 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-2bc72c2f-d6d0-48b8-bc9b-e14203ab8a76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8636fe098af34b33b41c75cf2f0072d5', 'request_id': 'req-2bc72c2f-d6d0-48b8-bc9b-e14203ab8a76'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:42:52.048974 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-2bc72c2f-d6d0-48b8-bc9b-e14203ab8a76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8636fe098af34b33b41c75cf2f0072d5', 'request_id': 'req-2bc72c2f-d6d0-48b8-bc9b-e14203ab8a76'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:42:52.059079 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-2bc72c2f-d6d0-48b8-bc9b-e14203ab8a76 admin admin] The token cache is being invalidate because project 8636fe098af34b33b41c75cf2f0072d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:42:52.059360 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-2bc72c2f-d6d0-48b8-bc9b-e14203ab8a76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:42:52.060010 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-2bc72c2f-d6d0-48b8-bc9b-e14203ab8a76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:42:52.061555 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1410/2825] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:42:51 2021] DELETE /identity/v3/projects/8636fe098af34b33b41c75cf2f0072d5 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:42:52.065767 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fb15ea-2a66-48ea-877d-a0dd05917ab4 admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:42:52.067126 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-e2fb15ea-2a66-48ea-877d-a0dd05917ab4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:42:52.080286 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fb15ea-2a66-48ea-877d-a0dd05917ab4 admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:42:52.133942 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1675c8-51dc-49ee-babe-dd7ae892aeea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:42:52.134797 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1675c8-51dc-49ee-babe-dd7ae892aeea admin admin] REQUEST_METHOD: `DELETE` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:42:52.135075 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1675c8-51dc-49ee-babe-dd7ae892aeea admin admin] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:42:52.135342 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1675c8-51dc-49ee-babe-dd7ae892aeea admin admin] PATH_INFO: `/v3/users/6d407660f2614242a7c34ec39258b0f9` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:42:52.136562 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1675c8-51dc-49ee-babe-dd7ae892aeea admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d407660f2614242a7c34ec39258b0f9)` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:42:52.138480 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1675c8-51dc-49ee-babe-dd7ae892aeea admin admin] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:42:52.358465 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-7a1675c8-51dc-49ee-babe-dd7ae892aeea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d407660f2614242a7c34ec39258b0f9'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:42:52.359128 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-7a1675c8-51dc-49ee-babe-dd7ae892aeea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d407660f2614242a7c34ec39258b0f9'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:42:52.370319 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-7a1675c8-51dc-49ee-babe-dd7ae892aeea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d407660f2614242a7c34ec39258b0f9'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:42:52.371026 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-7a1675c8-51dc-49ee-babe-dd7ae892aeea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d407660f2614242a7c34ec39258b0f9'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:42:52.377926 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.notifications [None req-7a1675c8-51dc-49ee-babe-dd7ae892aeea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d407660f2614242a7c34ec39258b0f9'} {{(pid=74005) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:42:52.447868 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1416/2826] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Oct 12 18:42:52 2021] DELETE /identity/v3/users/6d407660f2614242a7c34ec39258b0f9 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:42:52.753407 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc72c2f-d6d0-48b8-bc9b-e14203ab8a76 admin admin] Authenticating user token {{(pid=74006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:42:52.754825 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.fernet_utils [None req-2bc72c2f-d6d0-48b8-bc9b-e14203ab8a76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:42:52.768331 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc72c2f-d6d0-48b8-bc9b-e14203ab8a76 admin admin] Validating token access rules against request {{(pid=74006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:42:52.823045 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5de285e-9899-4ff5-b14c-bd976735e36c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31651079c8d04df8a5fb70d40851475c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e340b2a295714eb294f0cebe48fde56d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:42:52.823896 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de285e-9899-4ff5-b14c-bd976735e36c admin admin] REQUEST_METHOD: `DELETE` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:42:52.824175 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de285e-9899-4ff5-b14c-bd976735e36c admin admin] SCRIPT_NAME: `/identity` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:42:52.824474 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de285e-9899-4ff5-b14c-bd976735e36c admin admin] PATH_INFO: `/v3/projects/1865fa2ebc104ef69e8ba3fbb30bf125` {{(pid=74006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:42:52.825666 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5de285e-9899-4ff5-b14c-bd976735e36c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1865fa2ebc104ef69e8ba3fbb30bf125)` {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:42:52.828648 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5de285e-9899-4ff5-b14c-bd976735e36c admin admin] RBAC: Authorization granted {{(pid=74006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:42:52.996978 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-d5de285e-9899-4ff5-b14c-bd976735e36c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1865fa2ebc104ef69e8ba3fbb30bf125', 'request_id': 'req-d5de285e-9899-4ff5-b14c-bd976735e36c'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:42:53.071031 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-d5de285e-9899-4ff5-b14c-bd976735e36c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1865fa2ebc104ef69e8ba3fbb30bf125', 'request_id': 'req-d5de285e-9899-4ff5-b14c-bd976735e36c'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:42:53.077441 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-d5de285e-9899-4ff5-b14c-bd976735e36c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1865fa2ebc104ef69e8ba3fbb30bf125', 'request_id': 'req-d5de285e-9899-4ff5-b14c-bd976735e36c'} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:42:53.087629 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-d5de285e-9899-4ff5-b14c-bd976735e36c admin admin] The token cache is being invalidate because project 1865fa2ebc104ef69e8ba3fbb30bf125 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=74006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 18:42:53.087912 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-d5de285e-9899-4ff5-b14c-bd976735e36c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:42:53.088568 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: DEBUG keystone.notifications [None req-d5de285e-9899-4ff5-b14c-bd976735e36c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=74006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 18:42:53.090171 dv-cinder-813227-2-iscsi devstack@keystone.service[74006]: [pid: 74006|app: 0|req: 1411/2827] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Oct 12 18:42:52 2021] DELETE /identity/v3/projects/1865fa2ebc104ef69e8ba3fbb30bf125 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 18:44:54.609319 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1675c8-51dc-49ee-babe-dd7ae892aeea admin admin] Authenticating user token {{(pid=74005) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 18:44:54.610803 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-7a1675c8-51dc-49ee-babe-dd7ae892aeea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:44:54.691218 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1675c8-51dc-49ee-babe-dd7ae892aeea admin admin] Validating token access rules against request {{(pid=74005) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 18:44:54.756161 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517906d1-bf3d-42ff-bb21-1e6e254da020 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bd99e4f2d444a388ecde7ea3cb61089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e843aaa9e5e44a8e98f7cc7412d9697b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74005) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 18:44:54.756859 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517906d1-bf3d-42ff-bb21-1e6e254da020 service placement] REQUEST_METHOD: `GET` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 18:44:54.757140 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517906d1-bf3d-42ff-bb21-1e6e254da020 service placement] SCRIPT_NAME: `/identity` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 18:44:54.757412 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517906d1-bf3d-42ff-bb21-1e6e254da020 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=74005) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 18:44:54.759643 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.fernet_utils [None req-517906d1-bf3d-42ff-bb21-1e6e254da020 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=74005) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 18:44:54.772177 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517906d1-bf3d-42ff-bb21-1e6e254da020 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 18:44:54.773821 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517906d1-bf3d-42ff-bb21-1e6e254da020 service placement] RBAC: Authorization granted {{(pid=74005) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 18:44:54.785786 dv-cinder-813227-2-iscsi devstack@keystone.service[74005]: [pid: 74005|app: 0|req: 1417/2828] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 12 18:44:54 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)